2023-11-30T22:58:04.774 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-11-30T22:58:04.774 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_20.04} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}} --name yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473010 --owner scheduled_yuriw@teuthology --verbose -- /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473010/orig.config.yaml 2023-11-30T22:58:04.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:58:04.907 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473010 branch: reef-release description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_20.04} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}} email: yweinste@redhat.com first_in_suite: false job_id: '7473010' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: reef-release ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a6f82997ac57b70a895455dfed6256360a1e4c32 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a6f82997ac57b70a895455dfed6256360a1e4c32 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef-release sha1: a6f82997ac57b70a895455dfed6256360a1e4c32 owner: scheduled_yuriw@teuthology priority: 55 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 8832 sha1: a6f82997ac57b70a895455dfed6256360a1e4c32 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: reef-release suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: a6f82997ac57b70a895455dfed6256360a1e4c32 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi156.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - check-counter: counters: mds: - mds.dir_split - workunit: clients: client.0: - libcephfs/test.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-11-30_22:47:08 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-30T22:58:04.908 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa; will attempt to use it 2023-11-30T22:58:04.908 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa/tasks 2023-11-30T22:58:04.909 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-30T22:58:04.912 INFO:teuthology.task.internal:Checking packages... 2023-11-30T22:58:04.945 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a6f82997ac57b70a895455dfed6256360a1e4c32' 2023-11-30T22:58:04.945 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-30T22:58:04.945 INFO:teuthology.packaging:ref: None 2023-11-30T22:58:04.945 INFO:teuthology.packaging:tag: None 2023-11-30T22:58:04.945 INFO:teuthology.packaging:branch: reef-release 2023-11-30T22:58:04.945 INFO:teuthology.packaging:sha1: a6f82997ac57b70a895455dfed6256360a1e4c32 2023-11-30T22:58:04.946 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=reef-release 2023-11-30T22:58:05.214 INFO:teuthology.task.internal:Found packages for ceph version 18.2.0-1249-ga6f82997-1focal 2023-11-30T22:58:05.214 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-30T22:58:05.221 INFO:teuthology.task.internal:no buildpackages task found 2023-11-30T22:58:05.221 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-30T22:58:05.288 INFO:teuthology.task.internal:Saving configuration 2023-11-30T22:58:05.308 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-30T22:58:05.314 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-30T22:58:05.339 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473010', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-30 22:51:46.750546', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-11-30T22:58:05.362 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473010', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-30 22:51:46.749061', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-11-30T22:58:05.362 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-30T22:58:05.368 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-11-30T22:58:05.368 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-11-30T22:58:05.368 INFO:teuthology.run_tasks:Running task console_log... 2023-11-30T22:58:05.446 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fef95f92dc0>, signals=[15]) 2023-11-30T22:58:05.447 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-30T22:58:05.453 INFO:teuthology.task.internal:Opening connections... 2023-11-30T22:58:05.453 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2023-11-30T22:58:05.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:58:05.507 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi156.front.sepia.ceph.com 2023-11-30T22:58:05.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:58:05.555 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-30T22:58:05.562 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2023-11-30T22:58:05.584 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2023-11-30T22:58:05.585 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-11-30T22:58:05.635 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Ubuntu" 2023-11-30T22:58:05.635 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-30T22:58:05.635 INFO:teuthology.orchestra.run.smithi073.stdout:ID=ubuntu 2023-11-30T22:58:05.635 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE=debian 2023-11-30T22:58:05.635 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-30T22:58:05.635 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="20.04" 2023-11-30T22:58:05.635 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-30T22:58:05.635 INFO:teuthology.orchestra.run.smithi073.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-30T22:58:05.636 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-30T22:58:05.636 INFO:teuthology.orchestra.run.smithi073.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-30T22:58:05.636 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_CODENAME=focal 2023-11-30T22:58:05.636 INFO:teuthology.orchestra.run.smithi073.stdout:UBUNTU_CODENAME=focal 2023-11-30T22:58:05.636 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-11-30T22:58:05.655 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-11-30T22:58:05.662 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-11-30T22:58:05.663 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-11-30T22:58:05.712 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Ubuntu" 2023-11-30T22:58:05.712 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-30T22:58:05.712 INFO:teuthology.orchestra.run.smithi156.stdout:ID=ubuntu 2023-11-30T22:58:05.712 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE=debian 2023-11-30T22:58:05.712 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-30T22:58:05.713 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="20.04" 2023-11-30T22:58:05.713 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-30T22:58:05.713 INFO:teuthology.orchestra.run.smithi156.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-30T22:58:05.713 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-30T22:58:05.713 INFO:teuthology.orchestra.run.smithi156.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-30T22:58:05.713 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_CODENAME=focal 2023-11-30T22:58:05.713 INFO:teuthology.orchestra.run.smithi156.stdout:UBUNTU_CODENAME=focal 2023-11-30T22:58:05.713 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-11-30T22:58:05.738 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-30T22:58:05.748 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-30T22:58:05.776 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-30T22:58:05.776 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2023-11-30T22:58:05.779 DEBUG:teuthology.orchestra.run.smithi156:> test '!' -e /home/ubuntu/cephtest 2023-11-30T22:58:05.784 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-30T22:58:05.790 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-30T22:58:05.790 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2023-11-30T22:58:05.792 DEBUG:teuthology.orchestra.run.smithi156:> test -z $(ls -A /var/lib/ceph) 2023-11-30T22:58:05.808 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-30T22:58:05.863 INFO:teuthology.run_tasks:Running task kernel... 2023-11-30T22:58:05.877 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-30T22:58:05.877 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-30T22:58:05.877 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-30T22:58:05.878 DEBUG:teuthology.orchestra.run.smithi156:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-30T22:58:05.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T22:58:05.883 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2023-11-30T22:58:05.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T22:58:05.884 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2023-11-30T22:58:05.890 INFO:teuthology.orchestra.run.smithi073.stdout:5.4.0-124-generic 2023-11-30T22:58:05.890 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.4.0-124-generic 2023-11-30T22:58:05.890 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get clean 2023-11-30T22:58:05.891 INFO:teuthology.orchestra.run.smithi156.stdout:5.4.0-124-generic 2023-11-30T22:58:05.892 INFO:teuthology.task.kernel:Running kernel on smithi156: 5.4.0-124-generic 2023-11-30T22:58:05.892 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-get clean 2023-11-30T22:58:05.991 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-get update 2023-11-30T22:58:06.006 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2023-11-30T22:58:06.170 INFO:teuthology.orchestra.run.smithi156.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-11-30T22:58:06.175 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-30T22:58:06.175 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-11-30T22:58:06.175 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-11-30T22:58:06.238 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-11-30T22:58:06.263 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-30T22:58:06.326 INFO:teuthology.orchestra.run.smithi156.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-11-30T22:58:06.538 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [680 kB] 2023-11-30T22:58:06.630 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,604 kB] 2023-11-30T22:58:06.640 INFO:teuthology.orchestra.run.smithi156.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [680 kB] 2023-11-30T22:58:06.670 INFO:teuthology.orchestra.run.smithi156.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-11-30T22:58:06.673 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [402 kB] 2023-11-30T22:58:06.673 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [913 kB] 2023-11-30T22:58:06.677 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-11-30T22:58:06.678 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [34.7 kB] 2023-11-30T22:58:06.679 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,411 kB] 2023-11-30T22:58:06.704 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [336 kB] 2023-11-30T22:58:06.708 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2023-11-30T22:58:06.709 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [630 kB] 2023-11-30T22:58:06.716 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [911 kB] 2023-11-30T22:58:06.723 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [191 kB] 2023-11-30T22:58:06.724 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2023-11-30T22:58:06.725 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-11-30T22:58:06.725 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2023-11-30T22:58:06.726 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-11-30T22:58:06.726 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-11-30T22:58:06.741 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,994 kB] 2023-11-30T22:58:06.778 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [484 kB] 2023-11-30T22:58:06.781 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2023-11-30T22:58:06.781 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,528 kB] 2023-11-30T22:58:06.798 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.0 kB] 2023-11-30T22:58:06.798 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [353 kB] 2023-11-30T22:58:06.800 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2023-11-30T22:58:06.800 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [758 kB] 2023-11-30T22:58:06.805 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,136 kB] 2023-11-30T22:58:06.808 INFO:teuthology.orchestra.run.smithi156.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,604 kB] 2023-11-30T22:58:06.812 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [272 kB] 2023-11-30T22:58:06.815 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2023-11-30T22:58:06.815 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-11-30T22:58:06.815 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2023-11-30T22:58:06.829 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-11-30T22:58:06.830 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-11-30T22:58:06.830 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-11-30T22:58:06.830 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-11-30T22:58:06.831 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-11-30T22:58:06.845 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-11-30T22:58:06.846 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-11-30T22:58:06.846 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-11-30T22:58:06.847 INFO:teuthology.orchestra.run.smithi156.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,994 kB] 2023-11-30T22:58:06.975 INFO:teuthology.orchestra.run.smithi156.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [402 kB] 2023-11-30T22:58:06.989 INFO:teuthology.orchestra.run.smithi156.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-11-30T22:58:06.990 INFO:teuthology.orchestra.run.smithi156.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,411 kB] 2023-11-30T22:58:07.158 INFO:teuthology.orchestra.run.smithi156.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [34.7 kB] 2023-11-30T22:58:07.159 INFO:teuthology.orchestra.run.smithi156.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [336 kB] 2023-11-30T22:58:07.184 INFO:teuthology.orchestra.run.smithi156.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2023-11-30T22:58:07.185 INFO:teuthology.orchestra.run.smithi156.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [630 kB] 2023-11-30T22:58:07.225 INFO:teuthology.orchestra.run.smithi156.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [911 kB] 2023-11-30T22:58:07.283 INFO:teuthology.orchestra.run.smithi156.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [191 kB] 2023-11-30T22:58:07.295 INFO:teuthology.orchestra.run.smithi156.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2023-11-30T22:58:07.296 INFO:teuthology.orchestra.run.smithi156.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-11-30T22:58:07.298 INFO:teuthology.orchestra.run.smithi156.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2023-11-30T22:58:07.298 INFO:teuthology.orchestra.run.smithi156.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-11-30T22:58:07.299 INFO:teuthology.orchestra.run.smithi156.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-11-30T22:58:07.314 INFO:teuthology.orchestra.run.smithi156.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [913 kB] 2023-11-30T22:58:07.331 INFO:teuthology.orchestra.run.smithi156.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [484 kB] 2023-11-30T22:58:07.341 INFO:teuthology.orchestra.run.smithi156.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2023-11-30T22:58:07.341 INFO:teuthology.orchestra.run.smithi156.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.0 kB] 2023-11-30T22:58:07.341 INFO:teuthology.orchestra.run.smithi156.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,528 kB] 2023-11-30T22:58:07.418 INFO:teuthology.orchestra.run.smithi156.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [353 kB] 2023-11-30T22:58:07.425 INFO:teuthology.orchestra.run.smithi156.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2023-11-30T22:58:07.589 INFO:teuthology.orchestra.run.smithi156.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [758 kB] 2023-11-30T22:58:08.175 INFO:teuthology.orchestra.run.smithi156.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,136 kB] 2023-11-30T22:58:08.284 INFO:teuthology.orchestra.run.smithi156.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [272 kB] 2023-11-30T22:58:08.305 INFO:teuthology.orchestra.run.smithi156.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2023-11-30T22:58:08.306 INFO:teuthology.orchestra.run.smithi156.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-11-30T22:58:08.308 INFO:teuthology.orchestra.run.smithi156.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2023-11-30T22:58:08.309 INFO:teuthology.orchestra.run.smithi156.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-11-30T22:58:08.309 INFO:teuthology.orchestra.run.smithi156.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-11-30T22:58:08.309 INFO:teuthology.orchestra.run.smithi156.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-11-30T22:58:08.312 INFO:teuthology.orchestra.run.smithi156.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-11-30T22:58:08.315 INFO:teuthology.orchestra.run.smithi156.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-11-30T22:58:08.479 INFO:teuthology.orchestra.run.smithi156.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-11-30T22:58:08.642 INFO:teuthology.orchestra.run.smithi156.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-11-30T22:58:08.693 INFO:teuthology.orchestra.run.smithi156.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-11-30T22:58:10.535 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 18.3 MB in 3s (7,090 kB/s) 2023-11-30T22:58:11.067 INFO:teuthology.orchestra.run.smithi156.stdout:Fetched 18.3 MB in 3s (6,240 kB/s) 2023-11-30T22:58:11.993 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2023-11-30T22:58:12.020 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-30T22:58:12.104 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2023-11-30T22:58:12.307 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2023-11-30T22:58:12.308 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2023-11-30T22:58:12.503 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2023-11-30T22:58:12.503 INFO:teuthology.orchestra.run.smithi073.stdout: linux-generic linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-11-30T22:58:12.504 INFO:teuthology.orchestra.run.smithi073.stdout: linux-headers-generic linux-image-5.4.0-167-generic 2023-11-30T22:58:12.504 INFO:teuthology.orchestra.run.smithi073.stdout: linux-modules-5.4.0-167-generic linux-modules-extra-5.4.0-167-generic 2023-11-30T22:58:12.505 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2023-11-30T22:58:12.505 INFO:teuthology.orchestra.run.smithi073.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-11-30T22:58:12.505 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2023-11-30T22:58:12.505 INFO:teuthology.orchestra.run.smithi073.stdout: thermald 2023-11-30T22:58:12.517 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2023-11-30T22:58:12.542 DEBUG:teuthology.orchestra.run.smithi156:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-30T22:58:12.564 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2023-11-30T22:58:12.564 INFO:teuthology.orchestra.run.smithi073.stdout: linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-11-30T22:58:12.564 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-167-generic linux-modules-5.4.0-167-generic 2023-11-30T22:58:12.564 INFO:teuthology.orchestra.run.smithi073.stdout: linux-modules-extra-5.4.0-167-generic 2023-11-30T22:58:12.565 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2023-11-30T22:58:12.566 INFO:teuthology.orchestra.run.smithi073.stdout: linux-generic linux-headers-generic linux-image-generic 2023-11-30T22:58:12.615 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2023-11-30T22:58:12.620 INFO:teuthology.orchestra.run.smithi073.stdout:3 upgraded, 5 newly installed, 0 to remove and 280 not upgraded. 2023-11-30T22:58:12.620 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 77.0 MB of archives. 2023-11-30T22:58:12.620 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 380 MB of additional disk space will be used. 2023-11-30T22:58:12.620 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-167-generic amd64 5.4.0-167.184 [15.0 MB] 2023-11-30T22:58:12.819 INFO:teuthology.orchestra.run.smithi156.stdout:Building dependency tree... 2023-11-30T22:58:12.819 INFO:teuthology.orchestra.run.smithi156.stdout:Reading state information... 2023-11-30T22:58:12.931 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-167-generic amd64 5.4.0-167.184 [10.5 MB] 2023-11-30T22:58:13.009 INFO:teuthology.orchestra.run.smithi156.stdout:The following additional packages will be installed: 2023-11-30T22:58:13.010 INFO:teuthology.orchestra.run.smithi156.stdout: linux-generic linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-11-30T22:58:13.010 INFO:teuthology.orchestra.run.smithi156.stdout: linux-headers-generic linux-image-5.4.0-167-generic 2023-11-30T22:58:13.010 INFO:teuthology.orchestra.run.smithi156.stdout: linux-modules-5.4.0-167-generic linux-modules-extra-5.4.0-167-generic 2023-11-30T22:58:13.012 INFO:teuthology.orchestra.run.smithi156.stdout:Suggested packages: 2023-11-30T22:58:13.012 INFO:teuthology.orchestra.run.smithi156.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-11-30T22:58:13.012 INFO:teuthology.orchestra.run.smithi156.stdout:Recommended packages: 2023-11-30T22:58:13.012 INFO:teuthology.orchestra.run.smithi156.stdout: thermald 2023-11-30T22:58:13.026 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-167-generic amd64 5.4.0-167.184 [39.2 MB] 2023-11-30T22:58:13.070 INFO:teuthology.orchestra.run.smithi156.stdout:The following NEW packages will be installed: 2023-11-30T22:58:13.071 INFO:teuthology.orchestra.run.smithi156.stdout: linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-11-30T22:58:13.071 INFO:teuthology.orchestra.run.smithi156.stdout: linux-image-5.4.0-167-generic linux-modules-5.4.0-167-generic 2023-11-30T22:58:13.071 INFO:teuthology.orchestra.run.smithi156.stdout: linux-modules-extra-5.4.0-167-generic 2023-11-30T22:58:13.072 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages will be upgraded: 2023-11-30T22:58:13.072 INFO:teuthology.orchestra.run.smithi156.stdout: linux-generic linux-headers-generic linux-image-generic 2023-11-30T22:58:13.255 INFO:teuthology.orchestra.run.smithi156.stdout:3 upgraded, 5 newly installed, 0 to remove and 280 not upgraded. 2023-11-30T22:58:13.255 INFO:teuthology.orchestra.run.smithi156.stdout:Need to get 77.0 MB of archives. 2023-11-30T22:58:13.255 INFO:teuthology.orchestra.run.smithi156.stdout:After this operation, 380 MB of additional disk space will be used. 2023-11-30T22:58:13.255 INFO:teuthology.orchestra.run.smithi156.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-167-generic amd64 5.4.0-167.184 [15.0 MB] 2023-11-30T22:58:13.499 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.167.164 [1,900 B] 2023-11-30T22:58:13.499 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.167.164 [2,564 B] 2023-11-30T22:58:13.499 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167 all 5.4.0-167.184 [11.0 MB] 2023-11-30T22:58:13.590 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167-generic amd64 5.4.0-167.184 [1,367 kB] 2023-11-30T22:58:13.600 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.167.164 [2,428 B] 2023-11-30T22:58:14.272 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 77.0 MB in 1s (75.0 MB/s) 2023-11-30T22:58:14.422 INFO:teuthology.orchestra.run.smithi156.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-167-generic amd64 5.4.0-167.184 [10.5 MB] 2023-11-30T22:58:14.451 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-modules-5.4.0-167-generic. 2023-11-30T22:58:14.738 INFO:teuthology.orchestra.run.smithi156.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-167-generic amd64 5.4.0-167.184 [39.2 MB] 2023-11-30T22:58:16.083 INFO:teuthology.orchestra.run.smithi156.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.167.164 [1,900 B] 2023-11-30T22:58:16.083 INFO:teuthology.orchestra.run.smithi156.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.167.164 [2,564 B] 2023-11-30T22:58:16.083 INFO:teuthology.orchestra.run.smithi156.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167 all 5.4.0-167.184 [11.0 MB] 2023-11-30T22:58:16.215 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-11-30T22:58:16.220 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../0-linux-modules-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-30T22:58:16.307 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-30T22:58:16.446 INFO:teuthology.orchestra.run.smithi156.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167-generic amd64 5.4.0-167.184 [1,367 kB] 2023-11-30T22:58:16.487 INFO:teuthology.orchestra.run.smithi156.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.167.164 [2,428 B] 2023-11-30T22:58:17.170 INFO:teuthology.orchestra.run.smithi156.stdout:Fetched 77.0 MB in 3s (22.6 MB/s) 2023-11-30T22:58:17.364 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package linux-modules-5.4.0-167-generic. 2023-11-30T22:58:18.241 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-image-5.4.0-167-generic. 2023-11-30T22:58:18.254 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../1-linux-image-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-30T22:58:18.346 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-30T22:58:19.091 INFO:teuthology.orchestra.run.smithi156.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-11-30T22:58:19.096 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../0-linux-modules-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-30T22:58:19.169 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-30T22:58:19.428 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-167-generic. 2023-11-30T22:58:19.441 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-30T22:58:19.486 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-30T22:58:21.127 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package linux-image-5.4.0-167-generic. 2023-11-30T22:58:21.143 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../1-linux-image-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-30T22:58:21.240 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-30T22:58:22.322 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-167-generic. 2023-11-30T22:58:22.338 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-30T22:58:22.380 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-30T22:58:24.414 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../3-linux-generic_5.4.0.167.164_amd64.deb ... 2023-11-30T22:58:24.536 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-30T22:58:24.888 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.167.164_amd64.deb ... 2023-11-30T22:58:25.014 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-30T22:58:25.342 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-headers-5.4.0-167. 2023-11-30T22:58:25.357 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../5-linux-headers-5.4.0-167_5.4.0-167.184_all.deb ... 2023-11-30T22:58:25.400 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-11-30T22:58:27.066 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../3-linux-generic_5.4.0.167.164_amd64.deb ... 2023-11-30T22:58:27.192 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-30T22:58:27.519 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.167.164_amd64.deb ... 2023-11-30T22:58:27.646 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-image-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-30T22:58:28.007 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package linux-headers-5.4.0-167. 2023-11-30T22:58:28.021 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../5-linux-headers-5.4.0-167_5.4.0-167.184_all.deb ... 2023-11-30T22:58:28.065 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-11-30T22:58:30.728 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-headers-5.4.0-167-generic. 2023-11-30T22:58:30.748 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../6-linux-headers-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-30T22:58:30.785 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-30T22:58:33.512 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.167.164_amd64.deb ... 2023-11-30T22:58:33.567 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package linux-headers-5.4.0-167-generic. 2023-11-30T22:58:33.589 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../6-linux-headers-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-30T22:58:33.633 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-30T22:58:33.666 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-30T22:58:33.982 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-30T22:58:35.188 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-11-30T22:58:35.314 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-30T22:58:35.440 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-30T22:58:36.323 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.167.164_amd64.deb ... 2023-11-30T22:58:36.451 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking linux-headers-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-30T22:58:36.611 INFO:teuthology.orchestra.run.smithi073.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-167-generic 2023-11-30T22:58:36.611 INFO:teuthology.orchestra.run.smithi073.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-167-generic 2023-11-30T22:58:36.742 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-30T22:58:36.793 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-30T22:58:37.918 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-generic (5.4.0.167.164) ... 2023-11-30T22:58:38.048 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-11-30T22:58:38.061 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-generic (5.4.0.167.164) ... 2023-11-30T22:58:38.174 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-30T22:58:38.187 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-generic (5.4.0.167.164) ... 2023-11-30T22:58:38.300 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-30T22:58:38.339 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-30T22:58:38.410 INFO:teuthology.orchestra.run.smithi073.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-11-30T22:58:38.411 INFO:teuthology.orchestra.run.smithi073.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-167-generic 2023-11-30T22:58:39.441 INFO:teuthology.orchestra.run.smithi156.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-167-generic 2023-11-30T22:58:39.442 INFO:teuthology.orchestra.run.smithi156.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-167-generic 2023-11-30T22:58:39.586 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-30T22:58:41.287 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-image-generic (5.4.0.167.164) ... 2023-11-30T22:58:41.414 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-headers-generic (5.4.0.167.164) ... 2023-11-30T22:58:41.540 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up linux-generic (5.4.0.167.164) ... 2023-11-30T22:58:41.666 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-30T22:58:41.750 INFO:teuthology.orchestra.run.smithi156.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-11-30T22:58:41.750 INFO:teuthology.orchestra.run.smithi156.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-167-generic 2023-11-30T22:59:00.282 INFO:teuthology.orchestra.run.smithi073.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-11-30T22:59:00.282 INFO:teuthology.orchestra.run.smithi073.stdout:Sourcing file `/etc/default/grub' 2023-11-30T22:59:00.301 INFO:teuthology.orchestra.run.smithi073.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-30T22:59:00.317 INFO:teuthology.orchestra.run.smithi073.stdout:Generating grub configuration file ... 2023-11-30T22:59:00.682 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-11-30T22:59:00.708 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-11-30T22:59:01.125 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-30T22:59:01.137 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-30T22:59:03.786 INFO:teuthology.orchestra.run.smithi156.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-11-30T22:59:03.786 INFO:teuthology.orchestra.run.smithi156.stdout:Sourcing file `/etc/default/grub' 2023-11-30T22:59:03.798 INFO:teuthology.orchestra.run.smithi156.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-30T22:59:03.819 INFO:teuthology.orchestra.run.smithi156.stdout:Generating grub configuration file ... 2023-11-30T22:59:03.822 INFO:teuthology.orchestra.run.smithi073.stdout:done 2023-11-30T22:59:04.126 INFO:teuthology.orchestra.run.smithi156.stdout:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-11-30T22:59:04.146 INFO:teuthology.orchestra.run.smithi156.stdout:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-11-30T22:59:04.301 DEBUG:teuthology.orchestra.run.smithi073:> dpkg -s linux-image-generic 2023-11-30T22:59:04.341 INFO:teuthology.orchestra.run.smithi073.stdout:Package: linux-image-generic 2023-11-30T22:59:04.342 INFO:teuthology.orchestra.run.smithi073.stdout:Status: install ok installed 2023-11-30T22:59:04.342 INFO:teuthology.orchestra.run.smithi073.stdout:Priority: optional 2023-11-30T22:59:04.342 INFO:teuthology.orchestra.run.smithi073.stdout:Section: kernel 2023-11-30T22:59:04.342 INFO:teuthology.orchestra.run.smithi073.stdout:Installed-Size: 20 2023-11-30T22:59:04.342 INFO:teuthology.orchestra.run.smithi073.stdout:Maintainer: Ubuntu Kernel Team 2023-11-30T22:59:04.342 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: amd64 2023-11-30T22:59:04.342 INFO:teuthology.orchestra.run.smithi073.stdout:Source: linux-meta 2023-11-30T22:59:04.342 INFO:teuthology.orchestra.run.smithi073.stdout:Version: 5.4.0.167.164 2023-11-30T22:59:04.342 INFO:teuthology.orchestra.run.smithi073.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-11-30T22:59:04.342 INFO:teuthology.orchestra.run.smithi073.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-30T22:59:04.342 INFO:teuthology.orchestra.run.smithi073.stdout:Recommends: thermald 2023-11-30T22:59:04.342 INFO:teuthology.orchestra.run.smithi073.stdout:Description: Generic Linux kernel image 2023-11-30T22:59:04.342 INFO:teuthology.orchestra.run.smithi073.stdout: This package will always depend on the latest generic kernel image 2023-11-30T22:59:04.342 INFO:teuthology.orchestra.run.smithi073.stdout: available. 2023-11-30T22:59:04.343 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-167-generic 2023-11-30T22:59:04.343 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-30T22:59:04.343 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-30T22:59:04.343 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-30T22:59:04.343 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2023-11-30T22:59:04.343 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get clean 2023-11-30T22:59:04.442 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2023-11-30T22:59:04.524 INFO:teuthology.orchestra.run.smithi156.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-30T22:59:04.535 INFO:teuthology.orchestra.run.smithi156.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-30T22:59:04.700 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-30T22:59:04.700 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-30T22:59:04.772 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-30T22:59:04.854 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-30T22:59:06.314 INFO:teuthology.orchestra.run.smithi156.stdout:done 2023-11-30T22:59:06.458 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2023-11-30T22:59:06.484 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-30T22:59:06.550 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2023-11-30T22:59:06.739 DEBUG:teuthology.orchestra.run.smithi156:> dpkg -s linux-image-generic 2023-11-30T22:59:06.753 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2023-11-30T22:59:06.753 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2023-11-30T22:59:06.804 INFO:teuthology.orchestra.run.smithi156.stdout:Package: linux-image-generic 2023-11-30T22:59:06.804 INFO:teuthology.orchestra.run.smithi156.stdout:Status: install ok installed 2023-11-30T22:59:06.804 INFO:teuthology.orchestra.run.smithi156.stdout:Priority: optional 2023-11-30T22:59:06.804 INFO:teuthology.orchestra.run.smithi156.stdout:Section: kernel 2023-11-30T22:59:06.804 INFO:teuthology.orchestra.run.smithi156.stdout:Installed-Size: 20 2023-11-30T22:59:06.804 INFO:teuthology.orchestra.run.smithi156.stdout:Maintainer: Ubuntu Kernel Team 2023-11-30T22:59:06.804 INFO:teuthology.orchestra.run.smithi156.stdout:Architecture: amd64 2023-11-30T22:59:06.804 INFO:teuthology.orchestra.run.smithi156.stdout:Source: linux-meta 2023-11-30T22:59:06.805 INFO:teuthology.orchestra.run.smithi156.stdout:Version: 5.4.0.167.164 2023-11-30T22:59:06.805 INFO:teuthology.orchestra.run.smithi156.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-11-30T22:59:06.805 INFO:teuthology.orchestra.run.smithi156.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-30T22:59:06.805 INFO:teuthology.orchestra.run.smithi156.stdout:Recommends: thermald 2023-11-30T22:59:06.805 INFO:teuthology.orchestra.run.smithi156.stdout:Description: Generic Linux kernel image 2023-11-30T22:59:06.805 INFO:teuthology.orchestra.run.smithi156.stdout: This package will always depend on the latest generic kernel image 2023-11-30T22:59:06.805 INFO:teuthology.orchestra.run.smithi156.stdout: available. 2023-11-30T22:59:06.805 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-167-generic 2023-11-30T22:59:06.805 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-30T22:59:06.805 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-30T22:59:06.805 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-30T22:59:06.805 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi156.front.sepia.ceph.com, path=None, version=distro) 2023-11-30T22:59:06.806 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-get clean 2023-11-30T22:59:06.896 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-get update 2023-11-30T22:59:06.971 INFO:teuthology.orchestra.run.smithi073.stdout:linux-image-generic is already the newest version (5.4.0.167.164). 2023-11-30T22:59:06.971 INFO:teuthology.orchestra.run.smithi073.stdout:0 upgraded, 0 newly installed, 0 to remove and 280 not upgraded. 2023-11-30T22:59:06.973 DEBUG:teuthology.orchestra.run.smithi073:> dpkg -s linux-image-generic 2023-11-30T22:59:06.990 INFO:teuthology.orchestra.run.smithi073.stdout:Package: linux-image-generic 2023-11-30T22:59:06.990 INFO:teuthology.orchestra.run.smithi073.stdout:Status: install ok installed 2023-11-30T22:59:06.990 INFO:teuthology.orchestra.run.smithi073.stdout:Priority: optional 2023-11-30T22:59:06.990 INFO:teuthology.orchestra.run.smithi073.stdout:Section: kernel 2023-11-30T22:59:06.990 INFO:teuthology.orchestra.run.smithi073.stdout:Installed-Size: 20 2023-11-30T22:59:06.990 INFO:teuthology.orchestra.run.smithi073.stdout:Maintainer: Ubuntu Kernel Team 2023-11-30T22:59:06.990 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: amd64 2023-11-30T22:59:06.990 INFO:teuthology.orchestra.run.smithi073.stdout:Source: linux-meta 2023-11-30T22:59:06.990 INFO:teuthology.orchestra.run.smithi073.stdout:Version: 5.4.0.167.164 2023-11-30T22:59:06.990 INFO:teuthology.orchestra.run.smithi073.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-11-30T22:59:06.990 INFO:teuthology.orchestra.run.smithi073.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-30T22:59:06.991 INFO:teuthology.orchestra.run.smithi073.stdout:Recommends: thermald 2023-11-30T22:59:06.991 INFO:teuthology.orchestra.run.smithi073.stdout:Description: Generic Linux kernel image 2023-11-30T22:59:06.991 INFO:teuthology.orchestra.run.smithi073.stdout: This package will always depend on the latest generic kernel image 2023-11-30T22:59:06.991 INFO:teuthology.orchestra.run.smithi073.stdout: available. 2023-11-30T22:59:06.991 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-11-30T22:59:06.995 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.hU99Yr9oTi 2023-11-30T22:59:06.996 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub/grub.cfg /tmp/tmp.hU99Yr9oTi 2023-11-30T22:59:07.020 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.hU99Yr9oTi 2023-11-30T22:59:07.099 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.hU99Yr9oTi is 9KB 2023-11-30T22:59:07.114 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.hU99Yr9oTi 2023-11-30T22:59:07.120 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-11-30T22:59:07.164 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-30T22:59:07.164 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-30T22:59:07.175 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T22:59:07.175 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-11-30T22:59:07.175 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-11-30T22:59:07.212 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-167-generic 2023-11-30T22:59:07.212 DEBUG:teuthology.orchestra.run.smithi073:> sudo update-grub 2023-11-30T22:59:07.234 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-30T22:59:07.322 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-30T22:59:08.617 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub' 2023-11-30T22:59:08.625 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-30T22:59:08.642 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2023-11-30T22:59:08.946 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2023-11-30T22:59:08.952 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-11-30T22:59:08.964 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-11-30T22:59:08.972 DEBUG:teuthology.orchestra.run.smithi156:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-30T22:59:09.041 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2023-11-30T22:59:09.224 INFO:teuthology.orchestra.run.smithi156.stdout:Building dependency tree... 2023-11-30T22:59:09.224 INFO:teuthology.orchestra.run.smithi156.stdout:Reading state information... 2023-11-30T22:59:09.365 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-30T22:59:09.377 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-30T22:59:09.437 INFO:teuthology.orchestra.run.smithi156.stdout:linux-image-generic is already the newest version (5.4.0.167.164). 2023-11-30T22:59:09.437 INFO:teuthology.orchestra.run.smithi156.stdout:0 upgraded, 0 newly installed, 0 to remove and 280 not upgraded. 2023-11-30T22:59:09.438 DEBUG:teuthology.orchestra.run.smithi156:> dpkg -s linux-image-generic 2023-11-30T22:59:09.459 INFO:teuthology.orchestra.run.smithi156.stdout:Package: linux-image-generic 2023-11-30T22:59:09.459 INFO:teuthology.orchestra.run.smithi156.stdout:Status: install ok installed 2023-11-30T22:59:09.459 INFO:teuthology.orchestra.run.smithi156.stdout:Priority: optional 2023-11-30T22:59:09.459 INFO:teuthology.orchestra.run.smithi156.stdout:Section: kernel 2023-11-30T22:59:09.459 INFO:teuthology.orchestra.run.smithi156.stdout:Installed-Size: 20 2023-11-30T22:59:09.459 INFO:teuthology.orchestra.run.smithi156.stdout:Maintainer: Ubuntu Kernel Team 2023-11-30T22:59:09.459 INFO:teuthology.orchestra.run.smithi156.stdout:Architecture: amd64 2023-11-30T22:59:09.459 INFO:teuthology.orchestra.run.smithi156.stdout:Source: linux-meta 2023-11-30T22:59:09.459 INFO:teuthology.orchestra.run.smithi156.stdout:Version: 5.4.0.167.164 2023-11-30T22:59:09.460 INFO:teuthology.orchestra.run.smithi156.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-11-30T22:59:09.460 INFO:teuthology.orchestra.run.smithi156.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-30T22:59:09.460 INFO:teuthology.orchestra.run.smithi156.stdout:Recommends: thermald 2023-11-30T22:59:09.460 INFO:teuthology.orchestra.run.smithi156.stdout:Description: Generic Linux kernel image 2023-11-30T22:59:09.460 INFO:teuthology.orchestra.run.smithi156.stdout: This package will always depend on the latest generic kernel image 2023-11-30T22:59:09.460 INFO:teuthology.orchestra.run.smithi156.stdout: available. 2023-11-30T22:59:09.460 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2023-11-30T22:59:09.465 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.QO5ZfPaZ8J 2023-11-30T22:59:09.465 DEBUG:teuthology.orchestra.run.smithi156:> sudo cp /boot/grub/grub.cfg /tmp/tmp.QO5ZfPaZ8J 2023-11-30T22:59:09.531 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.QO5ZfPaZ8J 2023-11-30T22:59:09.582 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.QO5ZfPaZ8J is 9KB 2023-11-30T22:59:09.635 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.QO5ZfPaZ8J 2023-11-30T22:59:09.642 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-11-30T22:59:09.656 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T22:59:09.656 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-11-30T22:59:09.656 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-11-30T22:59:09.735 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-167-generic 2023-11-30T22:59:09.735 DEBUG:teuthology.orchestra.run.smithi156:> sudo update-grub 2023-11-30T22:59:11.016 INFO:teuthology.orchestra.run.smithi156.stderr:Sourcing file `/etc/default/grub' 2023-11-30T22:59:11.018 INFO:teuthology.orchestra.run.smithi073.stderr:done 2023-11-30T22:59:11.020 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2023-11-30T22:59:11.028 INFO:teuthology.orchestra.run.smithi156.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-30T22:59:11.049 INFO:teuthology.orchestra.run.smithi156.stderr:Generating grub configuration file ... 2023-11-30T22:59:11.301 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-11-30T22:59:11.312 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-11-30T22:59:11.663 INFO:teuthology.orchestra.run.smithi156.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-30T22:59:11.675 INFO:teuthology.orchestra.run.smithi156.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-30T22:59:12.394 INFO:teuthology.orchestra.run.smithi156.stderr:done 2023-11-30T22:59:12.395 DEBUG:teuthology.orchestra.run.smithi156:> sudo shutdown -r now 2023-11-30T22:59:41.050 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-30T22:59:41.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-30T22:59:41.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:59:42.400 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-30T22:59:42.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-30T22:59:42.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:59:59.458 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-30T23:00:00.738 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-30T23:00:08.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-30T23:00:08.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T23:00:09.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-30T23:00:09.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T23:00:11.523 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-30T23:00:12.802 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-30T23:00:23.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-30T23:00:23.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T23:00:24.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-30T23:00:24.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T23:00:41.958 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-11-30T23:00:56.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-30T23:00:56.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T23:00:57.179 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-11-30T23:00:57.766 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-30T23:00:57.766 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-167-generic"... 2023-11-30T23:00:57.766 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2023-11-30T23:00:57.812 INFO:teuthology.orchestra.run.smithi073.stdout:5.4.0-167-generic 2023-11-30T23:00:57.813 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-167-generic vs 5.4.0-167-generic 2023-11-30T23:00:57.813 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-30T23:00:57.813 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-30T23:00:58.814 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-30T23:00:58.815 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-30T23:00:58.892 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2023-11-30T23:00:58.917 DEBUG:teuthology.parallel:result is None 2023-11-30T23:01:24.807 DEBUG:teuthology.orchestra.remote:timed out 2023-11-30T23:01:39.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-30T23:01:39.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T23:01:40.017 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-11-30T23:01:40.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-30T23:01:40.556 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-167-generic"... 2023-11-30T23:01:40.557 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2023-11-30T23:01:40.562 INFO:teuthology.orchestra.run.smithi156.stdout:5.4.0-167-generic 2023-11-30T23:01:40.563 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-167-generic vs 5.4.0-167-generic 2023-11-30T23:01:40.563 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-30T23:01:40.563 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-30T23:01:41.563 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-30T23:01:41.564 DEBUG:teuthology.orchestra.run.smithi156:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-30T23:01:41.648 INFO:teuthology.orchestra.run.smithi156.stdout:ttyS1 2023-11-30T23:01:41.672 DEBUG:teuthology.parallel:result is None 2023-11-30T23:01:41.672 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-30T23:01:41.774 INFO:teuthology.task.internal:Creating test directory... 2023-11-30T23:01:41.774 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-30T23:01:41.779 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-30T23:01:41.788 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-30T23:01:41.806 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-30T23:01:41.815 INFO:teuthology.task.internal:Creating archive directory... 2023-11-30T23:01:41.816 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-30T23:01:41.830 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-30T23:01:41.855 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-30T23:01:41.945 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-30T23:01:41.945 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-30T23:01:41.948 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-30T23:01:41.967 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-30T23:01:41.974 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-30T23:01:41.979 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-30T23:01:41.985 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-30T23:01:41.986 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-30T23:01:42.072 INFO:teuthology.task.internal:Configuring sudo... 2023-11-30T23:01:42.072 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-30T23:01:42.081 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-30T23:01:42.099 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-30T23:01:42.156 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-30T23:01:42.157 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-30T23:01:42.165 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-30T23:01:42.175 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-30T23:01:42.219 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-30T23:01:42.226 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:01:42.227 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-30T23:01:42.304 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-30T23:01:42.311 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-30T23:01:42.319 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:01:42.319 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-30T23:01:42.341 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2023-11-30T23:01:42.344 DEBUG:teuthology.orchestra.run.smithi156:> sudo service rsyslog restart 2023-11-30T23:01:42.402 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-30T23:01:42.411 INFO:teuthology.task.internal:Starting timer... 2023-11-30T23:01:42.411 INFO:teuthology.run_tasks:Running task pcp... 2023-11-30T23:01:42.425 INFO:teuthology.run_tasks:Running task selinux... 2023-11-30T23:01:42.436 DEBUG:teuthology.task.selinux:Excluding smithi073: OS 'ubuntu' does not support SELinux 2023-11-30T23:01:42.436 DEBUG:teuthology.task.selinux:Excluding smithi156: OS 'ubuntu' does not support SELinux 2023-11-30T23:01:42.436 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-30T23:01:42.436 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-30T23:01:42.436 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-30T23:01:42.437 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-30T23:01:42.454 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-30T23:01:42.454 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-30T23:01:42.475 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-30T23:01:42.476 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi156.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-30T23:08:22.340 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi156.front.sepia.ceph.com')] 2023-11-30T23:08:22.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-30T23:08:22.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T23:08:22.390 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-11-30T23:08:22.511 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-11-30T23:08:22.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-30T23:08:22.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T23:08:22.558 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-11-30T23:08:22.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-30T23:08:22.680 INFO:teuthology.run_tasks:Running task clock... 2023-11-30T23:08:22.690 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-30T23:08:22.691 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-30T23:08:22.691 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-30T23:08:22.693 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-30T23:08:22.693 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-30T23:08:22.725 INFO:teuthology.orchestra.run.smithi156.stdout:30 Nov 23:08:22 ntpd[23653]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-11-30T23:08:22.725 INFO:teuthology.orchestra.run.smithi156.stdout:30 Nov 23:08:22 ntpd[23653]: Command line: ntpd -gq 2023-11-30T23:08:22.726 INFO:teuthology.orchestra.run.smithi156.stdout:30 Nov 23:08:22 ntpd[23653]: proto: precision = 0.078 usec (-24) 2023-11-30T23:08:22.726 INFO:teuthology.orchestra.run.smithi073.stdout:30 Nov 23:08:22 ntpd[23625]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-11-30T23:08:22.727 INFO:teuthology.orchestra.run.smithi073.stdout:30 Nov 23:08:22 ntpd[23625]: Command line: ntpd -gq 2023-11-30T23:08:22.727 INFO:teuthology.orchestra.run.smithi156.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-30T23:08:22.727 INFO:teuthology.orchestra.run.smithi156.stdout:30 Nov 23:08:22 ntpd[23653]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-30T23:08:22.727 INFO:teuthology.orchestra.run.smithi156.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-30T23:08:22.728 INFO:teuthology.orchestra.run.smithi156.stdout:30 Nov 23:08:22 ntpd[23653]: restrict ::: KOD does nothing without LIMITED. 2023-11-30T23:08:22.728 INFO:teuthology.orchestra.run.smithi156.stdout:30 Nov 23:08:22 ntpd[23653]: Listen and drop on 0 v6wildcard [::]:123 2023-11-30T23:08:22.728 INFO:teuthology.orchestra.run.smithi156.stdout:30 Nov 23:08:22 ntpd[23653]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-30T23:08:22.728 INFO:teuthology.orchestra.run.smithi156.stdout:30 Nov 23:08:22 ntpd[23653]: Listen normally on 2 lo 127.0.0.1:123 2023-11-30T23:08:22.728 INFO:teuthology.orchestra.run.smithi156.stdout:30 Nov 23:08:22 ntpd[23653]: Listen normally on 3 enp3s0f1 172.21.15.156:123 2023-11-30T23:08:22.729 INFO:teuthology.orchestra.run.smithi156.stdout:30 Nov 23:08:22 ntpd[23653]: Listen normally on 4 lo [::1]:123 2023-11-30T23:08:22.729 INFO:teuthology.orchestra.run.smithi156.stdout:30 Nov 23:08:22 ntpd[23653]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6dfd%5]:123 2023-11-30T23:08:22.729 INFO:teuthology.orchestra.run.smithi156.stdout:30 Nov 23:08:22 ntpd[23653]: Listening on routing socket on fd #22 for interface updates 2023-11-30T23:08:22.729 INFO:teuthology.orchestra.run.smithi073.stdout:30 Nov 23:08:22 ntpd[23625]: proto: precision = 0.117 usec (-23) 2023-11-30T23:08:22.729 INFO:teuthology.orchestra.run.smithi073.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-30T23:08:22.730 INFO:teuthology.orchestra.run.smithi073.stdout:30 Nov 23:08:22 ntpd[23625]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-30T23:08:22.730 INFO:teuthology.orchestra.run.smithi073.stdout:30 Nov 23:08:22 ntpd[23625]: restrict ::: KOD does nothing without LIMITED. 2023-11-30T23:08:22.730 INFO:teuthology.orchestra.run.smithi073.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-30T23:08:22.731 INFO:teuthology.orchestra.run.smithi073.stdout:30 Nov 23:08:22 ntpd[23625]: Listen and drop on 0 v6wildcard [::]:123 2023-11-30T23:08:22.731 INFO:teuthology.orchestra.run.smithi073.stdout:30 Nov 23:08:22 ntpd[23625]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-30T23:08:22.731 INFO:teuthology.orchestra.run.smithi073.stdout:30 Nov 23:08:22 ntpd[23625]: Listen normally on 2 lo 127.0.0.1:123 2023-11-30T23:08:22.731 INFO:teuthology.orchestra.run.smithi073.stdout:30 Nov 23:08:22 ntpd[23625]: Listen normally on 3 enp3s0f1 172.21.15.73:123 2023-11-30T23:08:22.731 INFO:teuthology.orchestra.run.smithi073.stdout:30 Nov 23:08:22 ntpd[23625]: Listen normally on 4 lo [::1]:123 2023-11-30T23:08:22.731 INFO:teuthology.orchestra.run.smithi073.stdout:30 Nov 23:08:22 ntpd[23625]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce7d%5]:123 2023-11-30T23:08:22.731 INFO:teuthology.orchestra.run.smithi073.stdout:30 Nov 23:08:22 ntpd[23625]: Listening on routing socket on fd #22 for interface updates 2023-11-30T23:08:23.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:23 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:23.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:23 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:23.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:23 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:23.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:23 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:23.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:23 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-30T23:08:23.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:23 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231130: Permission denied 2023-11-30T23:08:24.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:24 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:24.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:24 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:24.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:24 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:24.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:24 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:24.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:24 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-30T23:08:24.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:24 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231130: Permission denied 2023-11-30T23:08:24.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:24 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:24.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:24 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:24.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:24 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:24.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:24 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:24.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:24 ntpd[23625]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-30T23:08:24.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:24 ntpd[23625]: can't open /var/log/ntpstats/peerstats.20231130: Permission denied 2023-11-30T23:08:25.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:25 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:25.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:25 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:25.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:25 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:25.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:25 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:25.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:25 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:25.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:25 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:25.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:25 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-30T23:08:25.727 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:25 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231130: Permission denied 2023-11-30T23:08:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:25 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:25.728 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:25 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:25.728 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:25 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:25.728 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:25 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:25.728 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:25 ntpd[23625]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-30T23:08:25.728 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:25 ntpd[23625]: can't open /var/log/ntpstats/peerstats.20231130: Permission denied 2023-11-30T23:08:26.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:26 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:26.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:26 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:26.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:26 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:26.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:26 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:26.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:26 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-30T23:08:26.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:26 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231130: Permission denied 2023-11-30T23:08:26.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:26 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:26.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:26 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:26.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:26 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:26.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:26 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:26.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:26 ntpd[23625]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-30T23:08:26.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:26 ntpd[23625]: can't open /var/log/ntpstats/peerstats.20231130: Permission denied 2023-11-30T23:08:27.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:27 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:27.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:27 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:27.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:27 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:27.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:27 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:27.727 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:27 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:27.727 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:27 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:27.727 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:27 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-30T23:08:27.727 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:27 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231130: Permission denied 2023-11-30T23:08:27.727 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:27 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:27.727 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:27 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:27.727 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:27 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-30T23:08:27.727 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:27 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231130: Permission denied 2023-11-30T23:08:27.728 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:27 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:27 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:27 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:27 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:27 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:27 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:27 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:27 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:27 ntpd[23625]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-30T23:08:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:27 ntpd[23625]: can't open /var/log/ntpstats/peerstats.20231130: Permission denied 2023-11-30T23:08:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:27 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:27 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:27 ntpd[23625]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-30T23:08:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:27 ntpd[23625]: can't open /var/log/ntpstats/peerstats.20231130: Permission denied 2023-11-30T23:08:28.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:28 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:28.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:28 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:28.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:28 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:28.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:28 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:28.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:28 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-30T23:08:28.726 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:28 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231130: Permission denied 2023-11-30T23:08:28.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:28 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:28.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:28 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:28.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:28 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:28.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:28 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:28.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:28 ntpd[23625]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-30T23:08:28.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:28 ntpd[23625]: can't open /var/log/ntpstats/peerstats.20231130: Permission denied 2023-11-30T23:08:29.727 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:29 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:29.727 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:29 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:29.727 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:29 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:29.727 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:29 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:29.727 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:29 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:29.727 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:29 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:29.727 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:29 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-30T23:08:29.727 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:29 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231130: Permission denied 2023-11-30T23:08:29.727 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:29 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:29.728 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:29 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:29.728 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:29 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-30T23:08:29.728 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:29 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231130: Permission denied 2023-11-30T23:08:29.728 INFO:teuthology.orchestra.run.smithi156.stdout:30 Nov 23:08:29 ntpd[23653]: ntpd: time slew -0.000239 s 2023-11-30T23:08:29.728 INFO:teuthology.orchestra.run.smithi156.stdout:ntpd: time slew -0.000239s 2023-11-30T23:08:29.729 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:29 ntpd[23653]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-30T23:08:29.729 INFO:teuthology.orchestra.run.smithi156.stderr:30 Nov 23:08:29 ntpd[23653]: can't open /var/log/ntpstats/loopstats.20231130: Permission denied 2023-11-30T23:08:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:29 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:29 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:29 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:29 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:29 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:29 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:29.731 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:29 ntpd[23625]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-30T23:08:29.731 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:29 ntpd[23625]: can't open /var/log/ntpstats/peerstats.20231130: Permission denied 2023-11-30T23:08:29.731 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:29 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:29.731 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:29 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:29.731 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:29 ntpd[23625]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-30T23:08:29.731 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:29 ntpd[23625]: can't open /var/log/ntpstats/peerstats.20231130: Permission denied 2023-11-30T23:08:29.801 INFO:teuthology.orchestra.run.smithi156.stdout: remote refid st t when poll reach delay offset jitter 2023-11-30T23:08:29.801 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================== 2023-11-30T23:08:29.801 INFO:teuthology.orchestra.run.smithi156.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-30T23:08:29.801 INFO:teuthology.orchestra.run.smithi156.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-30T23:08:29.801 INFO:teuthology.orchestra.run.smithi156.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-30T23:08:29.801 INFO:teuthology.orchestra.run.smithi156.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-30T23:08:30.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:30 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:30.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:30 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:30.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:30 ntpd[23625]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-30T23:08:30.727 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:30 ntpd[23625]: can't open /var/log/ntpstats/rawstats.20231130: Permission denied 2023-11-30T23:08:30.728 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:30 ntpd[23625]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-30T23:08:30.728 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:30 ntpd[23625]: can't open /var/log/ntpstats/peerstats.20231130: Permission denied 2023-11-30T23:08:30.728 INFO:teuthology.orchestra.run.smithi073.stdout:30 Nov 23:08:30 ntpd[23625]: ntpd: time slew -0.000017 s 2023-11-30T23:08:30.728 INFO:teuthology.orchestra.run.smithi073.stdout:ntpd: time slew -0.000017s 2023-11-30T23:08:30.728 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:30 ntpd[23625]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-30T23:08:30.728 INFO:teuthology.orchestra.run.smithi073.stderr:30 Nov 23:08:30 ntpd[23625]: can't open /var/log/ntpstats/loopstats.20231130: Permission denied 2023-11-30T23:08:30.800 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2023-11-30T23:08:30.800 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2023-11-30T23:08:30.800 INFO:teuthology.orchestra.run.smithi073.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-30T23:08:30.801 INFO:teuthology.orchestra.run.smithi073.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-30T23:08:30.801 INFO:teuthology.orchestra.run.smithi073.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-30T23:08:30.801 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-30T23:08:30.802 INFO:teuthology.run_tasks:Running task install... 2023-11-30T23:08:30.813 DEBUG:teuthology.task.install:project ceph 2023-11-30T23:08:30.813 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32'}} 2023-11-30T23:08:30.813 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32'} 2023-11-30T23:08:30.814 INFO:teuthology.task.install:Using flavor: default 2023-11-30T23:08:30.819 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-30T23:08:30.819 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-30T23:08:30.820 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-key list | grep Ceph 2023-11-30T23:08:30.820 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-key list | grep Ceph 2023-11-30T23:08:30.920 INFO:teuthology.orchestra.run.smithi156.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-11-30T23:08:30.946 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-11-30T23:08:30.980 INFO:teuthology.orchestra.run.smithi156.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-30T23:08:30.980 INFO:teuthology.orchestra.run.smithi156.stdout:uid [ unknown] Ceph.com (release key) 2023-11-30T23:08:30.981 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-30T23:08:30.981 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-30T23:08:30.982 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a6f82997ac57b70a895455dfed6256360a1e4c32 2023-11-30T23:08:31.004 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-30T23:08:31.005 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph.com (release key) 2023-11-30T23:08:31.005 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-30T23:08:31.005 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-30T23:08:31.006 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a6f82997ac57b70a895455dfed6256360a1e4c32 2023-11-30T23:08:31.142 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default/ 2023-11-30T23:08:31.143 INFO:teuthology.task.install.deb:Package version is 18.2.0-1249-ga6f82997-1focal 2023-11-30T23:08:31.258 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default/ 2023-11-30T23:08:31.258 INFO:teuthology.task.install.deb:Package version is 18.2.0-1249-ga6f82997-1focal 2023-11-30T23:08:31.269 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:08:31.269 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-30T23:08:31.286 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2023-11-30T23:08:31.478 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal InRelease 2023-11-30T23:08:31.490 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-30T23:08:31.495 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-30T23:08:31.499 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-30T23:08:31.511 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-11-30T23:08:31.512 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-30T23:08:31.523 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:08:31.523 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-30T23:08:31.533 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal Release.gpg 2023-11-30T23:08:31.540 DEBUG:teuthology.orchestra.run.smithi156:> sudo apt-get update 2023-11-30T23:08:31.554 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main i386 Packages [3,428 B] 2023-11-30T23:08:31.585 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-11-30T23:08:31.757 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-30T23:08:31.797 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-30T23:08:31.805 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-30T23:08:31.839 INFO:teuthology.orchestra.run.smithi156.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-30T23:08:31.888 INFO:teuthology.orchestra.run.smithi156.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal InRelease 2023-11-30T23:08:31.928 INFO:teuthology.orchestra.run.smithi156.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-11-30T23:08:31.966 INFO:teuthology.orchestra.run.smithi156.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal Release.gpg 2023-11-30T23:08:32.003 INFO:teuthology.orchestra.run.smithi156.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main i386 Packages [3,428 B] 2023-11-30T23:08:32.052 INFO:teuthology.orchestra.run.smithi156.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-11-30T23:08:32.151 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 28.4 kB in 1s (40.4 kB/s) 2023-11-30T23:08:32.416 INFO:teuthology.orchestra.run.smithi156.stdout:Fetched 28.4 kB in 1s (39.8 kB/s) 2023-11-30T23:08:33.199 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2023-11-30T23:08:33.223 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.0-1249-ga6f82997-1focal cephadm=18.2.0-1249-ga6f82997-1focal ceph-mds=18.2.0-1249-ga6f82997-1focal ceph-mgr=18.2.0-1249-ga6f82997-1focal ceph-common=18.2.0-1249-ga6f82997-1focal ceph-fuse=18.2.0-1249-ga6f82997-1focal ceph-test=18.2.0-1249-ga6f82997-1focal ceph-volume=18.2.0-1249-ga6f82997-1focal radosgw=18.2.0-1249-ga6f82997-1focal python3-rados=18.2.0-1249-ga6f82997-1focal python3-rgw=18.2.0-1249-ga6f82997-1focal python3-cephfs=18.2.0-1249-ga6f82997-1focal python3-rbd=18.2.0-1249-ga6f82997-1focal libcephfs2=18.2.0-1249-ga6f82997-1focal libcephfs-dev=18.2.0-1249-ga6f82997-1focal librados2=18.2.0-1249-ga6f82997-1focal librbd1=18.2.0-1249-ga6f82997-1focal rbd-fuse=18.2.0-1249-ga6f82997-1focal python3-cephfs=18.2.0-1249-ga6f82997-1focal cephfs-shell=18.2.0-1249-ga6f82997-1focal cephfs-top=18.2.0-1249-ga6f82997-1focal cephfs-mirror=18.2.0-1249-ga6f82997-1focal 2023-11-30T23:08:33.291 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2023-11-30T23:08:33.470 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2023-11-30T23:08:33.471 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2023-11-30T23:08:33.473 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2023-11-30T23:08:33.497 DEBUG:teuthology.orchestra.run.smithi156:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.0-1249-ga6f82997-1focal cephadm=18.2.0-1249-ga6f82997-1focal ceph-mds=18.2.0-1249-ga6f82997-1focal ceph-mgr=18.2.0-1249-ga6f82997-1focal ceph-common=18.2.0-1249-ga6f82997-1focal ceph-fuse=18.2.0-1249-ga6f82997-1focal ceph-test=18.2.0-1249-ga6f82997-1focal ceph-volume=18.2.0-1249-ga6f82997-1focal radosgw=18.2.0-1249-ga6f82997-1focal python3-rados=18.2.0-1249-ga6f82997-1focal python3-rgw=18.2.0-1249-ga6f82997-1focal python3-cephfs=18.2.0-1249-ga6f82997-1focal python3-rbd=18.2.0-1249-ga6f82997-1focal libcephfs2=18.2.0-1249-ga6f82997-1focal libcephfs-dev=18.2.0-1249-ga6f82997-1focal librados2=18.2.0-1249-ga6f82997-1focal librbd1=18.2.0-1249-ga6f82997-1focal rbd-fuse=18.2.0-1249-ga6f82997-1focal python3-cephfs=18.2.0-1249-ga6f82997-1focal cephfs-shell=18.2.0-1249-ga6f82997-1focal cephfs-top=18.2.0-1249-ga6f82997-1focal cephfs-mirror=18.2.0-1249-ga6f82997-1focal 2023-11-30T23:08:33.564 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2023-11-30T23:08:33.643 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2023-11-30T23:08:33.645 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-30T23:08:33.645 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-30T23:08:33.645 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2023-11-30T23:08:33.645 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-30T23:08:33.645 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-11-30T23:08:33.645 INFO:teuthology.orchestra.run.smithi073.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-11-30T23:08:33.645 INFO:teuthology.orchestra.run.smithi073.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-11-30T23:08:33.646 INFO:teuthology.orchestra.run.smithi073.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-11-30T23:08:33.646 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-11-30T23:08:33.646 INFO:teuthology.orchestra.run.smithi073.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-30T23:08:33.646 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-30T23:08:33.646 INFO:teuthology.orchestra.run.smithi073.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-30T23:08:33.646 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-30T23:08:33.646 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-11-30T23:08:33.646 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-11-30T23:08:33.646 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-11-30T23:08:33.646 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-11-30T23:08:33.647 INFO:teuthology.orchestra.run.smithi073.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-30T23:08:33.647 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-30T23:08:33.647 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-11-30T23:08:33.647 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-11-30T23:08:33.647 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-30T23:08:33.647 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-30T23:08:33.647 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-30T23:08:33.647 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-30T23:08:33.647 INFO:teuthology.orchestra.run.smithi073.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-30T23:08:33.648 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2023-11-30T23:08:33.648 INFO:teuthology.orchestra.run.smithi073.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-11-30T23:08:33.648 INFO:teuthology.orchestra.run.smithi073.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-11-30T23:08:33.648 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-11-30T23:08:33.648 INFO:teuthology.orchestra.run.smithi073.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-11-30T23:08:33.648 INFO:teuthology.orchestra.run.smithi073.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-11-30T23:08:33.648 INFO:teuthology.orchestra.run.smithi073.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-11-30T23:08:33.648 INFO:teuthology.orchestra.run.smithi073.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-11-30T23:08:33.648 INFO:teuthology.orchestra.run.smithi073.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-30T23:08:33.648 INFO:teuthology.orchestra.run.smithi073.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-11-30T23:08:33.648 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2023-11-30T23:08:33.648 INFO:teuthology.orchestra.run.smithi073.stdout: btrfs-tools 2023-11-30T23:08:33.762 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2023-11-30T23:08:33.762 INFO:teuthology.orchestra.run.smithi073.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-30T23:08:33.762 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-30T23:08:33.762 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-30T23:08:33.762 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-11-30T23:08:33.762 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-11-30T23:08:33.762 INFO:teuthology.orchestra.run.smithi073.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-11-30T23:08:33.762 INFO:teuthology.orchestra.run.smithi073.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-11-30T23:08:33.764 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-11-30T23:08:33.764 INFO:teuthology.orchestra.run.smithi073.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-30T23:08:33.764 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-30T23:08:33.764 INFO:teuthology.orchestra.run.smithi073.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-30T23:08:33.764 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-11-30T23:08:33.764 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-11-30T23:08:33.764 INFO:teuthology.orchestra.run.smithi073.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-11-30T23:08:33.764 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-11-30T23:08:33.764 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-11-30T23:08:33.765 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-11-30T23:08:33.765 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-11-30T23:08:33.765 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-11-30T23:08:33.765 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-11-30T23:08:33.765 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-30T23:08:33.765 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-30T23:08:33.765 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-30T23:08:33.765 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-30T23:08:33.765 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-30T23:08:33.765 INFO:teuthology.orchestra.run.smithi073.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-11-30T23:08:33.765 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2023-11-30T23:08:33.766 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 librbd1 2023-11-30T23:08:33.766 INFO:teuthology.orchestra.run.smithi156.stdout:Building dependency tree... 2023-11-30T23:08:33.767 INFO:teuthology.orchestra.run.smithi156.stdout:Reading state information... 2023-11-30T23:08:33.841 INFO:teuthology.orchestra.run.smithi073.stdout:2 upgraded, 116 newly installed, 0 to remove and 259 not upgraded. 2023-11-30T23:08:33.841 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 208 MB of archives. 2023-11-30T23:08:33.841 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 1,030 MB of additional disk space will be used. 2023-11-30T23:08:33.841 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-11-30T23:08:33.864 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-11-30T23:08:33.874 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-11-30T23:08:33.906 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-11-30T23:08:33.948 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages were automatically installed and are no longer required: 2023-11-30T23:08:33.949 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-11-30T23:08:33.950 INFO:teuthology.orchestra.run.smithi156.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-30T23:08:33.950 INFO:teuthology.orchestra.run.smithi156.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-30T23:08:33.950 INFO:teuthology.orchestra.run.smithi156.stdout:The following additional packages will be installed: 2023-11-30T23:08:33.950 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-30T23:08:33.950 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-11-30T23:08:33.950 INFO:teuthology.orchestra.run.smithi156.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-11-30T23:08:33.950 INFO:teuthology.orchestra.run.smithi156.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-11-30T23:08:33.950 INFO:teuthology.orchestra.run.smithi156.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-11-30T23:08:33.950 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-11-30T23:08:33.950 INFO:teuthology.orchestra.run.smithi156.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-30T23:08:33.950 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-30T23:08:33.950 INFO:teuthology.orchestra.run.smithi156.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-30T23:08:33.951 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-30T23:08:33.951 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-11-30T23:08:33.951 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-11-30T23:08:33.951 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-11-30T23:08:33.951 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-11-30T23:08:33.951 INFO:teuthology.orchestra.run.smithi156.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-30T23:08:33.951 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-30T23:08:33.951 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-11-30T23:08:33.951 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-11-30T23:08:33.951 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-30T23:08:33.951 INFO:teuthology.orchestra.run.smithi156.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-30T23:08:33.951 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-30T23:08:33.951 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-30T23:08:33.951 INFO:teuthology.orchestra.run.smithi156.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-30T23:08:33.952 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-11-30T23:08:33.952 INFO:teuthology.orchestra.run.smithi156.stdout:Suggested packages: 2023-11-30T23:08:33.952 INFO:teuthology.orchestra.run.smithi156.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-11-30T23:08:33.952 INFO:teuthology.orchestra.run.smithi156.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-11-30T23:08:33.952 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-11-30T23:08:33.952 INFO:teuthology.orchestra.run.smithi156.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-11-30T23:08:33.952 INFO:teuthology.orchestra.run.smithi156.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-11-30T23:08:33.952 INFO:teuthology.orchestra.run.smithi156.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-11-30T23:08:33.953 INFO:teuthology.orchestra.run.smithi156.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-11-30T23:08:33.953 INFO:teuthology.orchestra.run.smithi156.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-30T23:08:33.953 INFO:teuthology.orchestra.run.smithi156.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-11-30T23:08:33.953 INFO:teuthology.orchestra.run.smithi156.stdout:Recommended packages: 2023-11-30T23:08:33.953 INFO:teuthology.orchestra.run.smithi156.stdout: btrfs-tools 2023-11-30T23:08:33.976 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-11-30T23:08:34.008 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.0-1249-ga6f82997-1focal [3,439 kB] 2023-11-30T23:08:34.056 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-11-30T23:08:34.061 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-11-30T23:08:34.072 INFO:teuthology.orchestra.run.smithi156.stdout:The following NEW packages will be installed: 2023-11-30T23:08:34.072 INFO:teuthology.orchestra.run.smithi156.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-30T23:08:34.072 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-30T23:08:34.072 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-30T23:08:34.072 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-11-30T23:08:34.073 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-11-30T23:08:34.073 INFO:teuthology.orchestra.run.smithi156.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-11-30T23:08:34.073 INFO:teuthology.orchestra.run.smithi156.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-11-30T23:08:34.073 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-11-30T23:08:34.074 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-11-30T23:08:34.074 INFO:teuthology.orchestra.run.smithi156.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-30T23:08:34.074 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-30T23:08:34.074 INFO:teuthology.orchestra.run.smithi156.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-30T23:08:34.074 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-11-30T23:08:34.075 INFO:teuthology.orchestra.run.smithi156.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-11-30T23:08:34.075 INFO:teuthology.orchestra.run.smithi156.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-11-30T23:08:34.075 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-11-30T23:08:34.075 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-11-30T23:08:34.075 INFO:teuthology.orchestra.run.smithi156.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-11-30T23:08:34.075 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-11-30T23:08:34.075 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-11-30T23:08:34.075 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-11-30T23:08:34.075 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-30T23:08:34.075 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-30T23:08:34.075 INFO:teuthology.orchestra.run.smithi156.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-30T23:08:34.075 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-30T23:08:34.075 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-30T23:08:34.075 INFO:teuthology.orchestra.run.smithi156.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-11-30T23:08:34.075 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages will be upgraded: 2023-11-30T23:08:34.076 INFO:teuthology.orchestra.run.smithi156.stdout: librados2 librbd1 2023-11-30T23:08:34.076 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-11-30T23:08:34.076 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-11-30T23:08:34.077 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-11-30T23:08:34.078 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-11-30T23:08:34.085 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-11-30T23:08:34.086 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-11-30T23:08:34.103 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-11-30T23:08:34.124 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-11-30T23:08:34.124 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-11-30T23:08:34.125 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-11-30T23:08:34.127 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-30T23:08:34.128 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-11-30T23:08:34.129 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-11-30T23:08:34.131 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-11-30T23:08:34.132 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-11-30T23:08:34.139 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-11-30T23:08:34.163 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-11-30T23:08:34.163 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-11-30T23:08:34.165 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-11-30T23:08:34.165 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-11-30T23:08:34.167 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-11-30T23:08:34.167 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-11-30T23:08:34.168 INFO:teuthology.orchestra.run.smithi156.stdout:2 upgraded, 116 newly installed, 0 to remove and 259 not upgraded. 2023-11-30T23:08:34.168 INFO:teuthology.orchestra.run.smithi156.stdout:Need to get 208 MB of archives. 2023-11-30T23:08:34.169 INFO:teuthology.orchestra.run.smithi156.stdout:After this operation, 1,030 MB of additional disk space will be used. 2023-11-30T23:08:34.169 INFO:teuthology.orchestra.run.smithi156.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-11-30T23:08:34.169 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-11-30T23:08:34.173 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-11-30T23:08:34.175 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-11-30T23:08:34.188 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-11-30T23:08:34.191 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-11-30T23:08:34.193 INFO:teuthology.orchestra.run.smithi156.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-11-30T23:08:34.193 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-11-30T23:08:34.193 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-11-30T23:08:34.194 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-11-30T23:08:34.205 INFO:teuthology.orchestra.run.smithi156.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-11-30T23:08:34.207 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-11-30T23:08:34.208 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-11-30T23:08:34.209 INFO:teuthology.orchestra.run.smithi073.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-11-30T23:08:34.210 INFO:teuthology.orchestra.run.smithi073.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-11-30T23:08:34.211 INFO:teuthology.orchestra.run.smithi073.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-11-30T23:08:34.228 INFO:teuthology.orchestra.run.smithi073.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-30T23:08:34.228 INFO:teuthology.orchestra.run.smithi073.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-11-30T23:08:34.231 INFO:teuthology.orchestra.run.smithi073.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-11-30T23:08:34.232 INFO:teuthology.orchestra.run.smithi073.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-11-30T23:08:34.234 INFO:teuthology.orchestra.run.smithi073.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-11-30T23:08:34.243 INFO:teuthology.orchestra.run.smithi156.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-11-30T23:08:34.250 INFO:teuthology.orchestra.run.smithi073.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-11-30T23:08:34.250 INFO:teuthology.orchestra.run.smithi073.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-11-30T23:08:34.298 INFO:teuthology.orchestra.run.smithi156.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-11-30T23:08:34.306 INFO:teuthology.orchestra.run.smithi156.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-11-30T23:08:34.350 INFO:teuthology.orchestra.run.smithi156.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-11-30T23:08:34.361 INFO:teuthology.orchestra.run.smithi156.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.0-1249-ga6f82997-1focal [3,439 kB] 2023-11-30T23:08:34.429 INFO:teuthology.orchestra.run.smithi073.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-11-30T23:08:34.462 INFO:teuthology.orchestra.run.smithi073.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-11-30T23:08:34.465 INFO:teuthology.orchestra.run.smithi073.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-11-30T23:08:34.493 INFO:teuthology.orchestra.run.smithi073.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-11-30T23:08:34.493 INFO:teuthology.orchestra.run.smithi073.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-11-30T23:08:34.493 INFO:teuthology.orchestra.run.smithi073.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-11-30T23:08:34.494 INFO:teuthology.orchestra.run.smithi073.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-11-30T23:08:34.494 INFO:teuthology.orchestra.run.smithi073.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-11-30T23:08:34.495 INFO:teuthology.orchestra.run.smithi073.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-11-30T23:08:34.495 INFO:teuthology.orchestra.run.smithi073.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-11-30T23:08:34.503 INFO:teuthology.orchestra.run.smithi073.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-11-30T23:08:34.503 INFO:teuthology.orchestra.run.smithi073.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-11-30T23:08:34.523 INFO:teuthology.orchestra.run.smithi073.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-11-30T23:08:34.526 INFO:teuthology.orchestra.run.smithi073.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-11-30T23:08:34.529 INFO:teuthology.orchestra.run.smithi073.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-11-30T23:08:34.531 INFO:teuthology.orchestra.run.smithi073.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-11-30T23:08:34.532 INFO:teuthology.orchestra.run.smithi073.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-11-30T23:08:34.534 INFO:teuthology.orchestra.run.smithi073.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-11-30T23:08:34.537 INFO:teuthology.orchestra.run.smithi073.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-11-30T23:08:34.537 INFO:teuthology.orchestra.run.smithi073.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-11-30T23:08:34.555 INFO:teuthology.orchestra.run.smithi156.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-11-30T23:08:34.563 INFO:teuthology.orchestra.run.smithi156.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-11-30T23:08:34.570 INFO:teuthology.orchestra.run.smithi073.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-11-30T23:08:34.575 INFO:teuthology.orchestra.run.smithi073.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-11-30T23:08:34.583 INFO:teuthology.orchestra.run.smithi156.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-11-30T23:08:34.591 INFO:teuthology.orchestra.run.smithi156.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-11-30T23:08:34.592 INFO:teuthology.orchestra.run.smithi156.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-11-30T23:08:34.593 INFO:teuthology.orchestra.run.smithi156.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-11-30T23:08:34.593 INFO:teuthology.orchestra.run.smithi156.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-11-30T23:08:34.594 INFO:teuthology.orchestra.run.smithi073.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-11-30T23:08:34.617 INFO:teuthology.orchestra.run.smithi156.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-11-30T23:08:34.619 INFO:teuthology.orchestra.run.smithi156.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-11-30T23:08:34.627 INFO:teuthology.orchestra.run.smithi156.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-11-30T23:08:34.634 INFO:teuthology.orchestra.run.smithi156.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-11-30T23:08:34.635 INFO:teuthology.orchestra.run.smithi156.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-11-30T23:08:34.666 INFO:teuthology.orchestra.run.smithi073.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-11-30T23:08:34.667 INFO:teuthology.orchestra.run.smithi073.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-11-30T23:08:34.667 INFO:teuthology.orchestra.run.smithi073.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-11-30T23:08:34.668 INFO:teuthology.orchestra.run.smithi073.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-11-30T23:08:34.674 INFO:teuthology.orchestra.run.smithi156.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-11-30T23:08:34.676 INFO:teuthology.orchestra.run.smithi156.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-30T23:08:34.676 INFO:teuthology.orchestra.run.smithi156.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-11-30T23:08:34.677 INFO:teuthology.orchestra.run.smithi156.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-11-30T23:08:34.679 INFO:teuthology.orchestra.run.smithi156.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-11-30T23:08:34.679 INFO:teuthology.orchestra.run.smithi156.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-11-30T23:08:34.682 INFO:teuthology.orchestra.run.smithi156.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-11-30T23:08:34.685 INFO:teuthology.orchestra.run.smithi156.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-11-30T23:08:34.691 INFO:teuthology.orchestra.run.smithi073.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-30T23:08:34.691 INFO:teuthology.orchestra.run.smithi073.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-11-30T23:08:34.694 INFO:teuthology.orchestra.run.smithi073.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-11-30T23:08:34.695 INFO:teuthology.orchestra.run.smithi073.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-11-30T23:08:34.695 INFO:teuthology.orchestra.run.smithi073.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-11-30T23:08:34.714 INFO:teuthology.orchestra.run.smithi156.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-11-30T23:08:34.721 INFO:teuthology.orchestra.run.smithi156.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-11-30T23:08:34.734 INFO:teuthology.orchestra.run.smithi156.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-11-30T23:08:34.735 INFO:teuthology.orchestra.run.smithi156.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-11-30T23:08:34.735 INFO:teuthology.orchestra.run.smithi156.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-11-30T23:08:34.736 INFO:teuthology.orchestra.run.smithi156.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-11-30T23:08:34.739 INFO:teuthology.orchestra.run.smithi156.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-11-30T23:08:34.742 INFO:teuthology.orchestra.run.smithi156.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-11-30T23:08:34.743 INFO:teuthology.orchestra.run.smithi156.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-11-30T23:08:34.745 INFO:teuthology.orchestra.run.smithi156.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-11-30T23:08:34.753 INFO:teuthology.orchestra.run.smithi156.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-11-30T23:08:34.753 INFO:teuthology.orchestra.run.smithi156.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-11-30T23:08:34.774 INFO:teuthology.orchestra.run.smithi156.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-11-30T23:08:34.774 INFO:teuthology.orchestra.run.smithi156.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-11-30T23:08:34.774 INFO:teuthology.orchestra.run.smithi156.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-11-30T23:08:34.776 INFO:teuthology.orchestra.run.smithi156.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-11-30T23:08:34.776 INFO:teuthology.orchestra.run.smithi156.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-11-30T23:08:34.777 INFO:teuthology.orchestra.run.smithi156.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-11-30T23:08:34.780 INFO:teuthology.orchestra.run.smithi156.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-30T23:08:34.780 INFO:teuthology.orchestra.run.smithi156.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-11-30T23:08:34.792 INFO:teuthology.orchestra.run.smithi156.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-11-30T23:08:34.794 INFO:teuthology.orchestra.run.smithi156.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-11-30T23:08:34.804 INFO:teuthology.orchestra.run.smithi156.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-11-30T23:08:34.805 INFO:teuthology.orchestra.run.smithi156.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-11-30T23:08:34.805 INFO:teuthology.orchestra.run.smithi156.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-11-30T23:08:34.979 INFO:teuthology.orchestra.run.smithi156.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-11-30T23:08:35.016 INFO:teuthology.orchestra.run.smithi156.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-11-30T23:08:35.018 INFO:teuthology.orchestra.run.smithi156.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-11-30T23:08:35.042 INFO:teuthology.orchestra.run.smithi156.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-11-30T23:08:35.042 INFO:teuthology.orchestra.run.smithi156.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-11-30T23:08:35.043 INFO:teuthology.orchestra.run.smithi156.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-11-30T23:08:35.043 INFO:teuthology.orchestra.run.smithi156.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-11-30T23:08:35.044 INFO:teuthology.orchestra.run.smithi156.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-11-30T23:08:35.044 INFO:teuthology.orchestra.run.smithi156.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-11-30T23:08:35.045 INFO:teuthology.orchestra.run.smithi156.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-11-30T23:08:35.058 INFO:teuthology.orchestra.run.smithi156.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-11-30T23:08:35.059 INFO:teuthology.orchestra.run.smithi156.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-11-30T23:08:35.079 INFO:teuthology.orchestra.run.smithi156.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-11-30T23:08:35.082 INFO:teuthology.orchestra.run.smithi156.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-11-30T23:08:35.085 INFO:teuthology.orchestra.run.smithi156.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-11-30T23:08:35.087 INFO:teuthology.orchestra.run.smithi156.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-11-30T23:08:35.088 INFO:teuthology.orchestra.run.smithi156.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-11-30T23:08:35.091 INFO:teuthology.orchestra.run.smithi156.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-11-30T23:08:35.093 INFO:teuthology.orchestra.run.smithi156.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-11-30T23:08:35.094 INFO:teuthology.orchestra.run.smithi156.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-11-30T23:08:35.121 INFO:teuthology.orchestra.run.smithi156.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-11-30T23:08:35.126 INFO:teuthology.orchestra.run.smithi156.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-11-30T23:08:35.142 INFO:teuthology.orchestra.run.smithi156.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-11-30T23:08:35.214 INFO:teuthology.orchestra.run.smithi156.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-11-30T23:08:35.222 INFO:teuthology.orchestra.run.smithi156.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-11-30T23:08:35.222 INFO:teuthology.orchestra.run.smithi156.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-11-30T23:08:35.222 INFO:teuthology.orchestra.run.smithi156.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-11-30T23:08:35.237 INFO:teuthology.orchestra.run.smithi156.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-30T23:08:35.237 INFO:teuthology.orchestra.run.smithi156.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-11-30T23:08:35.240 INFO:teuthology.orchestra.run.smithi156.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-11-30T23:08:35.240 INFO:teuthology.orchestra.run.smithi156.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-11-30T23:08:35.241 INFO:teuthology.orchestra.run.smithi156.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-11-30T23:08:35.285 INFO:teuthology.orchestra.run.smithi073.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.0-1249-ga6f82997-1focal [4,000 kB] 2023-11-30T23:08:35.988 INFO:teuthology.orchestra.run.smithi073.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.0-1249-ga6f82997-1focal [738 kB] 2023-11-30T23:08:36.102 INFO:teuthology.orchestra.run.smithi073.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.0-1249-ga6f82997-1focal [387 kB] 2023-11-30T23:08:36.195 INFO:teuthology.orchestra.run.smithi073.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.0-1249-ga6f82997-1focal [31.9 kB] 2023-11-30T23:08:36.198 INFO:teuthology.orchestra.run.smithi073.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.0-1249-ga6f82997-1focal [201 kB] 2023-11-30T23:08:36.213 INFO:teuthology.orchestra.run.smithi073.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.0-1249-ga6f82997-1focal [60.2 kB] 2023-11-30T23:08:36.231 INFO:teuthology.orchestra.run.smithi073.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.0-1249-ga6f82997-1focal [365 kB] 2023-11-30T23:08:36.281 INFO:teuthology.orchestra.run.smithi073.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.0-1249-ga6f82997-1focal [6,587 kB] 2023-11-30T23:08:36.295 INFO:teuthology.orchestra.run.smithi156.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.0-1249-ga6f82997-1focal [4,000 kB] 2023-11-30T23:08:37.189 INFO:teuthology.orchestra.run.smithi073.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.0-1249-ga6f82997-1focal [113 kB] 2023-11-30T23:08:37.201 INFO:teuthology.orchestra.run.smithi073.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.0-1249-ga6f82997-1focal [478 kB] 2023-11-30T23:08:37.263 INFO:teuthology.orchestra.run.smithi073.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.0-1249-ga6f82997-1focal [25.2 MB] 2023-11-30T23:08:37.498 INFO:teuthology.orchestra.run.smithi156.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.0-1249-ga6f82997-1focal [738 kB] 2023-11-30T23:08:37.678 INFO:teuthology.orchestra.run.smithi156.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.0-1249-ga6f82997-1focal [387 kB] 2023-11-30T23:08:37.782 INFO:teuthology.orchestra.run.smithi156.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.0-1249-ga6f82997-1focal [31.9 kB] 2023-11-30T23:08:37.784 INFO:teuthology.orchestra.run.smithi156.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.0-1249-ga6f82997-1focal [201 kB] 2023-11-30T23:08:37.824 INFO:teuthology.orchestra.run.smithi156.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.0-1249-ga6f82997-1focal [60.2 kB] 2023-11-30T23:08:37.850 INFO:teuthology.orchestra.run.smithi156.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.0-1249-ga6f82997-1focal [365 kB] 2023-11-30T23:08:37.930 INFO:teuthology.orchestra.run.smithi156.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.0-1249-ga6f82997-1focal [6,587 kB] 2023-11-30T23:08:39.481 INFO:teuthology.orchestra.run.smithi156.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.0-1249-ga6f82997-1focal [113 kB] 2023-11-30T23:08:39.491 INFO:teuthology.orchestra.run.smithi156.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.0-1249-ga6f82997-1focal [478 kB] 2023-11-30T23:08:39.593 INFO:teuthology.orchestra.run.smithi156.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.0-1249-ga6f82997-1focal [25.2 MB] 2023-11-30T23:08:39.976 INFO:teuthology.orchestra.run.smithi073.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.0-1249-ga6f82997-1focal [11.0 MB] 2023-11-30T23:08:41.498 INFO:teuthology.orchestra.run.smithi073.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.0-1249-ga6f82997-1focal [234 kB] 2023-11-30T23:08:41.541 INFO:teuthology.orchestra.run.smithi073.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.0-1249-ga6f82997-1focal [147 kB] 2023-11-30T23:08:41.553 INFO:teuthology.orchestra.run.smithi073.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.0-1249-ga6f82997-1focal [1,565 kB] 2023-11-30T23:08:41.848 INFO:teuthology.orchestra.run.smithi073.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.0-1249-ga6f82997-1focal [9,404 kB] 2023-11-30T23:08:42.980 INFO:teuthology.orchestra.run.smithi073.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.0-1249-ga6f82997-1focal [31.3 MB] 2023-11-30T23:08:44.892 INFO:teuthology.orchestra.run.smithi156.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.0-1249-ga6f82997-1focal [11.0 MB] 2023-11-30T23:08:46.327 INFO:teuthology.orchestra.run.smithi073.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.0-1249-ga6f82997-1focal [13.7 kB] 2023-11-30T23:08:46.329 INFO:teuthology.orchestra.run.smithi073.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.0-1249-ga6f82997-1focal [846 kB] 2023-11-30T23:08:46.450 INFO:teuthology.orchestra.run.smithi073.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.0-1249-ga6f82997-1focal [2,309 kB] 2023-11-30T23:08:46.708 INFO:teuthology.orchestra.run.smithi156.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.0-1249-ga6f82997-1focal [234 kB] 2023-11-30T23:08:46.713 INFO:teuthology.orchestra.run.smithi156.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.0-1249-ga6f82997-1focal [147 kB] 2023-11-30T23:08:46.734 INFO:teuthology.orchestra.run.smithi156.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.0-1249-ga6f82997-1focal [1,565 kB] 2023-11-30T23:08:46.930 INFO:teuthology.orchestra.run.smithi073.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.0-1249-ga6f82997-1focal [234 kB] 2023-11-30T23:08:46.972 INFO:teuthology.orchestra.run.smithi073.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.0-1249-ga6f82997-1focal [136 kB] 2023-11-30T23:08:46.976 INFO:teuthology.orchestra.run.smithi073.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.0-1249-ga6f82997-1focal [1,831 kB] 2023-11-30T23:08:46.981 INFO:teuthology.orchestra.run.smithi156.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.0-1249-ga6f82997-1focal [9,404 kB] 2023-11-30T23:08:47.261 INFO:teuthology.orchestra.run.smithi073.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.0-1249-ga6f82997-1focal [7,892 kB] 2023-11-30T23:08:48.339 INFO:teuthology.orchestra.run.smithi156.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.0-1249-ga6f82997-1focal [31.3 MB] 2023-11-30T23:08:49.211 INFO:teuthology.orchestra.run.smithi073.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.0-1249-ga6f82997-1focal [13.8 kB] 2023-11-30T23:08:49.212 INFO:teuthology.orchestra.run.smithi073.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.0-1249-ga6f82997-1focal [50.1 MB] 2023-11-30T23:08:53.897 INFO:teuthology.orchestra.run.smithi156.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.0-1249-ga6f82997-1focal [13.7 kB] 2023-11-30T23:08:53.897 INFO:teuthology.orchestra.run.smithi156.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.0-1249-ga6f82997-1focal [846 kB] 2023-11-30T23:08:53.948 INFO:teuthology.orchestra.run.smithi156.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.0-1249-ga6f82997-1focal [2,309 kB] 2023-11-30T23:08:54.362 INFO:teuthology.orchestra.run.smithi156.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.0-1249-ga6f82997-1focal [234 kB] 2023-11-30T23:08:54.404 INFO:teuthology.orchestra.run.smithi156.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.0-1249-ga6f82997-1focal [136 kB] 2023-11-30T23:08:54.415 INFO:teuthology.orchestra.run.smithi156.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.0-1249-ga6f82997-1focal [1,831 kB] 2023-11-30T23:08:54.673 INFO:teuthology.orchestra.run.smithi156.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.0-1249-ga6f82997-1focal [7,892 kB] 2023-11-30T23:08:55.854 INFO:teuthology.orchestra.run.smithi156.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.0-1249-ga6f82997-1focal [13.8 kB] 2023-11-30T23:08:55.854 INFO:teuthology.orchestra.run.smithi156.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.0-1249-ga6f82997-1focal [50.1 MB] 2023-11-30T23:08:58.475 INFO:teuthology.orchestra.run.smithi073.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.0-1249-ga6f82997-1focal [119 kB] 2023-11-30T23:08:58.477 INFO:teuthology.orchestra.run.smithi073.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.0-1249-ga6f82997-1focal [266 kB] 2023-11-30T23:08:58.483 INFO:teuthology.orchestra.run.smithi073.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.0-1249-ga6f82997-1focal [32.9 kB] 2023-11-30T23:08:58.484 INFO:teuthology.orchestra.run.smithi073.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.0-1249-ga6f82997-1focal [22.6 kB] 2023-11-30T23:08:58.537 INFO:teuthology.orchestra.run.smithi073.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.0-1249-ga6f82997-1focal [37.3 kB] 2023-11-30T23:08:58.538 INFO:teuthology.orchestra.run.smithi073.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.0-1249-ga6f82997-1focal [13.4 MB] 2023-11-30T23:08:59.765 INFO:teuthology.orchestra.run.smithi073.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.0-1249-ga6f82997-1focal [107 kB] 2023-11-30T23:09:00.418 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 208 MB in 26s (8,003 kB/s) 2023-11-30T23:09:00.558 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-30T23:09:00.614 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141728 files and directories currently installed.) 2023-11-30T23:09:00.619 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-11-30T23:09:00.656 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-11-30T23:09:00.976 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-30T23:09:00.998 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-11-30T23:09:01.001 INFO:teuthology.orchestra.run.smithi156.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.0-1249-ga6f82997-1focal [119 kB] 2023-11-30T23:09:01.003 INFO:teuthology.orchestra.run.smithi156.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.0-1249-ga6f82997-1focal [266 kB] 2023-11-30T23:09:01.009 INFO:teuthology.orchestra.run.smithi156.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.0-1249-ga6f82997-1focal [32.9 kB] 2023-11-30T23:09:01.009 INFO:teuthology.orchestra.run.smithi156.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.0-1249-ga6f82997-1focal [22.6 kB] 2023-11-30T23:09:01.010 INFO:teuthology.orchestra.run.smithi156.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.0-1249-ga6f82997-1focal [37.3 kB] 2023-11-30T23:09:01.011 INFO:teuthology.orchestra.run.smithi156.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.0-1249-ga6f82997-1focal [13.4 MB] 2023-11-30T23:09:01.034 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-30T23:09:01.346 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cmd2. 2023-11-30T23:09:01.365 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-11-30T23:09:01.396 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-11-30T23:09:01.741 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-11-30T23:09:01.760 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-11-30T23:09:01.841 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-30T23:09:02.158 INFO:teuthology.orchestra.run.smithi156.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.0-1249-ga6f82997-1focal [107 kB] 2023-11-30T23:09:02.228 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-30T23:09:02.247 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-11-30T23:09:02.286 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-30T23:09:02.658 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-30T23:09:02.673 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-11-30T23:09:02.714 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-30T23:09:02.773 INFO:teuthology.orchestra.run.smithi156.stdout:Fetched 208 MB in 28s (7,410 kB/s) 2023-11-30T23:09:02.908 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-30T23:09:02.965 INFO:teuthology.orchestra.run.smithi156.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141728 files and directories currently installed.) 2023-11-30T23:09:02.969 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-11-30T23:09:03.015 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-11-30T23:09:03.119 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-30T23:09:03.133 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-30T23:09:03.180 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-30T23:09:03.335 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-30T23:09:03.351 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-11-30T23:09:03.384 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-30T23:09:03.688 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-30T23:09:03.704 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cmd2. 2023-11-30T23:09:03.705 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-30T23:09:03.719 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-11-30T23:09:03.738 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-30T23:09:03.762 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-11-30T23:09:04.109 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-30T23:09:04.115 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-11-30T23:09:04.125 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-30T23:09:04.133 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-11-30T23:09:04.167 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-30T23:09:04.240 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-30T23:09:04.579 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-11-30T23:09:04.594 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-11-30T23:09:04.635 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-30T23:09:04.645 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-30T23:09:04.651 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-11-30T23:09:04.693 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-30T23:09:05.049 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../010-librbd1_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:05.054 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-30T23:09:05.071 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-11-30T23:09:05.113 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-30T23:09:05.174 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librbd1 (18.2.0-1249-ga6f82997-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-30T23:09:05.634 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-30T23:09:05.650 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-30T23:09:05.706 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-30T23:09:05.885 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../011-librados2_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:06.039 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librados2 (18.2.0-1249-ga6f82997-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-30T23:09:06.798 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-30T23:09:06.817 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-30T23:09:07.031 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-30T23:09:07.426 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-30T23:09:07.442 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-30T23:09:07.482 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs2. 2023-11-30T23:09:07.484 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-30T23:09:07.503 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../012-libcephfs2_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:07.542 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs2 (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:07.885 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rados. 2023-11-30T23:09:07.904 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../013-python3-rados_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:07.904 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-11-30T23:09:07.920 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-11-30T23:09:07.943 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rados (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:07.955 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-30T23:09:08.324 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-30T23:09:08.325 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../010-librbd1_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:08.338 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:09:08.380 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-argparse (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:08.449 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librbd1 (18.2.0-1249-ga6f82997-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-30T23:09:08.658 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cephfs. 2023-11-30T23:09:08.673 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../015-python3-cephfs_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:08.708 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cephfs (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:09.102 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-30T23:09:09.120 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:09:09.160 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:09.205 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../011-librados2_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:09.329 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librados2 (18.2.0-1249-ga6f82997-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-30T23:09:09.514 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-prettytable. 2023-11-30T23:09:09.530 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-11-30T23:09:09.572 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-11-30T23:09:09.850 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rbd. 2023-11-30T23:09:09.868 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../018-python3-rbd_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:09.908 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rbd (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:10.058 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libcephfs2. 2023-11-30T23:09:10.077 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../012-libcephfs2_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:10.141 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libcephfs2 (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:10.269 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-11-30T23:09:10.288 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-11-30T23:09:10.327 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-30T23:09:10.495 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-rados. 2023-11-30T23:09:10.513 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../013-python3-rados_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:10.553 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-rados (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:10.722 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-11-30T23:09:10.741 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-11-30T23:09:10.781 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-11-30T23:09:10.906 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-30T23:09:10.923 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:09:10.964 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-ceph-argparse (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:11.142 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-30T23:09:11.158 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-11-30T23:09:11.200 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-30T23:09:11.250 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cephfs. 2023-11-30T23:09:11.267 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../015-python3-cephfs_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:11.308 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cephfs (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:11.578 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librgw2. 2023-11-30T23:09:11.596 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../022-librgw2_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:11.638 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librgw2 (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:11.669 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-30T23:09:11.687 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:09:11.753 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:12.081 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-prettytable. 2023-11-30T23:09:12.101 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-11-30T23:09:12.139 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-11-30T23:09:12.384 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-rbd. 2023-11-30T23:09:12.401 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../018-python3-rbd_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:12.433 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-rbd (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:12.498 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rgw. 2023-11-30T23:09:12.514 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../023-python3-rgw_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:12.556 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rgw (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:12.795 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-11-30T23:09:12.814 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-11-30T23:09:12.853 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-30T23:09:12.917 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liboath0. 2023-11-30T23:09:12.936 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-11-30T23:09:12.975 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-11-30T23:09:13.223 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-11-30T23:09:13.242 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-11-30T23:09:13.281 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-11-30T23:09:13.304 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libradosstriper1. 2023-11-30T23:09:13.321 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../025-libradosstriper1_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:13.363 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libradosstriper1 (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:13.567 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-30T23:09:13.584 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-11-30T23:09:13.650 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-30T23:09:13.841 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-common. 2023-11-30T23:09:13.857 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../026-ceph-common_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:13.915 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:13.979 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package librgw2. 2023-11-30T23:09:13.996 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../022-librgw2_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:14.037 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking librgw2 (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:14.923 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-rgw. 2023-11-30T23:09:14.939 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../023-python3-rgw_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:14.981 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-rgw (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:15.367 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package liboath0. 2023-11-30T23:09:15.385 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-11-30T23:09:15.417 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-11-30T23:09:15.762 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libradosstriper1. 2023-11-30T23:09:15.779 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../025-libradosstriper1_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:15.820 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libradosstriper1 (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:16.340 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-common. 2023-11-30T23:09:16.361 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../026-ceph-common_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:16.399 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:16.421 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-base. 2023-11-30T23:09:16.438 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../027-ceph-base_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:16.481 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-base (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:17.884 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-30T23:09:17.903 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-11-30T23:09:17.975 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-11-30T23:09:18.304 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-natsort. 2023-11-30T23:09:18.324 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-11-30T23:09:18.396 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-11-30T23:09:18.715 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-logutils. 2023-11-30T23:09:18.733 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-11-30T23:09:18.807 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-11-30T23:09:18.913 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-base. 2023-11-30T23:09:18.932 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../027-ceph-base_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:18.981 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-base (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:19.110 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-30T23:09:19.126 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-11-30T23:09:19.168 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-11-30T23:09:19.513 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-mako. 2023-11-30T23:09:19.529 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-11-30T23:09:19.571 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-30T23:09:19.942 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-30T23:09:19.967 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-30T23:09:19.999 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-30T23:09:20.327 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-30T23:09:20.345 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-11-30T23:09:20.385 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-11-30T23:09:20.426 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-30T23:09:20.442 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-11-30T23:09:20.483 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-11-30T23:09:20.722 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webob. 2023-11-30T23:09:20.738 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-11-30T23:09:20.780 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-11-30T23:09:20.837 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-natsort. 2023-11-30T23:09:20.854 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-11-30T23:09:20.895 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-11-30T23:09:21.141 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-soupsieve. 2023-11-30T23:09:21.157 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-11-30T23:09:21.200 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-30T23:09:21.249 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-logutils. 2023-11-30T23:09:21.266 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-11-30T23:09:21.332 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-11-30T23:09:21.528 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-bs4. 2023-11-30T23:09:21.545 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-11-30T23:09:21.586 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-11-30T23:09:21.668 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-30T23:09:21.688 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-11-30T23:09:21.726 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-11-30T23:09:21.964 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-waitress. 2023-11-30T23:09:21.984 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-11-30T23:09:22.034 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-30T23:09:22.072 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-mako. 2023-11-30T23:09:22.090 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-11-30T23:09:22.130 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-30T23:09:22.475 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-30T23:09:22.491 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-30T23:09:22.533 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-30T23:09:22.727 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempita. 2023-11-30T23:09:22.747 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-11-30T23:09:22.792 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-11-30T23:09:22.853 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-30T23:09:22.870 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-11-30T23:09:22.944 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-11-30T23:09:23.063 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-paste. 2023-11-30T23:09:23.083 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-11-30T23:09:23.112 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-11-30T23:09:23.281 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-webob. 2023-11-30T23:09:23.299 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-11-30T23:09:23.339 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-11-30T23:09:23.457 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-30T23:09:23.475 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-11-30T23:09:23.518 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-11-30T23:09:23.692 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-soupsieve. 2023-11-30T23:09:23.707 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-11-30T23:09:23.750 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-30T23:09:23.851 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-30T23:09:23.868 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-11-30T23:09:23.910 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-11-30T23:09:24.062 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-bs4. 2023-11-30T23:09:24.081 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-11-30T23:09:24.120 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-11-30T23:09:24.246 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webtest. 2023-11-30T23:09:24.267 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-11-30T23:09:24.306 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-11-30T23:09:24.481 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-waitress. 2023-11-30T23:09:24.501 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-11-30T23:09:24.554 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-30T23:09:24.574 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pecan. 2023-11-30T23:09:24.593 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-11-30T23:09:24.633 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-11-30T23:09:24.876 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-tempita. 2023-11-30T23:09:24.895 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-11-30T23:09:24.929 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-30T23:09:24.934 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-11-30T23:09:24.948 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-11-30T23:09:24.989 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-30T23:09:25.221 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-paste. 2023-11-30T23:09:25.237 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-11-30T23:09:25.270 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-11-30T23:09:25.309 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-30T23:09:25.325 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:09:25.367 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-modules-core (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:25.607 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-30T23:09:25.625 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-11-30T23:09:25.666 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-11-30T23:09:25.756 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-30T23:09:25.775 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:25.847 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libsqlite3-mod-ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:26.002 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-30T23:09:26.019 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-11-30T23:09:26.060 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-11-30T23:09:26.175 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cryptography. 2023-11-30T23:09:26.191 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-11-30T23:09:26.258 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-30T23:09:26.405 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-webtest. 2023-11-30T23:09:26.425 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-11-30T23:09:26.480 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-11-30T23:09:26.595 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-openssl. 2023-11-30T23:09:26.615 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-11-30T23:09:26.687 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-11-30T23:09:26.808 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pecan. 2023-11-30T23:09:26.824 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-11-30T23:09:26.866 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-11-30T23:09:27.031 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr. 2023-11-30T23:09:27.049 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../050-ceph-mgr_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:27.123 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:27.246 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-30T23:09:27.265 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-11-30T23:09:27.296 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-30T23:09:27.632 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-30T23:09:27.650 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:09:27.660 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mon. 2023-11-30T23:09:27.677 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../051-ceph-mon_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:27.691 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-modules-core (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:27.718 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mon (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:28.113 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-30T23:09:28.130 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:28.171 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libsqlite3-mod-ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:28.524 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cryptography. 2023-11-30T23:09:28.546 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-11-30T23:09:28.583 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-30T23:09:28.986 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-openssl. 2023-11-30T23:09:29.002 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-11-30T23:09:29.021 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-osd. 2023-11-30T23:09:29.038 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../052-ceph-osd_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:29.069 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-11-30T23:09:29.096 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-osd (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:29.389 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr. 2023-11-30T23:09:29.406 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../050-ceph-mgr_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:29.439 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:30.009 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mon. 2023-11-30T23:09:30.024 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../051-ceph-mon_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:30.067 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mon (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:31.379 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-osd. 2023-11-30T23:09:31.397 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../052-ceph-osd_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:31.438 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-osd (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:32.224 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph. 2023-11-30T23:09:32.241 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../053-ceph_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:32.282 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:32.610 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-fuse. 2023-11-30T23:09:32.628 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../054-ceph-fuse_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:32.668 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:33.155 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mds. 2023-11-30T23:09:33.171 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../055-ceph-mds_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:33.255 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mds (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:33.791 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephadm. 2023-11-30T23:09:33.811 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../056-cephadm_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:33.849 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:34.202 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-30T23:09:34.220 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-11-30T23:09:34.260 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-11-30T23:09:34.507 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph. 2023-11-30T23:09:34.525 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../053-ceph_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:34.565 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:34.647 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jinja2. 2023-11-30T23:09:34.663 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-11-30T23:09:34.705 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-11-30T23:09:34.916 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-fuse. 2023-11-30T23:09:34.934 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../054-ceph-fuse_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:34.976 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:35.059 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-30T23:09:35.076 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:09:35.116 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:35.421 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mds. 2023-11-30T23:09:35.438 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../055-ceph-mds_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:35.478 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-30T23:09:35.480 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mds (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:35.494 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-11-30T23:09:35.540 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-30T23:09:35.856 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jwt. 2023-11-30T23:09:35.875 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-11-30T23:09:35.913 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-30T23:09:35.966 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package cephadm. 2023-11-30T23:09:35.982 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../056-cephadm_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:36.024 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:36.258 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-attr. 2023-11-30T23:09:36.274 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2023-11-30T23:09:36.316 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-11-30T23:09:36.326 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-30T23:09:36.345 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-11-30T23:09:36.385 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-11-30T23:09:36.669 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pluggy. 2023-11-30T23:09:36.686 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2023-11-30T23:09:36.727 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-11-30T23:09:36.763 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-jinja2. 2023-11-30T23:09:36.779 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-11-30T23:09:36.854 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-11-30T23:09:37.064 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-py. 2023-11-30T23:09:37.081 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-11-30T23:09:37.122 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-11-30T23:09:37.191 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-30T23:09:37.207 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:09:37.249 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:37.475 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-atomicwrites. 2023-11-30T23:09:37.492 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-11-30T23:09:37.533 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-11-30T23:09:37.611 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-30T23:09:37.627 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-11-30T23:09:37.669 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-30T23:09:37.836 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-packaging. 2023-11-30T23:09:37.855 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2023-11-30T23:09:37.894 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-packaging (20.3-1) ... 2023-11-30T23:09:38.005 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-jwt. 2023-11-30T23:09:38.025 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-11-30T23:09:38.063 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-30T23:09:38.230 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pytest. 2023-11-30T23:09:38.247 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2023-11-30T23:09:38.288 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-11-30T23:09:38.400 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-attr. 2023-11-30T23:09:38.418 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2023-11-30T23:09:38.483 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-11-30T23:09:38.659 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-30T23:09:38.675 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2023-11-30T23:09:38.717 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-30T23:09:38.869 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pluggy. 2023-11-30T23:09:38.887 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2023-11-30T23:09:38.927 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-11-30T23:09:39.011 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjs-underscore. 2023-11-30T23:09:39.029 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-11-30T23:09:39.069 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-30T23:09:39.264 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-py. 2023-11-30T23:09:39.282 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-11-30T23:09:39.322 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-11-30T23:09:39.347 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-11-30T23:09:39.367 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-11-30T23:09:39.405 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-30T23:09:39.701 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-atomicwrites. 2023-11-30T23:09:39.716 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-11-30T23:09:39.749 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-routes. 2023-11-30T23:09:39.768 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2023-11-30T23:09:39.787 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-11-30T23:09:39.807 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-11-30T23:09:40.120 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-packaging. 2023-11-30T23:09:40.137 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2023-11-30T23:09:40.153 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-30T23:09:40.172 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:09:40.178 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-packaging (20.3-1) ... 2023-11-30T23:09:40.210 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-dashboard (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:40.507 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pytest. 2023-11-30T23:09:40.525 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2023-11-30T23:09:40.564 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-11-30T23:09:40.730 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-decorator. 2023-11-30T23:09:40.748 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-11-30T23:09:40.788 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-11-30T23:09:40.926 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-30T23:09:40.945 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2023-11-30T23:09:40.984 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-30T23:09:41.100 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-11-30T23:09:41.119 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-11-30T23:09:41.158 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-30T23:09:41.262 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libjs-underscore. 2023-11-30T23:09:41.279 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-11-30T23:09:41.329 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-30T23:09:41.486 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-scipy. 2023-11-30T23:09:41.504 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-11-30T23:09:41.543 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-11-30T23:09:41.622 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-11-30T23:09:41.642 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-11-30T23:09:41.714 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-30T23:09:42.067 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-routes. 2023-11-30T23:09:42.083 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2023-11-30T23:09:42.125 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-11-30T23:09:42.478 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-30T23:09:42.494 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:09:42.536 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-dashboard (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:42.843 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-11-30T23:09:42.863 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-11-30T23:09:42.926 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-30T23:09:43.057 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-decorator. 2023-11-30T23:09:43.073 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-11-30T23:09:43.115 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-11-30T23:09:43.416 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-11-30T23:09:43.435 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-11-30T23:09:43.466 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-30T23:09:43.471 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-joblib. 2023-11-30T23:09:43.489 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2023-11-30T23:09:43.529 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-11-30T23:09:43.803 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-scipy. 2023-11-30T23:09:43.822 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-11-30T23:09:43.861 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-11-30T23:09:43.933 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn. 2023-11-30T23:09:43.950 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-11-30T23:09:43.991 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-30T23:09:44.767 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-30T23:09:44.785 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:09:44.825 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:45.195 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-11-30T23:09:45.213 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-11-30T23:09:45.287 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-30T23:09:45.824 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-joblib. 2023-11-30T23:09:45.842 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2023-11-30T23:09:45.908 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-11-30T23:09:45.969 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cachetools. 2023-11-30T23:09:45.985 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2023-11-30T23:09:46.027 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-11-30T23:09:46.311 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-sklearn. 2023-11-30T23:09:46.328 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-11-30T23:09:46.369 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-30T23:09:46.445 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-30T23:09:46.462 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-11-30T23:09:46.528 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-11-30T23:09:46.898 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-30T23:09:46.916 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-11-30T23:09:46.956 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-30T23:09:47.101 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-30T23:09:47.121 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:09:47.159 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:47.302 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rsa. 2023-11-30T23:09:47.320 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2023-11-30T23:09:47.360 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rsa (4.0-3) ... 2023-11-30T23:09:47.697 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-google-auth. 2023-11-30T23:09:47.716 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2023-11-30T23:09:47.754 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-11-30T23:09:48.034 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-blinker. 2023-11-30T23:09:48.052 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-11-30T23:09:48.125 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-30T23:09:48.321 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-cachetools. 2023-11-30T23:09:48.336 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2023-11-30T23:09:48.378 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-11-30T23:09:48.428 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-oauthlib. 2023-11-30T23:09:48.448 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-11-30T23:09:48.505 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-30T23:09:48.800 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-30T23:09:48.816 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-11-30T23:09:48.834 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-30T23:09:48.849 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-11-30T23:09:48.883 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-11-30T23:09:48.890 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-30T23:09:49.226 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-websocket. 2023-11-30T23:09:49.237 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-30T23:09:49.244 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-11-30T23:09:49.253 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-11-30T23:09:49.295 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-30T23:09:49.320 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-11-30T23:09:49.633 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-rsa. 2023-11-30T23:09:49.638 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-30T23:09:49.651 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2023-11-30T23:09:49.655 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-11-30T23:09:49.691 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-rsa (4.0-3) ... 2023-11-30T23:09:49.729 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-11-30T23:09:50.037 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-google-auth. 2023-11-30T23:09:50.054 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2023-11-30T23:09:50.095 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-11-30T23:09:50.301 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-30T23:09:50.318 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:09:50.359 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-k8sevents (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:50.441 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-blinker. 2023-11-30T23:09:50.456 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-11-30T23:09:50.531 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-30T23:09:50.712 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-30T23:09:50.729 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2023-11-30T23:09:50.770 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-11-30T23:09:50.843 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-oauthlib. 2023-11-30T23:09:50.862 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-11-30T23:09:50.901 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-30T23:09:51.148 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-30T23:09:51.165 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-30T23:09:51.206 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-30T23:09:51.263 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-30T23:09:51.280 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-11-30T23:09:51.321 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-30T23:09:51.510 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package jq. 2023-11-30T23:09:51.528 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-30T23:09:51.567 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-11-30T23:09:51.666 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-websocket. 2023-11-30T23:09:51.684 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-11-30T23:09:51.724 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-11-30T23:09:51.845 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package socat. 2023-11-30T23:09:51.864 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2023-11-30T23:09:51.903 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking socat (1.7.3.3-2) ... 2023-11-30T23:09:52.044 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-30T23:09:52.062 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-11-30T23:09:52.127 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-11-30T23:09:52.265 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package xmlstarlet. 2023-11-30T23:09:52.282 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-11-30T23:09:52.323 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-11-30T23:09:52.700 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-30T23:09:52.705 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-test. 2023-11-30T23:09:52.719 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:09:52.720 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../096-ceph-test_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:52.762 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-test (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:52.782 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-mgr-k8sevents (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:53.552 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-30T23:09:53.570 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2023-11-30T23:09:53.644 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-11-30T23:09:54.022 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-30T23:09:54.039 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-30T23:09:54.080 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-30T23:09:54.375 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package jq. 2023-11-30T23:09:54.392 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-30T23:09:54.458 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-11-30T23:09:54.696 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package socat. 2023-11-30T23:09:54.712 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2023-11-30T23:09:54.787 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking socat (1.7.3.3-2) ... 2023-11-30T23:09:55.115 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package xmlstarlet. 2023-11-30T23:09:55.134 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-11-30T23:09:55.173 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-11-30T23:09:55.570 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-test. 2023-11-30T23:09:55.587 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../096-ceph-test_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:55.628 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-test (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:57.291 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-volume. 2023-11-30T23:09:57.313 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../097-ceph-volume_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:09:57.349 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-volume (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:57.745 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-30T23:09:57.764 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:57.828 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephfs-mirror (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:58.190 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-colorama. 2023-11-30T23:09:58.209 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2023-11-30T23:09:58.248 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-11-30T23:09:58.509 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephfs-shell. 2023-11-30T23:09:58.525 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../100-cephfs-shell_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:09:58.600 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephfs-shell (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:58.861 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephfs-top. 2023-11-30T23:09:58.880 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../101-cephfs-top_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:09:58.943 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephfs-top (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:09:59.205 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package fonts-mathjax. 2023-11-30T23:09:59.225 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-30T23:09:59.263 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-30T23:09:59.817 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-30T23:09:59.834 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:09:59.875 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs-dev (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:00.232 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ceph-volume. 2023-11-30T23:10:00.250 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../097-ceph-volume_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:10:00.287 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package nvme-cli. 2023-11-30T23:10:00.290 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ceph-volume (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:00.303 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-11-30T23:10:00.363 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-11-30T23:10:00.700 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-30T23:10:00.712 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-30T23:10:00.717 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-11-30T23:10:00.728 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:10:00.758 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-11-30T23:10:00.769 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking cephfs-mirror (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:01.131 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-colorama. 2023-11-30T23:10:01.148 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2023-11-30T23:10:01.169 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjs-mathjax. 2023-11-30T23:10:01.188 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-30T23:10:01.189 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-11-30T23:10:01.227 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-30T23:10:01.476 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package cephfs-shell. 2023-11-30T23:10:01.493 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../100-cephfs-shell_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:10:01.533 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking cephfs-shell (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:01.812 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package cephfs-top. 2023-11-30T23:10:01.830 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../101-cephfs-top_18.2.0-1249-ga6f82997-1focal_all.deb ... 2023-11-30T23:10:01.869 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking cephfs-top (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:02.155 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package fonts-mathjax. 2023-11-30T23:10:02.173 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-30T23:10:02.214 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-30T23:10:02.768 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-30T23:10:02.786 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:10:02.825 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libcephfs-dev (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:02.937 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-natsort-doc. 2023-11-30T23:10:02.955 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2023-11-30T23:10:02.987 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-11-30T23:10:03.262 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package nvme-cli. 2023-11-30T23:10:03.278 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-11-30T23:10:03.315 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webencodings. 2023-11-30T23:10:03.333 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-11-30T23:10:03.338 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-11-30T23:10:03.373 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-30T23:10:03.668 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-30T23:10:03.684 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-11-30T23:10:03.717 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-11-30T23:10:03.726 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-html5lib. 2023-11-30T23:10:03.743 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2023-11-30T23:10:03.784 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-11-30T23:10:04.128 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libjs-mathjax. 2023-11-30T23:10:04.144 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-30T23:10:04.154 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-11-30T23:10:04.171 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-11-30T23:10:04.211 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-30T23:10:04.212 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-30T23:10:04.732 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastescript. 2023-11-30T23:10:04.750 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2023-11-30T23:10:04.790 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-30T23:10:05.144 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-psutil. 2023-11-30T23:10:05.164 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-11-30T23:10:05.203 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-11-30T23:10:05.558 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-30T23:10:05.574 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-11-30T23:10:05.619 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-30T23:10:05.898 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python-natsort-doc. 2023-11-30T23:10:05.917 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2023-11-30T23:10:05.951 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplejson. 2023-11-30T23:10:05.956 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-11-30T23:10:05.972 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-11-30T23:10:06.018 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-30T23:10:06.288 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-30T23:10:06.306 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-11-30T23:10:06.317 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-webencodings. 2023-11-30T23:10:06.335 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-11-30T23:10:06.371 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-30T23:10:06.375 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-30T23:10:06.704 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-html5lib. 2023-11-30T23:10:06.721 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2023-11-30T23:10:06.781 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-11-30T23:10:07.087 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package radosgw. 2023-11-30T23:10:07.104 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../116-radosgw_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:10:07.149 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-11-30T23:10:07.165 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking radosgw (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:07.170 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-11-30T23:10:07.207 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-30T23:10:07.705 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pastescript. 2023-11-30T23:10:07.726 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2023-11-30T23:10:07.796 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-30T23:10:08.125 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-psutil. 2023-11-30T23:10:08.142 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-11-30T23:10:08.191 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-11-30T23:10:08.536 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-30T23:10:08.555 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-11-30T23:10:08.588 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-30T23:10:08.606 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package rbd-fuse. 2023-11-30T23:10:08.626 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../117-rbd-fuse_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:10:08.664 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking rbd-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:08.985 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package python3-simplejson. 2023-11-30T23:10:09.000 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-attr (19.3.0-2) ... 2023-11-30T23:10:09.000 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-11-30T23:10:09.075 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-30T23:10:09.305 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-11-30T23:10:09.378 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-30T23:10:09.398 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-11-30T23:10:09.431 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-30T23:10:09.444 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-30T23:10:09.597 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-11-30T23:10:09.783 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:10.176 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package radosgw. 2023-11-30T23:10:10.195 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../116-radosgw_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:10:10.233 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking radosgw (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:10.370 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user cephadm....done 2023-11-30T23:10:10.557 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-30T23:10:10.683 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-30T23:10:11.018 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-30T23:10:11.311 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-30T23:10:11.436 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-11-30T23:10:11.587 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-11-30T23:10:11.679 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package rbd-fuse. 2023-11-30T23:10:11.696 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../117-rbd-fuse_18.2.0-1249-ga6f82997-1focal_amd64.deb ... 2023-11-30T23:10:11.770 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking rbd-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:11.914 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-11-30T23:10:12.065 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-attr (19.3.0-2) ... 2023-11-30T23:10:12.350 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-11-30T23:10:12.408 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-30T23:10:12.509 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-30T23:10:12.638 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-11-30T23:10:12.718 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-11-30T23:10:12.872 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:13.044 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-11-30T23:10:13.345 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-30T23:10:13.492 INFO:teuthology.orchestra.run.smithi156.stdout:Adding system user cephadm....done 2023-11-30T23:10:13.645 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-30T23:10:13.663 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-30T23:10:13.796 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-30T23:10:13.960 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-argparse (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:14.139 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-30T23:10:14.274 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-30T23:10:14.400 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-11-30T23:10:14.441 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-30T23:10:14.567 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-11-30T23:10:14.709 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-11-30T23:10:14.726 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-11-30T23:10:15.002 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-30T23:10:15.061 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-11-30T23:10:15.303 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-30T23:10:15.429 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-11-30T23:10:15.480 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-30T23:10:15.773 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-11-30T23:10:15.814 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-11-30T23:10:16.057 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-11-30T23:10:16.106 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-11-30T23:10:16.350 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-30T23:10:16.424 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-30T23:10:16.626 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-30T23:10:16.778 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-11-30T23:10:16.927 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-ceph-argparse (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:17.076 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-11-30T23:10:17.261 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-30T23:10:17.396 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-11-30T23:10:17.419 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-11-30T23:10:17.680 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-11-30T23:10:17.712 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-packaging (20.3-1) ... 2023-11-30T23:10:17.965 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-30T23:10:18.013 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-11-30T23:10:18.164 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-30T23:10:18.249 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-30T23:10:18.290 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-30T23:10:18.375 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-11-30T23:10:18.591 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-11-30T23:10:18.751 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-11-30T23:10:19.001 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-11-30T23:10:19.052 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-11-30T23:10:19.310 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-30T23:10:19.370 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-30T23:10:19.712 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-30T23:10:19.780 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-11-30T23:10:20.072 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-11-30T23:10:20.114 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up socat (1.7.3.3-2) ... 2023-11-30T23:10:20.240 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:20.456 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-11-30T23:10:20.575 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-30T23:10:20.709 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-11-30T23:10:20.791 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-packaging (20.3-1) ... 2023-11-30T23:10:21.044 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-30T23:10:21.117 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-11-30T23:10:21.169 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-11-30T23:10:21.243 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-30T23:10:21.320 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-11-30T23:10:21.369 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-30T23:10:21.605 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-30T23:10:21.695 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-11-30T23:10:21.931 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-30T23:10:22.057 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-30T23:10:22.138 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-11-30T23:10:22.208 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-11-30T23:10:22.448 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-30T23:10:22.535 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-11-30T23:10:22.824 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-30T23:10:22.845 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-11-30T23:10:23.171 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-30T23:10:23.192 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up socat (1.7.3.3-2) ... 2023-11-30T23:10:23.305 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-30T23:10:23.318 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:23.598 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-11-30T23:10:23.703 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-30T23:10:23.837 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-11-30T23:10:23.891 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-30T23:10:24.175 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-11-30T23:10:24.189 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-30T23:10:24.530 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-11-30T23:10:24.606 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-11-30T23:10:24.803 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-11-30T23:10:24.840 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-11-30T23:10:24.971 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-30T23:10:25.133 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-30T23:10:25.325 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-11-30T23:10:25.451 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-30T23:10:25.600 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-30T23:10:25.691 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-30T23:10:25.737 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-11-30T23:10:25.819 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-30T23:10:25.945 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-11-30T23:10:26.055 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-11-30T23:10:26.271 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-30T23:10:26.340 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-11-30T23:10:26.564 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-11-30T23:10:26.632 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-30T23:10:26.759 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-30T23:10:27.038 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-11-30T23:10:27.355 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-30T23:10:27.664 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-11-30T23:10:28.037 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-30T23:10:28.064 INFO:teuthology.orchestra.run.smithi156.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-11-30T23:10:28.170 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-11-30T23:10:28.342 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-11-30T23:10:28.478 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-30T23:10:28.539 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-11-30T23:10:28.819 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-11-30T23:10:28.892 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-11-30T23:10:29.179 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-30T23:10:29.295 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-30T23:10:29.305 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-30T23:10:29.456 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-11-30T23:10:29.798 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-30T23:10:29.811 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-11-30T23:10:30.109 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-11-30T23:10:30.179 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-30T23:10:30.497 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-11-30T23:10:30.899 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-30T23:10:31.267 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-30T23:10:31.558 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-30T23:10:31.717 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-11-30T23:10:32.085 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-11-30T23:10:32.340 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-30T23:10:32.386 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-11-30T23:10:32.466 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-11-30T23:10:32.617 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-11-30T23:10:32.679 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-30T23:10:32.743 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rsa (4.0-3) ... 2023-11-30T23:10:32.805 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-11-30T23:10:33.044 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-30T23:10:33.140 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-30T23:10:33.170 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-11-30T23:10:33.459 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-11-30T23:10:33.472 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-30T23:10:33.756 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-30T23:10:33.835 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-30T23:10:34.091 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-11-30T23:10:34.195 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-30T23:10:34.484 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librados2 (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:34.729 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-11-30T23:10:34.881 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librgw2 (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:35.048 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libsqlite3-mod-ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:35.174 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs2 (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:35.267 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-30T23:10:35.300 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-routes (2.4.1-2) ... 2023-11-30T23:10:35.393 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-11-30T23:10:35.560 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-11-30T23:10:35.602 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libradosstriper1 (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:35.686 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-rsa (4.0-3) ... 2023-11-30T23:10:35.728 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-11-30T23:10:35.996 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-30T23:10:36.063 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librbd1 (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:36.122 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-11-30T23:10:36.233 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-modules-core (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:36.359 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:36.448 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-30T23:10:36.584 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-30T23:10:36.584 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-30T23:10:36.774 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-30T23:10:37.060 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs-dev (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:37.142 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-11-30T23:10:37.186 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rados (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:37.312 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephfs-top (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:37.463 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-11-30T23:10:37.502 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librados2 (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:37.714 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-11-30T23:10:37.865 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librgw2 (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:37.991 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libsqlite3-mod-ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:38.133 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libcephfs2 (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:38.260 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-routes (2.4.1-2) ... 2023-11-30T23:10:38.384 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rbd (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:38.527 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up rbd-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:38.561 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libradosstriper1 (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:38.678 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rgw (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:38.687 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-11-30T23:10:38.804 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cephfs (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:38.930 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephfs-shell (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:39.022 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up librbd1 (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:39.073 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:39.173 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-modules-core (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:39.299 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:39.549 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-30T23:10:39.549 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-30T23:10:39.651 INFO:teuthology.orchestra.run.smithi073.stdout:Adding group ceph....done 2023-11-30T23:10:39.984 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libcephfs-dev (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:40.151 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-rados (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:40.237 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user ceph....done 2023-11-30T23:10:40.277 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up cephfs-top (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:40.429 INFO:teuthology.orchestra.run.smithi073.stdout:Setting system user ceph properties....done 2023-11-30T23:10:40.445 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-11-30T23:10:40.447 INFO:teuthology.orchestra.run.smithi073.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-30T23:10:40.587 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-30T23:10:40.911 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-30T23:10:41.375 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephfs-mirror (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:41.390 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-rbd (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:41.508 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up rbd-fuse (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:41.631 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-30T23:10:41.631 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-30T23:10:41.634 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-rgw (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:41.793 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up python3-cephfs (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:41.919 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up cephfs-shell (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:42.060 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-test (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:42.070 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-common (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:42.219 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up radosgw (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:42.672 INFO:teuthology.orchestra.run.smithi156.stdout:Adding group ceph....done 2023-11-30T23:10:42.801 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-30T23:10:42.801 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-30T23:10:43.083 INFO:teuthology.orchestra.run.smithi156.stdout:Adding system user ceph....done 2023-11-30T23:10:43.272 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-base (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:43.278 INFO:teuthology.orchestra.run.smithi156.stdout:Setting system user ceph properties....done 2023-11-30T23:10:43.305 INFO:teuthology.orchestra.run.smithi156.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-30T23:10:43.457 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-30T23:10:43.690 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-30T23:10:43.778 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-30T23:10:44.174 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mds (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:44.263 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up cephfs-mirror (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:44.414 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-30T23:10:44.414 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-30T23:10:44.483 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-30T23:10:44.483 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-30T23:10:44.851 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:44.940 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-test (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:45.105 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-30T23:10:45.106 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-30T23:10:45.232 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up radosgw (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:45.595 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-osd (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:46.055 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-30T23:10:46.056 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-30T23:10:46.082 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-30T23:10:46.083 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-30T23:10:46.502 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-base (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:46.563 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-k8sevents (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:46.689 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-diskprediction-local (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:46.832 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mon (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:46.923 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-30T23:10:47.059 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-30T23:10:47.059 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-30T23:10:47.370 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mds (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:47.500 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:47.605 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-30T23:10:47.606 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-30T23:10:47.643 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:47.794 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-dashboard (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:47.936 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-volume (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:48.055 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:48.277 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-30T23:10:48.278 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-30T23:10:48.289 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-30T23:10:48.441 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-30T23:10:48.718 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-30T23:10:48.732 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-osd (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:49.225 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-30T23:10:49.225 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-30T23:10:49.666 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-k8sevents (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:49.792 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-diskprediction-local (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:49.960 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mon (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:50.179 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-30T23:10:50.179 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-30T23:10:50.726 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-cephadm (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:51.046 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:51.197 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-mgr-dashboard (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:51.340 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ceph-volume (18.2.0-1249-ga6f82997-1focal) ... 2023-11-30T23:10:51.654 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-11-30T23:10:51.712 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-30T23:10:51.878 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-30T23:10:52.179 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-30T23:10:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-30T23:10:52.332 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-30T23:10:52.408 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2023-11-30T23:10:52.614 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2023-11-30T23:10:52.615 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2023-11-30T23:10:52.816 INFO:teuthology.orchestra.run.smithi073.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-11-30T23:10:52.816 INFO:teuthology.orchestra.run.smithi073.stdout:flex is already the newest version (2.6.4-6.2). 2023-11-30T23:10:52.816 INFO:teuthology.orchestra.run.smithi073.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-11-30T23:10:52.816 INFO:teuthology.orchestra.run.smithi073.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-11-30T23:10:52.816 INFO:teuthology.orchestra.run.smithi073.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-11-30T23:10:52.816 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2023-11-30T23:10:52.816 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-30T23:10:52.817 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-30T23:10:52.817 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2023-11-30T23:10:52.817 INFO:teuthology.orchestra.run.smithi073.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-11-30T23:10:52.817 INFO:teuthology.orchestra.run.smithi073.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-11-30T23:10:52.818 INFO:teuthology.orchestra.run.smithi073.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-11-30T23:10:52.818 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-11-30T23:10:52.818 INFO:teuthology.orchestra.run.smithi073.stdout: usb-modeswitch-data wpasupplicant 2023-11-30T23:10:52.819 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2023-11-30T23:10:52.819 INFO:teuthology.orchestra.run.smithi073.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-11-30T23:10:52.819 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-11-30T23:10:52.819 INFO:teuthology.orchestra.run.smithi073.stdout: libengine-pkcs11-openssl 2023-11-30T23:10:52.876 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2023-11-30T23:10:52.876 INFO:teuthology.orchestra.run.smithi073.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-11-30T23:10:52.876 INFO:teuthology.orchestra.run.smithi073.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-11-30T23:10:52.877 INFO:teuthology.orchestra.run.smithi073.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-11-30T23:10:52.877 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-11-30T23:10:52.877 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-11-30T23:10:52.877 INFO:teuthology.orchestra.run.smithi073.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-30T23:10:52.878 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2023-11-30T23:10:52.879 INFO:teuthology.orchestra.run.smithi073.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-11-30T23:10:52.971 INFO:teuthology.orchestra.run.smithi073.stdout:6 upgraded, 31 newly installed, 0 to remove and 253 not upgraded. 2023-11-30T23:10:52.972 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 25.3 MB of archives. 2023-11-30T23:10:52.972 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-11-30T23:10:52.972 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-11-30T23:10:53.124 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-11-30T23:10:53.125 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-11-30T23:10:53.125 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-11-30T23:10:53.131 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-11-30T23:10:53.132 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-11-30T23:10:53.157 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-11-30T23:10:53.158 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-11-30T23:10:53.160 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-11-30T23:10:53.162 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-11-30T23:10:53.162 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-11-30T23:10:53.169 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-11-30T23:10:53.170 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-11-30T23:10:53.172 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-11-30T23:10:53.172 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-11-30T23:10:53.189 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-11-30T23:10:53.189 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-11-30T23:10:53.194 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-11-30T23:10:53.196 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-11-30T23:10:53.206 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-11-30T23:10:53.206 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-11-30T23:10:53.225 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-11-30T23:10:53.225 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-11-30T23:10:53.238 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-11-30T23:10:53.257 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-11-30T23:10:53.281 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-11-30T23:10:53.287 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-11-30T23:10:53.287 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-11-30T23:10:53.292 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-11-30T23:10:53.293 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-11-30T23:10:53.310 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-11-30T23:10:53.312 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-11-30T23:10:53.530 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-11-30T23:10:53.530 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-11-30T23:10:53.594 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-11-30T23:10:53.595 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-11-30T23:10:53.596 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-11-30T23:10:53.998 INFO:teuthology.orchestra.run.smithi073.stdout:Preconfiguring packages ... 2023-11-30T23:10:54.215 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 25.3 MB in 1s (35.6 MB/s) 2023-11-30T23:10:54.505 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152782 files and directories currently installed.) 2023-11-30T23:10:54.511 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-30T23:10:54.674 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-30T23:10:55.065 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-11-30T23:10:55.645 INFO:teuthology.orchestra.run.smithi156.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-30T23:10:55.647 DEBUG:teuthology.orchestra.run.smithi156:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-30T23:10:55.718 INFO:teuthology.orchestra.run.smithi156.stdout:Reading package lists... 2023-11-30T23:10:55.906 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-11-30T23:10:55.925 INFO:teuthology.orchestra.run.smithi156.stdout:Building dependency tree... 2023-11-30T23:10:55.926 INFO:teuthology.orchestra.run.smithi156.stdout:Reading state information... 2023-11-30T23:10:56.129 INFO:teuthology.orchestra.run.smithi156.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-11-30T23:10:56.129 INFO:teuthology.orchestra.run.smithi156.stdout:flex is already the newest version (2.6.4-6.2). 2023-11-30T23:10:56.129 INFO:teuthology.orchestra.run.smithi156.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-11-30T23:10:56.129 INFO:teuthology.orchestra.run.smithi156.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-11-30T23:10:56.129 INFO:teuthology.orchestra.run.smithi156.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-11-30T23:10:56.129 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages were automatically installed and are no longer required: 2023-11-30T23:10:56.129 INFO:teuthology.orchestra.run.smithi156.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-30T23:10:56.130 INFO:teuthology.orchestra.run.smithi156.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-30T23:10:56.130 INFO:teuthology.orchestra.run.smithi156.stdout:The following additional packages will be installed: 2023-11-30T23:10:56.130 INFO:teuthology.orchestra.run.smithi156.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-11-30T23:10:56.130 INFO:teuthology.orchestra.run.smithi156.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-11-30T23:10:56.131 INFO:teuthology.orchestra.run.smithi156.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-11-30T23:10:56.131 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-11-30T23:10:56.131 INFO:teuthology.orchestra.run.smithi156.stdout: usb-modeswitch-data wpasupplicant 2023-11-30T23:10:56.132 INFO:teuthology.orchestra.run.smithi156.stdout:Suggested packages: 2023-11-30T23:10:56.132 INFO:teuthology.orchestra.run.smithi156.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-11-30T23:10:56.132 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-11-30T23:10:56.132 INFO:teuthology.orchestra.run.smithi156.stdout: libengine-pkcs11-openssl 2023-11-30T23:10:56.189 INFO:teuthology.orchestra.run.smithi156.stdout:The following NEW packages will be installed: 2023-11-30T23:10:56.189 INFO:teuthology.orchestra.run.smithi156.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-11-30T23:10:56.190 INFO:teuthology.orchestra.run.smithi156.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-11-30T23:10:56.190 INFO:teuthology.orchestra.run.smithi156.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-11-30T23:10:56.190 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-11-30T23:10:56.190 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-11-30T23:10:56.190 INFO:teuthology.orchestra.run.smithi156.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-30T23:10:56.191 INFO:teuthology.orchestra.run.smithi156.stdout:The following packages will be upgraded: 2023-11-30T23:10:56.192 INFO:teuthology.orchestra.run.smithi156.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-11-30T23:10:56.245 INFO:teuthology.orchestra.run.smithi156.stdout:6 upgraded, 31 newly installed, 0 to remove and 253 not upgraded. 2023-11-30T23:10:56.245 INFO:teuthology.orchestra.run.smithi156.stdout:Need to get 25.3 MB of archives. 2023-11-30T23:10:56.246 INFO:teuthology.orchestra.run.smithi156.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-11-30T23:10:56.246 INFO:teuthology.orchestra.run.smithi156.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-11-30T23:10:56.375 INFO:teuthology.orchestra.run.smithi156.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-11-30T23:10:56.376 INFO:teuthology.orchestra.run.smithi156.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-11-30T23:10:56.377 INFO:teuthology.orchestra.run.smithi156.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-11-30T23:10:56.381 INFO:teuthology.orchestra.run.smithi156.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-11-30T23:10:56.382 INFO:teuthology.orchestra.run.smithi156.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-11-30T23:10:56.400 INFO:teuthology.orchestra.run.smithi156.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-11-30T23:10:56.401 INFO:teuthology.orchestra.run.smithi156.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-11-30T23:10:56.402 INFO:teuthology.orchestra.run.smithi156.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-11-30T23:10:56.403 INFO:teuthology.orchestra.run.smithi156.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-11-30T23:10:56.403 INFO:teuthology.orchestra.run.smithi156.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-11-30T23:10:56.409 INFO:teuthology.orchestra.run.smithi156.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-11-30T23:10:56.410 INFO:teuthology.orchestra.run.smithi156.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-11-30T23:10:56.412 INFO:teuthology.orchestra.run.smithi156.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-11-30T23:10:56.412 INFO:teuthology.orchestra.run.smithi156.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-11-30T23:10:56.426 INFO:teuthology.orchestra.run.smithi156.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-11-30T23:10:56.426 INFO:teuthology.orchestra.run.smithi156.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-11-30T23:10:56.431 INFO:teuthology.orchestra.run.smithi156.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-11-30T23:10:56.433 INFO:teuthology.orchestra.run.smithi156.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-11-30T23:10:56.442 INFO:teuthology.orchestra.run.smithi156.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-11-30T23:10:56.442 INFO:teuthology.orchestra.run.smithi156.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-11-30T23:10:56.456 INFO:teuthology.orchestra.run.smithi156.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-11-30T23:10:56.456 INFO:teuthology.orchestra.run.smithi156.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-11-30T23:10:56.463 INFO:teuthology.orchestra.run.smithi156.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-11-30T23:10:56.473 INFO:teuthology.orchestra.run.smithi156.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-11-30T23:10:56.489 INFO:teuthology.orchestra.run.smithi156.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-11-30T23:10:56.492 INFO:teuthology.orchestra.run.smithi156.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-11-30T23:10:56.492 INFO:teuthology.orchestra.run.smithi156.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-11-30T23:10:56.492 INFO:teuthology.orchestra.run.smithi156.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-11-30T23:10:56.493 INFO:teuthology.orchestra.run.smithi156.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-11-30T23:10:56.501 INFO:teuthology.orchestra.run.smithi156.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-11-30T23:10:56.503 INFO:teuthology.orchestra.run.smithi156.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-11-30T23:10:56.690 INFO:teuthology.orchestra.run.smithi156.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-11-30T23:10:56.690 INFO:teuthology.orchestra.run.smithi156.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-11-30T23:10:56.690 INFO:teuthology.orchestra.run.smithi156.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-11-30T23:10:56.690 INFO:teuthology.orchestra.run.smithi156.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-11-30T23:10:56.690 INFO:teuthology.orchestra.run.smithi156.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-11-30T23:10:57.084 INFO:teuthology.orchestra.run.smithi156.stdout:Preconfiguring packages ... 2023-11-30T23:10:57.281 INFO:teuthology.orchestra.run.smithi156.stdout:Fetched 25.3 MB in 0s (51.5 MB/s) 2023-11-30T23:10:57.333 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152782 files and directories currently installed.) 2023-11-30T23:10:57.339 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-30T23:10:57.472 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-30T23:10:57.750 INFO:teuthology.orchestra.run.smithi156.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152782 files and directories currently installed.) 2023-11-30T23:10:57.754 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-30T23:10:57.903 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-30T23:10:57.909 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-30T23:10:58.112 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-30T23:10:58.449 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-30T23:10:58.927 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152782 files and directories currently installed.) 2023-11-30T23:10:58.931 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-30T23:10:59.070 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-30T23:10:59.116 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-11-30T23:10:59.528 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-30T23:10:59.684 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-30T23:11:00.190 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-30T23:11:00.330 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-11-30T23:11:00.611 INFO:teuthology.orchestra.run.smithi156.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152782 files and directories currently installed.) 2023-11-30T23:11:00.616 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-30T23:11:00.724 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-30T23:11:01.173 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-30T23:11:01.372 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-30T23:11:01.752 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-30T23:11:01.773 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-11-30T23:11:02.046 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-11-30T23:11:02.772 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-30T23:11:03.133 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package dump. 2023-11-30T23:11:03.150 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-11-30T23:11:03.191 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking dump (0.4b46-6) ... 2023-11-30T23:11:03.219 INFO:teuthology.orchestra.run.smithi156.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152782 files and directories currently installed.) 2023-11-30T23:11:03.224 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-30T23:11:03.390 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-30T23:11:03.512 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package indent. 2023-11-30T23:11:03.529 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-11-30T23:11:03.570 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-30T23:11:03.848 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-30T23:11:03.914 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-30T23:11:03.931 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-11-30T23:11:03.992 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-11-30T23:11:04.004 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-30T23:11:04.326 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-30T23:11:04.345 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-11-30T23:11:04.426 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-30T23:11:04.525 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-30T23:11:04.683 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-11-30T23:11:04.704 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-30T23:11:04.725 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-30T23:11:04.762 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-30T23:11:05.149 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-30T23:11:05.168 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-30T23:11:05.188 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-30T23:11:05.207 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-30T23:11:05.208 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-11-30T23:11:05.237 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-11-30T23:11:05.485 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-30T23:11:05.503 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-30T23:11:05.543 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-30T23:11:05.659 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package dump. 2023-11-30T23:11:05.680 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-11-30T23:11:05.715 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking dump (0.4b46-6) ... 2023-11-30T23:11:05.888 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-30T23:11:05.908 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-30T23:11:05.946 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-30T23:11:06.035 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package indent. 2023-11-30T23:11:06.053 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-11-30T23:11:06.094 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-30T23:11:06.325 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-30T23:11:06.342 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-11-30T23:11:06.408 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-30T23:11:06.447 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-30T23:11:06.464 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-11-30T23:11:06.505 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-11-30T23:11:06.727 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-30T23:11:06.748 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-30T23:11:06.786 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-30T23:11:06.841 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-30T23:11:06.862 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-11-30T23:11:06.916 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-30T23:11:07.164 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-30T23:11:07.182 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-30T23:11:07.219 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-30T23:11:07.239 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-30T23:11:07.247 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-30T23:11:07.286 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-30T23:11:07.567 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-30T23:11:07.585 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-30T23:11:07.658 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-30T23:11:07.664 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-30T23:11:07.680 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-30T23:11:07.722 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-30T23:11:08.020 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-30T23:11:08.040 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-30T23:11:08.144 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-30T23:11:08.385 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-30T23:11:08.401 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-30T23:11:08.443 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-30T23:11:08.798 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-30T23:11:08.816 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-30T23:11:08.856 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-30T23:11:09.066 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-30T23:11:09.083 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-30T23:11:09.124 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-30T23:11:09.252 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-30T23:11:09.268 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-11-30T23:11:09.309 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-30T23:11:09.645 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-30T23:11:09.664 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-11-30T23:11:09.670 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-30T23:11:09.688 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-30T23:11:09.725 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-11-30T23:11:09.728 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-30T23:11:10.106 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package modemmanager. 2023-11-30T23:11:10.115 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-30T23:11:10.125 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-30T23:11:10.135 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-30T23:11:10.191 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-30T23:11:10.198 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-30T23:11:10.601 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-30T23:11:10.621 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-30T23:11:10.659 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-30T23:11:10.829 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package wpasupplicant. 2023-11-30T23:11:10.846 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-11-30T23:11:10.887 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-30T23:11:11.004 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-30T23:11:11.021 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-30T23:11:11.062 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-30T23:11:11.348 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-30T23:11:11.366 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-30T23:11:11.406 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-30T23:11:11.451 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package network-manager. 2023-11-30T23:11:11.472 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-30T23:11:11.534 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-11-30T23:11:11.943 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-30T23:11:11.961 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-11-30T23:11:12.001 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-11-30T23:11:12.309 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ppp. 2023-11-30T23:11:12.329 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-11-30T23:11:12.388 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package modemmanager. 2023-11-30T23:11:12.405 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-30T23:11:12.465 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-30T23:11:12.604 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-30T23:11:12.973 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package pptp-linux. 2023-11-30T23:11:12.990 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-11-30T23:11:13.031 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-11-30T23:11:13.127 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package wpasupplicant. 2023-11-30T23:11:13.147 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-11-30T23:11:13.185 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-30T23:11:13.426 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-30T23:11:13.445 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-11-30T23:11:13.502 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-11-30T23:11:13.846 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-30T23:11:13.865 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-11-30T23:11:13.904 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-11-30T23:11:14.296 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-client-12. 2023-11-30T23:11:14.316 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-30T23:11:14.503 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-30T23:11:14.568 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package network-manager. 2023-11-30T23:11:14.585 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-30T23:11:14.650 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-11-30T23:11:15.155 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-common. 2023-11-30T23:11:15.173 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-11-30T23:11:15.237 INFO:teuthology.orchestra.run.smithi073.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-30T23:11:15.265 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-11-30T23:11:15.375 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package ppp. 2023-11-30T23:11:15.395 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-11-30T23:11:15.699 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-30T23:11:15.821 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-12. 2023-11-30T23:11:15.838 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-30T23:11:15.882 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-30T23:11:16.080 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package pptp-linux. 2023-11-30T23:11:16.100 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-11-30T23:11:16.147 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-11-30T23:11:16.542 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-30T23:11:16.560 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-11-30T23:11:16.618 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-11-30T23:11:16.953 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-30T23:11:16.973 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-11-30T23:11:17.036 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-11-30T23:11:17.374 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql-client-12. 2023-11-30T23:11:17.392 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-30T23:11:17.432 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-30T23:11:17.566 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql. 2023-11-30T23:11:17.585 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-11-30T23:11:17.633 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-11-30T23:11:17.910 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-client. 2023-11-30T23:11:17.927 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-11-30T23:11:17.968 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-11-30T23:11:18.120 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql-common. 2023-11-30T23:11:18.137 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-11-30T23:11:18.203 INFO:teuthology.orchestra.run.smithi156.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-30T23:11:18.212 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-30T23:11:18.230 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-11-30T23:11:18.230 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-11-30T23:11:18.304 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-11-30T23:11:18.548 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-30T23:11:18.565 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-11-30T23:11:18.606 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-11-30T23:11:18.744 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql-12. 2023-11-30T23:11:18.761 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-30T23:11:18.805 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-30T23:11:19.018 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-30T23:11:19.034 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-11-30T23:11:19.107 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-30T23:11:19.411 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-11-30T23:11:19.766 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-30T23:11:20.084 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-30T23:11:20.210 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-11-30T23:11:20.370 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-11-30T23:11:20.495 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-30T23:11:20.664 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql. 2023-11-30T23:11:20.684 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-11-30T23:11:20.731 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-11-30T23:11:20.909 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-30T23:11:20.909 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-30T23:11:21.008 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql-client. 2023-11-30T23:11:21.025 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-11-30T23:11:21.066 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-11-30T23:11:21.335 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-30T23:11:21.352 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-11-30T23:11:21.391 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-30T23:11:21.393 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-11-30T23:11:21.662 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-30T23:11:21.680 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-11-30T23:11:21.720 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-11-30T23:11:22.149 INFO:teuthology.orchestra.run.smithi156.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-30T23:11:22.166 INFO:teuthology.orchestra.run.smithi156.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-11-30T23:11:22.226 INFO:teuthology.orchestra.run.smithi156.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-30T23:11:22.298 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-30T23:11:22.396 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-30T23:11:22.522 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-11-30T23:11:22.544 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-11-30T23:11:22.673 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-11-30T23:11:22.755 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-30T23:11:23.098 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-30T23:11:23.249 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-11-30T23:11:23.375 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-11-30T23:11:23.526 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-30T23:11:23.692 INFO:teuthology.orchestra.run.smithi073.stdout:Adding user postgres to group ssl-cert 2023-11-30T23:11:23.959 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:23.959 INFO:teuthology.orchestra.run.smithi073.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-30T23:11:23.960 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-30T23:11:23.960 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-30T23:11:24.191 INFO:teuthology.orchestra.run.smithi073.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-30T23:11:24.191 INFO:teuthology.orchestra.run.smithi073.stdout:Removing obsolete dictionary files: 2023-11-30T23:11:24.463 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-30T23:11:24.511 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-30T23:11:25.286 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-30T23:11:25.347 INFO:teuthology.orchestra.run.smithi156.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-30T23:11:25.436 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-11-30T23:11:25.460 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-30T23:11:25.563 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-30T23:11:25.585 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-11-30T23:11:25.689 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-30T23:11:25.736 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-11-30T23:11:26.658 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-11-30T23:11:26.831 INFO:teuthology.orchestra.run.smithi156.stdout:Adding user postgres to group ssl-cert 2023-11-30T23:11:26.895 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up dump (0.4b46-6) ... 2023-11-30T23:11:26.991 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-30T23:11:27.088 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-30T23:11:27.108 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:27.108 INFO:teuthology.orchestra.run.smithi156.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-30T23:11:27.214 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-30T23:11:27.357 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-30T23:11:27.359 INFO:teuthology.orchestra.run.smithi156.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-30T23:11:27.359 INFO:teuthology.orchestra.run.smithi156.stdout:Removing obsolete dictionary files: 2023-11-30T23:11:27.491 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-30T23:11:27.635 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-30T23:11:27.711 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-30T23:11:27.769 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-30T23:11:28.153 INFO:teuthology.orchestra.run.smithi073.stdout:Creating new PostgreSQL cluster 12/main ... 2023-11-30T23:11:28.166 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-11-30T23:11:28.225 INFO:teuthology.orchestra.run.smithi073.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-30T23:11:28.225 INFO:teuthology.orchestra.run.smithi073.stdout:This user must also own the server process. 2023-11-30T23:11:28.225 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:28.225 INFO:teuthology.orchestra.run.smithi073.stdout:The database cluster will be initialized with locale "en_US". 2023-11-30T23:11:28.225 INFO:teuthology.orchestra.run.smithi073.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-30T23:11:28.225 INFO:teuthology.orchestra.run.smithi073.stdout:The default text search configuration will be set to "english". 2023-11-30T23:11:28.226 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:28.226 INFO:teuthology.orchestra.run.smithi073.stdout:Data page checksums are disabled. 2023-11-30T23:11:28.226 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:28.226 INFO:teuthology.orchestra.run.smithi073.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-11-30T23:11:28.226 INFO:teuthology.orchestra.run.smithi073.stdout:creating subdirectories ... ok 2023-11-30T23:11:28.226 INFO:teuthology.orchestra.run.smithi073.stdout:selecting dynamic shared memory implementation ... posix 2023-11-30T23:11:28.247 INFO:teuthology.orchestra.run.smithi073.stdout:selecting default max_connections ... 100 2023-11-30T23:11:28.272 INFO:teuthology.orchestra.run.smithi073.stdout:selecting default shared_buffers ... 128MB 2023-11-30T23:11:28.278 INFO:teuthology.orchestra.run.smithi073.stdout:selecting default time zone ... Etc/UTC 2023-11-30T23:11:28.279 INFO:teuthology.orchestra.run.smithi073.stdout:creating configuration files ... ok 2023-11-30T23:11:28.384 INFO:teuthology.orchestra.run.smithi073.stdout:running bootstrap script ... ok 2023-11-30T23:11:28.489 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-30T23:11:28.646 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-11-30T23:11:28.766 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-30T23:11:28.917 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-30T23:11:28.944 INFO:teuthology.orchestra.run.smithi073.stdout:performing post-bootstrap initialization ... ok 2023-11-30T23:11:29.671 INFO:teuthology.orchestra.run.smithi073.stdout:syncing data to disk ... ok 2023-11-30T23:11:29.672 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:29.672 INFO:teuthology.orchestra.run.smithi073.stdout:Success. You can now start the database server using: 2023-11-30T23:11:29.672 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:29.672 INFO:teuthology.orchestra.run.smithi073.stdout: pg_ctlcluster 12 main start 2023-11-30T23:11:29.672 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:29.928 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-11-30T23:11:29.985 INFO:teuthology.orchestra.run.smithi073.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-11-30T23:11:29.986 INFO:teuthology.orchestra.run.smithi073.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-11-30T23:11:30.075 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-30T23:11:30.628 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up dump (0.4b46-6) ... 2023-11-30T23:11:30.729 INFO:teuthology.orchestra.run.smithi156.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-30T23:11:30.799 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-30T23:11:30.950 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-30T23:11:31.076 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-30T23:11:31.202 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-30T23:11:31.412 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-30T23:11:31.571 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-30T23:11:31.947 INFO:teuthology.orchestra.run.smithi156.stdout:Creating new PostgreSQL cluster 12/main ... 2023-11-30T23:11:31.967 INFO:teuthology.orchestra.run.smithi156.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-11-30T23:11:32.027 INFO:teuthology.orchestra.run.smithi156.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-30T23:11:32.027 INFO:teuthology.orchestra.run.smithi156.stdout:This user must also own the server process. 2023-11-30T23:11:32.027 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:32.027 INFO:teuthology.orchestra.run.smithi156.stdout:The database cluster will be initialized with locale "en_US". 2023-11-30T23:11:32.027 INFO:teuthology.orchestra.run.smithi156.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-30T23:11:32.028 INFO:teuthology.orchestra.run.smithi156.stdout:The default text search configuration will be set to "english". 2023-11-30T23:11:32.028 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:32.028 INFO:teuthology.orchestra.run.smithi156.stdout:Data page checksums are disabled. 2023-11-30T23:11:32.028 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:32.028 INFO:teuthology.orchestra.run.smithi156.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-11-30T23:11:32.028 INFO:teuthology.orchestra.run.smithi156.stdout:creating subdirectories ... ok 2023-11-30T23:11:32.028 INFO:teuthology.orchestra.run.smithi156.stdout:selecting dynamic shared memory implementation ... posix 2023-11-30T23:11:32.047 INFO:teuthology.orchestra.run.smithi156.stdout:selecting default max_connections ... 100 2023-11-30T23:11:32.074 INFO:teuthology.orchestra.run.smithi156.stdout:selecting default shared_buffers ... 128MB 2023-11-30T23:11:32.080 INFO:teuthology.orchestra.run.smithi156.stdout:selecting default time zone ... Etc/UTC 2023-11-30T23:11:32.081 INFO:teuthology.orchestra.run.smithi156.stdout:creating configuration files ... ok 2023-11-30T23:11:32.184 INFO:teuthology.orchestra.run.smithi156.stdout:running bootstrap script ... ok 2023-11-30T23:11:32.718 INFO:teuthology.orchestra.run.smithi156.stdout:performing post-bootstrap initialization ... ok 2023-11-30T23:11:33.184 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-30T23:11:33.310 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-30T23:11:33.436 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-11-30T23:11:33.488 INFO:teuthology.orchestra.run.smithi156.stdout:syncing data to disk ... ok 2023-11-30T23:11:33.488 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:33.488 INFO:teuthology.orchestra.run.smithi156.stdout:Success. You can now start the database server using: 2023-11-30T23:11:33.488 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:33.488 INFO:teuthology.orchestra.run.smithi156.stdout: pg_ctlcluster 12 main start 2023-11-30T23:11:33.488 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:33.637 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-30T23:11:33.763 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-11-30T23:11:33.813 INFO:teuthology.orchestra.run.smithi156.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-11-30T23:11:33.813 INFO:teuthology.orchestra.run.smithi156.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-11-30T23:11:33.889 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-11-30T23:11:33.904 INFO:teuthology.orchestra.run.smithi156.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-30T23:11:34.625 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:34.625 INFO:teuthology.orchestra.run.smithi073.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-30T23:11:34.625 INFO:teuthology.orchestra.run.smithi073.stdout:which means they are currently configured by ifupdown: 2023-11-30T23:11:34.625 INFO:teuthology.orchestra.run.smithi073.stdout:- enp3s0f1 2023-11-30T23:11:34.625 INFO:teuthology.orchestra.run.smithi073.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-30T23:11:34.625 INFO:teuthology.orchestra.run.smithi073.stdout:remove their configuration from /etc/network/interfaces. 2023-11-30T23:11:34.625 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:34.785 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-30T23:11:35.122 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-30T23:11:35.669 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-30T23:11:36.192 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-30T23:11:36.361 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-11-30T23:11:36.503 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-30T23:11:36.629 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-11-30T23:11:36.780 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-11-30T23:11:36.906 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-30T23:11:36.953 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-30T23:11:37.032 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-30T23:11:37.079 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-30T23:11:37.183 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-30T23:11:37.239 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-11-30T23:11:37.407 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-30T23:11:37.459 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-30T23:11:37.459 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-30T23:11:37.558 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-11-30T23:11:37.684 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-11-30T23:11:38.028 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-11-30T23:11:38.128 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-30T23:11:38.256 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-30T23:11:38.412 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:38.413 INFO:teuthology.orchestra.run.smithi156.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-30T23:11:38.413 INFO:teuthology.orchestra.run.smithi156.stdout:which means they are currently configured by ifupdown: 2023-11-30T23:11:38.413 INFO:teuthology.orchestra.run.smithi156.stdout:- enp3s0f1 2023-11-30T23:11:38.413 INFO:teuthology.orchestra.run.smithi156.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-30T23:11:38.413 INFO:teuthology.orchestra.run.smithi156.stdout:remove their configuration from /etc/network/interfaces. 2023-11-30T23:11:38.413 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:38.431 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-30T23:11:38.568 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-30T23:11:38.749 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-30T23:11:38.892 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-30T23:11:39.432 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-30T23:11:39.936 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-30T23:11:40.105 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-11-30T23:11:40.248 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-30T23:11:40.399 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-11-30T23:11:40.525 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-11-30T23:11:40.675 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-30T23:11:40.810 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-30T23:11:40.936 INFO:teuthology.orchestra.run.smithi156.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-30T23:11:41.227 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-30T23:11:41.227 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-30T23:11:41.747 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-11-30T23:11:41.848 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-30T23:11:41.999 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-30T23:11:42.150 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-30T23:11:42.446 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-30T23:11:46.156 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-11-30T23:11:46.253 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-11-30T23:11:47.145 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-30T23:11:47.148 DEBUG:teuthology.parallel:result is None 2023-11-30T23:11:49.781 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-11-30T23:11:49.881 INFO:teuthology.orchestra.run.smithi156.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-11-30T23:11:50.707 INFO:teuthology.orchestra.run.smithi156.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-30T23:11:50.710 DEBUG:teuthology.parallel:result is None 2023-11-30T23:11:50.711 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a6f82997ac57b70a895455dfed6256360a1e4c32 2023-11-30T23:11:50.854 DEBUG:teuthology.orchestra.run.smithi073:> dpkg-query -W -f '${Version}' ceph 2023-11-30T23:11:50.879 INFO:teuthology.orchestra.run.smithi073.stdout:18.2.0-1249-ga6f82997-1focal 2023-11-30T23:11:50.879 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1249-ga6f82997-1focal 2023-11-30T23:11:50.880 INFO:teuthology.task.install:The correct ceph version 18.2.0-1249-ga6f82997-1focal is installed. 2023-11-30T23:11:50.880 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a6f82997ac57b70a895455dfed6256360a1e4c32 2023-11-30T23:11:51.019 DEBUG:teuthology.orchestra.run.smithi156:> dpkg-query -W -f '${Version}' ceph 2023-11-30T23:11:51.042 INFO:teuthology.orchestra.run.smithi156.stdout:18.2.0-1249-ga6f82997-1focal 2023-11-30T23:11:51.043 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1249-ga6f82997-1focal 2023-11-30T23:11:51.043 INFO:teuthology.task.install:The correct ceph version 18.2.0-1249-ga6f82997-1focal is installed. 2023-11-30T23:11:51.043 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-30T23:11:51.043 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:11:51.043 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-30T23:11:51.060 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:11:51.061 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-30T23:11:51.075 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-30T23:11:51.076 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:11:51.076 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2023-11-30T23:11:51.089 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-30T23:11:51.099 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:11:51.100 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/daemon-helper 2023-11-30T23:11:51.131 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-30T23:11:51.144 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-30T23:11:51.144 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:11:51.145 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-30T23:11:51.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-30T23:11:51.173 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:11:51.173 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-30T23:11:51.187 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-30T23:11:51.197 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-30T23:11:51.198 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:11:51.198 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2023-11-30T23:11:51.213 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-30T23:11:51.275 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:11:51.275 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/stdin-killer 2023-11-30T23:11:51.289 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-30T23:11:51.348 INFO:teuthology.run_tasks:Running task ceph... 2023-11-30T23:11:51.414 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-30T23:11:51.414 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2023-11-30T23:11:51.416 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 777 /var/log/ceph 2023-11-30T23:11:51.432 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-30T23:11:51.432 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-30T23:11:51.435 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-30T23:11:51.444 INFO:tasks.ceph:Creating extra log directories... 2023-11-30T23:11:51.444 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-30T23:11:51.487 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-30T23:11:51.508 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-30T23:11:51.509 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-30T23:11:51.509 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-30T23:11:51.509 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:11:51.509 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-30T23:11:51.514 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-30T23:11:51.551 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:11:51.551 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-30T23:11:51.560 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-30T23:11:51.604 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-30T23:11:51.604 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-30T23:11:51.604 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473010', 'branch': 'reef-release', 'description': 'fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_20.04} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7473010', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'reef-release'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef-release', 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 55, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 8832, 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'reef-release', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi156.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32', 'cluster': 'ceph'}}, {'check-counter': {'counters': {'mds': ['mds.dir_split']}}}, {'workunit': {'clients': {'client.0': ['libcephfs/test.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f2de108beb0a6dde7f3e6c96039071828a1f6269', 'timestamp': '2023-11-30_22:47:08', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-30T23:11:51.605 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-30T23:11:51.608 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-30T23:11:51.647 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2023-11-30T23:11:51.655 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/run/ceph 2023-11-30T23:11:51.670 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:11:51.670 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2023-11-30T23:11:51.675 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-30T23:11:51.675 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2023-11-30T23:11:51.682 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-30T23:11:51.682 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-30T23:11:51.682 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 359 Links: 1 2023-11-30T23:11:51.682 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-30T23:11:51.682 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-11-30 23:06:47.554881935 +0000 2023-11-30T23:11:51.682 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-11-30 23:06:47.234889311 +0000 2023-11-30T23:11:51.682 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-11-30 23:06:47.234889311 +0000 2023-11-30T23:11:51.683 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-11-30T23:11:51.683 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-30T23:11:51.697 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-11-30T23:11:51.697 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-11-30T23:11:51.697 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000350008 s, 1.5 MB/s 2023-11-30T23:11:51.698 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-30T23:11:51.750 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2023-11-30T23:11:51.757 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-30T23:11:51.757 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-30T23:11:51.757 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 367 Links: 1 2023-11-30T23:11:51.757 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-30T23:11:51.757 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-11-30 23:06:48.070870041 +0000 2023-11-30T23:11:51.757 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-11-30 23:06:47.766877049 +0000 2023-11-30T23:11:51.758 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-11-30 23:06:47.766877049 +0000 2023-11-30T23:11:51.758 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-11-30T23:11:51.758 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-30T23:11:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-11-30T23:11:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-11-30T23:11:51.772 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000376242 s, 1.4 MB/s 2023-11-30T23:11:51.773 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-30T23:11:51.827 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2023-11-30T23:11:51.834 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-30T23:11:51.834 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-30T23:11:51.835 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 371 Links: 1 2023-11-30T23:11:51.835 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-30T23:11:51.835 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-11-30 23:06:48.618857409 +0000 2023-11-30T23:11:51.835 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-11-30 23:06:48.278865247 +0000 2023-11-30T23:11:51.835 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-11-30 23:06:48.278865247 +0000 2023-11-30T23:11:51.835 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-11-30T23:11:51.835 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-30T23:11:51.848 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-11-30T23:11:51.848 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-11-30T23:11:51.848 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000338472 s, 1.5 MB/s 2023-11-30T23:11:51.849 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-30T23:11:51.857 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2023-11-30T23:11:51.904 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-30T23:11:51.904 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-30T23:11:51.904 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 377 Links: 1 2023-11-30T23:11:51.905 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-30T23:11:51.905 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-11-30 23:06:49.162844870 +0000 2023-11-30T23:11:51.905 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-11-30 23:06:48.838852338 +0000 2023-11-30T23:11:51.905 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-11-30 23:06:48.838852338 +0000 2023-11-30T23:11:51.905 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-11-30T23:11:51.905 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-30T23:11:51.916 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-11-30T23:11:51.916 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-11-30T23:11:51.916 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000413604 s, 1.2 MB/s 2023-11-30T23:11:51.917 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-30T23:11:51.924 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-30T23:11:51.924 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:11:51.924 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/scratch_devs of=/dev/stdout 2023-11-30T23:11:51.931 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-30T23:11:51.932 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_1 2023-11-30T23:11:51.939 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-30T23:11:51.939 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-30T23:11:51.939 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 361 Links: 1 2023-11-30T23:11:51.939 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-30T23:11:51.939 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-11-30 23:06:47.541617401 +0000 2023-11-30T23:11:51.939 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-11-30 23:06:47.213624960 +0000 2023-11-30T23:11:51.940 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-11-30 23:06:47.213624960 +0000 2023-11-30T23:11:51.940 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-11-30T23:11:51.940 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-30T23:11:51.953 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-11-30T23:11:51.953 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-11-30T23:11:51.954 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000302514 s, 1.7 MB/s 2023-11-30T23:11:51.954 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-30T23:11:52.005 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_2 2023-11-30T23:11:52.012 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-30T23:11:52.012 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-30T23:11:52.012 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 364 Links: 1 2023-11-30T23:11:52.012 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-30T23:11:52.013 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-11-30 23:06:47.805611316 +0000 2023-11-30T23:11:52.013 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-11-30 23:06:47.801611407 +0000 2023-11-30T23:11:52.013 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-11-30 23:06:47.801611407 +0000 2023-11-30T23:11:52.013 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-11-30T23:11:52.013 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-30T23:11:52.025 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-11-30T23:11:52.025 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-11-30T23:11:52.025 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000302334 s, 1.7 MB/s 2023-11-30T23:11:52.027 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-30T23:11:52.035 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_3 2023-11-30T23:11:52.041 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-30T23:11:52.041 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-30T23:11:52.041 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 371 Links: 1 2023-11-30T23:11:52.041 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-30T23:11:52.041 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-11-30 23:06:48.725590109 +0000 2023-11-30T23:11:52.042 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-11-30 23:06:48.349598776 +0000 2023-11-30T23:11:52.042 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-11-30 23:06:48.349598776 +0000 2023-11-30T23:11:52.042 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-11-30T23:11:52.042 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-30T23:11:52.102 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-11-30T23:11:52.102 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-11-30T23:11:52.102 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000291779 s, 1.8 MB/s 2023-11-30T23:11:52.102 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-30T23:11:52.109 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_4 2023-11-30T23:11:52.116 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-30T23:11:52.116 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-30T23:11:52.116 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 379 Links: 1 2023-11-30T23:11:52.116 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-30T23:11:52.116 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-11-30 23:06:49.281577293 +0000 2023-11-30T23:11:52.116 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-11-30 23:06:48.953584854 +0000 2023-11-30T23:11:52.116 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-11-30 23:06:48.953584854 +0000 2023-11-30T23:11:52.116 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-11-30T23:11:52.117 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-30T23:11:52.128 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-11-30T23:11:52.128 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-11-30T23:11:52.128 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000291323 s, 1.8 MB/s 2023-11-30T23:11:52.129 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-30T23:11:52.180 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-30T23:11:52.181 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-30T23:11:52.181 INFO:tasks.ceph:Generating config... 2023-11-30T23:11:52.182 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-30T23:11:52.182 INFO:tasks.ceph:[client] debug client = 20 2023-11-30T23:11:52.182 INFO:tasks.ceph:[client] debug ms = 1 2023-11-30T23:11:52.182 INFO:tasks.ceph:[client] pid file = 2023-11-30T23:11:52.182 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-30T23:11:52.182 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-30T23:11:52.182 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-30T23:11:52.182 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-30T23:11:52.183 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-30T23:11:52.183 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2023-11-30T23:11:52.183 INFO:tasks.ceph:[mds] mds bal merge size = 5 2023-11-30T23:11:52.183 INFO:tasks.ceph:[mds] mds bal split bits = 3 2023-11-30T23:11:52.183 INFO:tasks.ceph:[mds] mds bal split size = 100 2023-11-30T23:11:52.183 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-30T23:11:52.183 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-30T23:11:52.183 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-30T23:11:52.183 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-30T23:11:52.183 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-30T23:11:52.183 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-30T23:11:52.183 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-30T23:11:52.183 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-30T23:11:52.183 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-30T23:11:52.183 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-30T23:11:52.184 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-30T23:11:52.184 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-30T23:11:52.184 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-30T23:11:52.184 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-30T23:11:52.184 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-30T23:11:52.184 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-30T23:11:52.184 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-30T23:11:52.184 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-30T23:11:52.184 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-30T23:11:52.184 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-30T23:11:52.184 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-30T23:11:52.184 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-30T23:11:52.184 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-30T23:11:52.184 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-30T23:11:52.184 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-30T23:11:52.184 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-30T23:11:52.185 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-30T23:11:52.185 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-30T23:11:52.185 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-30T23:11:52.185 INFO:tasks.ceph:Setting up mon.a... 2023-11-30T23:11:52.185 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-30T23:11:52.224 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2023-11-30T23:11:52.239 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-30T23:11:52.285 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-30T23:11:52.296 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.73'), ('mon.b', '172.21.15.156'), ('mon.c', '[v2:172.21.15.156:3301,v1:172.21.15.156:6790]')] 2023-11-30T23:11:52.297 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.73,172.21.15.156,[v2:172.21.15.156:3301,v1:172.21.15.156:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-30T23:11:52.297 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:11:52.298 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-30T23:11:52.304 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.73 --add b 172.21.15.156 --addv c '[v2:172.21.15.156:3301,v1:172.21.15.156:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-30T23:11:52.392 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-30T23:11:52.392 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid a677cb6a-4a54-4567-a30d-f0fa4bc22b17 2023-11-30T23:11:52.392 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = pacific 2023-11-30T23:11:52.392 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2023-11-30T23:11:52.393 INFO:teuthology.orchestra.run.smithi073.stdout:fsid a677cb6a-4a54-4567-a30d-f0fa4bc22b17 2023-11-30T23:11:52.393 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2023-11-30T23:11:52.392774+0000 2023-11-30T23:11:52.393 INFO:teuthology.orchestra.run.smithi073.stdout:created 2023-11-30T23:11:52.392774+0000 2023-11-30T23:11:52.393 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 16 (pacific) 2023-11-30T23:11:52.393 INFO:teuthology.orchestra.run.smithi073.stdout:election_strategy: 1 2023-11-30T23:11:52.393 INFO:teuthology.orchestra.run.smithi073.stdout:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2023-11-30T23:11:52.393 INFO:teuthology.orchestra.run.smithi073.stdout:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-30T23:11:52.393 INFO:teuthology.orchestra.run.smithi073.stdout:2: [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] mon.c 2023-11-30T23:11:52.393 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-30T23:11:52.395 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-30T23:11:52.402 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a677cb6a-4a54-4567-a30d-f0fa4bc22b17... 2023-11-30T23:11:52.403 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-30T23:11:52.405 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-30T23:11:52.438 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-11-30T23:11:52.438 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-11-30T23:11:52.438 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-30T23:11:52.438 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-11-30T23:11:52.438 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.438 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-11-30T23:11:52.439 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.439 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-11-30T23:11:52.439 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.439 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-11-30T23:11:52.439 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-11-30T23:11:52.439 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.439 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-11-30T23:11:52.439 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-11-30T23:11:52.439 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.439 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-30T23:11:52.439 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-11-30T23:11:52.439 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.439 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-11-30T23:11:52.439 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-30T23:11:52.439 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.440 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-11-30T23:11:52.440 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.440 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-11-30T23:11:52.440 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-11-30T23:11:52.440 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-11-30T23:11:52.440 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-11-30T23:11:52.440 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-11-30T23:11:52.440 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-11-30T23:11:52.440 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-11-30T23:11:52.441 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-30T23:11:52.441 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-30T23:11:52.441 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-11-30T23:11:52.441 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.441 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-30T23:11:52.441 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.441 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-11-30T23:11:52.441 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.441 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-11-30T23:11:52.441 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.441 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-11-30T23:11:52.441 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-11-30T23:11:52.441 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-11-30T23:11:52.441 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.73,172.21.15.156,[v2:172.21.15.156:3301,v1:172.21.15.156:6790]" 2023-11-30T23:11:52.441 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = a677cb6a-4a54-4567-a30d-f0fa4bc22b17 2023-11-30T23:11:52.442 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.442 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-11-30T23:11:52.442 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-11-30T23:11:52.442 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.442 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-11-30T23:11:52.442 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-11-30T23:11:52.442 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-11-30T23:11:52.442 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.442 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-11-30T23:11:52.442 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-11-30T23:11:52.442 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.442 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-11-30T23:11:52.442 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-11-30T23:11:52.442 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-11-30T23:11:52.443 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.443 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-11-30T23:11:52.443 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-11-30T23:11:52.443 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.443 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-11-30T23:11:52.443 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.443 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-11-30T23:11:52.443 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.443 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-11-30T23:11:52.443 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.443 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-11-30T23:11:52.443 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-11-30T23:11:52.443 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.443 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-11-30T23:11:52.443 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-11-30T23:11:52.444 INFO:teuthology.orchestra.run.smithi073.stdout: bdev async discard = True 2023-11-30T23:11:52.444 INFO:teuthology.orchestra.run.smithi073.stdout: bdev enable discard = True 2023-11-30T23:11:52.444 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore allocator = bitmap 2023-11-30T23:11:52.444 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-11-30T23:11:52.444 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-11-30T23:11:52.444 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2023-11-30T23:11:52.444 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2023-11-30T23:11:52.444 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-11-30T23:11:52.444 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-11-30T23:11:52.444 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2023-11-30T23:11:52.445 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-11-30T23:11:52.445 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-11-30T23:11:52.445 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-11-30T23:11:52.445 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-11-30T23:11:52.445 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-11-30T23:11:52.445 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-11-30T23:11:52.445 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.445 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-11-30T23:11:52.445 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-11-30T23:11:52.445 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-11-30T23:11:52.445 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-11-30T23:11:52.445 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-11-30T23:11:52.445 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-11-30T23:11:52.445 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-11-30T23:11:52.445 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-11-30T23:11:52.446 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.446 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-11-30T23:11:52.446 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-11-30T23:11:52.446 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-11-30T23:11:52.446 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-11-30T23:11:52.446 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-11-30T23:11:52.446 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-11-30T23:11:52.446 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-11-30T23:11:52.446 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-11-30T23:11:52.446 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-11-30T23:11:52.446 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-11-30T23:11:52.446 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-11-30T23:11:52.446 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.446 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-30T23:11:52.447 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-11-30T23:11:52.447 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-11-30T23:11:52.447 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.447 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-11-30T23:11:52.447 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-30T23:11:52.447 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-30T23:11:52.447 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.447 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-11-30T23:11:52.447 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-11-30T23:11:52.447 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.447 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-11-30T23:11:52.447 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-11-30T23:11:52.447 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:11:52.447 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-11-30T23:11:52.447 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-11-30T23:11:52.448 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-11-30T23:11:52.448 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-11-30T23:11:52.448 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-30T23:11:52.448 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-30T23:11:52.448 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-11-30T23:11:52.448 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-11-30T23:11:52.448 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-11-30T23:11:52.448 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2023-11-30T23:11:52.448 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-11-30T23:11:52.448 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-11-30T23:11:52.448 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-11-30T23:11:52.448 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-11-30T23:11:52.448 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-11-30T23:11:52.448 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-11-30T23:11:52.448 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-11-30T23:11:52.449 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-11-30T23:11:52.449 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-11-30T23:11:52.449 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-11-30T23:11:52.449 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-11-30T23:11:52.449 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal fragment size max = 10000 2023-11-30T23:11:52.449 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal merge size = 5 2023-11-30T23:11:52.449 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal split bits = 3 2023-11-30T23:11:52.449 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal split size = 100 2023-11-30T23:11:52.449 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-11-30T23:11:52.449 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2023-11-30T23:11:52.449 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-11-30T23:11:52.449 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2023-11-30T23:11:52.449 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-11-30T23:11:52.450 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-11-30T23:11:52.450 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-11-30T23:11:52.450 INFO:teuthology.orchestra.run.smithi156.stdout:[global] 2023-11-30T23:11:52.451 INFO:teuthology.orchestra.run.smithi156.stdout: chdir = "" 2023-11-30T23:11:52.451 INFO:teuthology.orchestra.run.smithi156.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-30T23:11:52.451 INFO:teuthology.orchestra.run.smithi156.stdout: auth supported = cephx 2023-11-30T23:11:52.451 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.451 INFO:teuthology.orchestra.run.smithi156.stdout: filestore xattr use omap = true 2023-11-30T23:11:52.451 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.451 INFO:teuthology.orchestra.run.smithi156.stdout: mon clock drift allowed = 1.000 2023-11-30T23:11:52.451 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.451 INFO:teuthology.orchestra.run.smithi156.stdout: osd crush chooseleaf type = 0 2023-11-30T23:11:52.451 INFO:teuthology.orchestra.run.smithi156.stdout: auth debug = true 2023-11-30T23:11:52.452 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.452 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on old message = true 2023-11-30T23:11:52.452 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on bug = true 2023-11-30T23:11:52.452 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.452 INFO:teuthology.orchestra.run.smithi156.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-30T23:11:52.452 INFO:teuthology.orchestra.run.smithi156.stdout: mon pg warn max object skew = 0 2023-11-30T23:11:52.452 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.452 INFO:teuthology.orchestra.run.smithi156.stdout: # disable pg_autoscaler by default for new pools 2023-11-30T23:11:52.452 INFO:teuthology.orchestra.run.smithi156.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-30T23:11:52.452 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.452 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default size = 2 2023-11-30T23:11:52.452 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.452 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow primary affinity = true 2023-11-30T23:11:52.452 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow pg remap = true 2023-11-30T23:11:52.452 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on legacy crush tunables = false 2023-11-30T23:11:52.453 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on crush straw calc version zero = false 2023-11-30T23:11:52.453 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on no sortbitwise = false 2023-11-30T23:11:52.453 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on osd down out interval zero = false 2023-11-30T23:11:52.453 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on too few osds = false 2023-11-30T23:11:52.453 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-30T23:11:52.453 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-30T23:11:52.453 INFO:teuthology.orchestra.run.smithi156.stdout: mon_allow_pool_size_one = true 2023-11-30T23:11:52.453 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.453 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-30T23:11:52.453 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.453 INFO:teuthology.orchestra.run.smithi156.stdout: osd default data pool replay window = 5 2023-11-30T23:11:52.453 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.453 INFO:teuthology.orchestra.run.smithi156.stdout: mon allow pool delete = true 2023-11-30T23:11:52.453 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.453 INFO:teuthology.orchestra.run.smithi156.stdout: mon cluster log file level = debug 2023-11-30T23:11:52.454 INFO:teuthology.orchestra.run.smithi156.stdout: debug asserts on shutdown = true 2023-11-30T23:11:52.454 INFO:teuthology.orchestra.run.smithi156.stdout: mon health detail to clog = false 2023-11-30T23:11:52.454 INFO:teuthology.orchestra.run.smithi156.stdout: mon host = "172.21.15.73,172.21.15.156,[v2:172.21.15.156:3301,v1:172.21.15.156:6790]" 2023-11-30T23:11:52.454 INFO:teuthology.orchestra.run.smithi156.stdout: fsid = a677cb6a-4a54-4567-a30d-f0fa4bc22b17 2023-11-30T23:11:52.454 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.454 INFO:teuthology.orchestra.run.smithi156.stdout:[osd] 2023-11-30T23:11:52.454 INFO:teuthology.orchestra.run.smithi156.stdout: osd journal size = 100 2023-11-30T23:11:52.454 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.454 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub load threshold = 5.0 2023-11-30T23:11:52.454 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub max interval = 600 2023-11-30T23:11:52.454 INFO:teuthology.orchestra.run.smithi156.stdout: osd mclock profile = high_recovery_ops 2023-11-30T23:11:52.454 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.454 INFO:teuthology.orchestra.run.smithi156.stdout: osd recover clone overlap = true 2023-11-30T23:11:52.454 INFO:teuthology.orchestra.run.smithi156.stdout: osd recovery max chunk = 1048576 2023-11-30T23:11:52.455 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.455 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug shutdown = true 2023-11-30T23:11:52.455 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug op order = true 2023-11-30T23:11:52.455 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug verify stray on activate = true 2023-11-30T23:11:52.455 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.455 INFO:teuthology.orchestra.run.smithi156.stdout: osd open classes on start = true 2023-11-30T23:11:52.455 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug pg log writeout = true 2023-11-30T23:11:52.455 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.455 INFO:teuthology.orchestra.run.smithi156.stdout: osd deep scrub update digest min age = 30 2023-11-30T23:11:52.455 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.455 INFO:teuthology.orchestra.run.smithi156.stdout: osd map max advance = 10 2023-11-30T23:11:52.455 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.455 INFO:teuthology.orchestra.run.smithi156.stdout: journal zero on create = true 2023-11-30T23:11:52.455 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.455 INFO:teuthology.orchestra.run.smithi156.stdout: filestore ondisk finisher threads = 3 2023-11-30T23:11:52.456 INFO:teuthology.orchestra.run.smithi156.stdout: filestore apply finisher threads = 3 2023-11-30T23:11:52.456 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.456 INFO:teuthology.orchestra.run.smithi156.stdout: bdev debug aio = true 2023-11-30T23:11:52.456 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug misdirected ops = true 2023-11-30T23:11:52.456 INFO:teuthology.orchestra.run.smithi156.stdout: bdev async discard = True 2023-11-30T23:11:52.456 INFO:teuthology.orchestra.run.smithi156.stdout: bdev enable discard = True 2023-11-30T23:11:52.456 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore allocator = bitmap 2023-11-30T23:11:52.456 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore block size = 96636764160 2023-11-30T23:11:52.456 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore fsck on mount = True 2023-11-30T23:11:52.456 INFO:teuthology.orchestra.run.smithi156.stdout: debug bluefs = 1/20 2023-11-30T23:11:52.456 INFO:teuthology.orchestra.run.smithi156.stdout: debug bluestore = 1/20 2023-11-30T23:11:52.456 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-11-30T23:11:52.456 INFO:teuthology.orchestra.run.smithi156.stdout: debug osd = 20 2023-11-30T23:11:52.456 INFO:teuthology.orchestra.run.smithi156.stdout: debug rocksdb = 4/10 2023-11-30T23:11:52.456 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd backfillfull_ratio = 0.85 2023-11-30T23:11:52.457 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd full ratio = 0.9 2023-11-30T23:11:52.457 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd nearfull ratio = 0.8 2023-11-30T23:11:52.457 INFO:teuthology.orchestra.run.smithi156.stdout: osd failsafe full ratio = 0.95 2023-11-30T23:11:52.457 INFO:teuthology.orchestra.run.smithi156.stdout: osd objectstore = bluestore 2023-11-30T23:11:52.457 INFO:teuthology.orchestra.run.smithi156.stdout: osd op complaint time = 180 2023-11-30T23:11:52.457 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.457 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr] 2023-11-30T23:11:52.457 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-11-30T23:11:52.457 INFO:teuthology.orchestra.run.smithi156.stdout: debug mgr = 20 2023-11-30T23:11:52.457 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2023-11-30T23:11:52.457 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2023-11-30T23:11:52.457 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2023-11-30T23:11:52.457 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2023-11-30T23:11:52.457 INFO:teuthology.orchestra.run.smithi156.stdout: mgr/telemetry/nag = false 2023-11-30T23:11:52.458 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.458 INFO:teuthology.orchestra.run.smithi156.stdout:[mon] 2023-11-30T23:11:52.458 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-11-30T23:11:52.458 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2023-11-30T23:11:52.458 INFO:teuthology.orchestra.run.smithi156.stdout: debug paxos = 20 2023-11-30T23:11:52.458 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2023-11-30T23:11:52.458 INFO:teuthology.orchestra.run.smithi156.stdout: mon data avail warn = 5 2023-11-30T23:11:52.458 INFO:teuthology.orchestra.run.smithi156.stdout: mon mgr mkfs grace = 240 2023-11-30T23:11:52.458 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2023-11-30T23:11:52.458 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd reporter subtree level = osd 2023-11-30T23:11:52.458 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd prime pg temp = true 2023-11-30T23:11:52.458 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2023-11-30T23:11:52.458 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.458 INFO:teuthology.orchestra.run.smithi156.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-30T23:11:52.459 INFO:teuthology.orchestra.run.smithi156.stdout: auth mon ticket ttl = 660 # 11m 2023-11-30T23:11:52.459 INFO:teuthology.orchestra.run.smithi156.stdout: auth service ticket ttl = 240 # 4m 2023-11-30T23:11:52.459 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.459 INFO:teuthology.orchestra.run.smithi156.stdout: # don't complain about insecure global_id in the test suite 2023-11-30T23:11:52.459 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-30T23:11:52.459 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-30T23:11:52.459 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.459 INFO:teuthology.orchestra.run.smithi156.stdout: # 1m isn't quite enough 2023-11-30T23:11:52.459 INFO:teuthology.orchestra.run.smithi156.stdout: mon_down_mkfs_grace = 2m 2023-11-30T23:11:52.459 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.459 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_filestore_osds = false 2023-11-30T23:11:52.459 INFO:teuthology.orchestra.run.smithi156.stdout: mon op complaint time = 120 2023-11-30T23:11:52.459 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-30T23:11:52.459 INFO:teuthology.orchestra.run.smithi156.stdout:[client] 2023-11-30T23:11:52.459 INFO:teuthology.orchestra.run.smithi156.stdout: rgw cache enabled = true 2023-11-30T23:11:52.460 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable ops log = true 2023-11-30T23:11:52.460 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable usage log = true 2023-11-30T23:11:52.460 INFO:teuthology.orchestra.run.smithi156.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-30T23:11:52.460 INFO:teuthology.orchestra.run.smithi156.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-30T23:11:52.460 INFO:teuthology.orchestra.run.smithi156.stdout: client mount timeout = 600 2023-11-30T23:11:52.460 INFO:teuthology.orchestra.run.smithi156.stdout: debug client = 20 2023-11-30T23:11:52.460 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-11-30T23:11:52.460 INFO:teuthology.orchestra.run.smithi156.stdout: pid file = "" 2023-11-30T23:11:52.460 INFO:teuthology.orchestra.run.smithi156.stdout: rados mon op timeout = 900 2023-11-30T23:11:52.460 INFO:teuthology.orchestra.run.smithi156.stdout: rados osd op timeout = 900 2023-11-30T23:11:52.460 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.a] 2023-11-30T23:11:52.460 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.b] 2023-11-30T23:11:52.460 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.c] 2023-11-30T23:11:52.460 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.a] 2023-11-30T23:11:52.460 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.b] 2023-11-30T23:11:52.460 INFO:teuthology.orchestra.run.smithi156.stdout:[mds] 2023-11-30T23:11:52.461 INFO:teuthology.orchestra.run.smithi156.stdout: debug mds = 20 2023-11-30T23:11:52.461 INFO:teuthology.orchestra.run.smithi156.stdout: debug mds balancer = 20 2023-11-30T23:11:52.461 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-11-30T23:11:52.461 INFO:teuthology.orchestra.run.smithi156.stdout: mds bal fragment size max = 10000 2023-11-30T23:11:52.461 INFO:teuthology.orchestra.run.smithi156.stdout: mds bal merge size = 5 2023-11-30T23:11:52.461 INFO:teuthology.orchestra.run.smithi156.stdout: mds bal split bits = 3 2023-11-30T23:11:52.461 INFO:teuthology.orchestra.run.smithi156.stdout: mds bal split size = 100 2023-11-30T23:11:52.461 INFO:teuthology.orchestra.run.smithi156.stdout: mds debug frag = True 2023-11-30T23:11:52.462 INFO:teuthology.orchestra.run.smithi156.stdout: mds debug scatterstat = True 2023-11-30T23:11:52.462 INFO:teuthology.orchestra.run.smithi156.stdout: mds op complaint time = 180 2023-11-30T23:11:52.462 INFO:teuthology.orchestra.run.smithi156.stdout: mds verify scatter = True 2023-11-30T23:11:52.462 INFO:teuthology.orchestra.run.smithi156.stdout: osd op complaint time = 180 2023-11-30T23:11:52.462 INFO:teuthology.orchestra.run.smithi156.stdout: rados mon op timeout = 900 2023-11-30T23:11:52.462 INFO:teuthology.orchestra.run.smithi156.stdout: rados osd op timeout = 900 2023-11-30T23:11:52.463 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-30T23:11:52.463 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-30T23:11:52.559 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-30T23:11:52.559 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:11:52.559 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-30T23:11:52.566 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:11:52.566 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-30T23:11:52.573 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2023-11-30T23:11:52.573 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:11:52.573 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-30T23:11:52.573 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-30T23:11:52.598 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:11:52.598 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-30T23:11:52.604 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi156.front.sepia.ceph.com 2023-11-30T23:11:52.604 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:11:52.604 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-30T23:11:52.604 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-30T23:11:52.629 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:11:52.630 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-30T23:11:52.678 INFO:tasks.ceph:Setting up mon nodes... 2023-11-30T23:11:52.679 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-30T23:11:52.679 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-30T23:11:52.729 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-30T23:11:52.732 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-30T23:11:52.782 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-30T23:11:52.803 INFO:tasks.ceph:Setting up mds nodes... 2023-11-30T23:11:52.803 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-30T23:11:52.853 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-30T23:11:52.856 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-30T23:11:52.872 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-30T23:11:52.922 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-30T23:11:52.929 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-30T23:11:52.948 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-30T23:11:52.948 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-30T23:11:52.991 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-30T23:11:53.003 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-30T23:11:53.003 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-30T23:11:53.004 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-30T23:11:53.019 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-30T23:11:53.019 INFO:tasks.ceph:role: osd.0 2023-11-30T23:11:53.019 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2023-11-30T23:11:53.019 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-30T23:11:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-30T23:11:53.555 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-30T23:11:53.555 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-30T23:11:53.555 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 2023-11-30T23:11:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-30T23:11:53.555 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-11-30T23:11:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-30T23:11:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-30T23:11:53.555 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-30T23:11:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-30T23:11:53.558 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-11-30T23:11:53.558 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-30T23:11:53.642 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-30T23:11:53.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T23:11:53.655 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2023-11-30T23:11:53.655 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-30T23:11:53.711 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-30T23:11:53.711 INFO:tasks.ceph:role: osd.1 2023-11-30T23:11:53.712 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2023-11-30T23:11:53.712 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-30T23:11:54.240 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-30T23:11:54.240 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-30T23:11:54.240 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-30T23:11:54.240 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 2023-11-30T23:11:54.240 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-30T23:11:54.240 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-11-30T23:11:54.240 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-30T23:11:54.240 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-30T23:11:54.240 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-30T23:11:54.240 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-30T23:11:54.241 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-11-30T23:11:54.242 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-30T23:11:54.282 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-30T23:11:54.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T23:11:54.294 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2023-11-30T23:11:54.294 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-30T23:11:54.353 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-30T23:11:54.353 INFO:tasks.ceph:role: osd.2 2023-11-30T23:11:54.353 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2023-11-30T23:11:54.353 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-30T23:11:54.822 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-30T23:11:54.823 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-30T23:11:54.823 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-30T23:11:54.823 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 2023-11-30T23:11:54.823 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-30T23:11:54.823 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-11-30T23:11:54.823 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-30T23:11:54.823 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-30T23:11:54.823 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-30T23:11:54.823 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-30T23:11:54.824 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-11-30T23:11:54.824 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-30T23:11:54.889 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-30T23:11:54.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T23:11:54.901 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2023-11-30T23:11:54.901 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-30T23:11:54.959 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-30T23:11:54.960 INFO:tasks.ceph:role: osd.3 2023-11-30T23:11:54.960 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com 2023-11-30T23:11:54.960 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-30T23:11:55.474 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-30T23:11:55.475 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-30T23:11:55.475 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-30T23:11:55.475 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 2023-11-30T23:11:55.475 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-30T23:11:55.475 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-11-30T23:11:55.475 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-30T23:11:55.475 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-30T23:11:55.475 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-30T23:11:55.475 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-30T23:11:55.476 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-11-30T23:11:55.476 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-30T23:11:55.538 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-30T23:11:55.550 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2023-11-30T23:11:55.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T23:11:55.552 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-30T23:11:55.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:11:55.616+0000 7fdff4f2f700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-30T23:11:55.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:11:55.620+0000 7fdff4f2f700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-30T23:11:55.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:11:55.620+0000 7fdff4f2f700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-30T23:11:55.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:11:55.620+0000 7fdff4f2f700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-30T23:11:55.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:11:55.620+0000 7fdff4f2f700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-30T23:11:55.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:11:55.624+0000 7fdff4f2f700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-30T23:11:58.899 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-30T23:11:58.978 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-30T23:11:59.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:11:59.020+0000 7f56788c3700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-30T23:11:59.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:11:59.024+0000 7f56788c3700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-30T23:11:59.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:11:59.024+0000 7f56788c3700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-30T23:11:59.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:11:59.024+0000 7f56788c3700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-30T23:11:59.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:11:59.024+0000 7f56788c3700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-30T23:11:59.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:11:59.024+0000 7f56788c3700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-30T23:12:02.033 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-30T23:12:02.049 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-30T23:12:02.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:02.136+0000 7fdda697f700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-30T23:12:02.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:02.136+0000 7fdda697f700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-30T23:12:02.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:02.136+0000 7fdda697f700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-30T23:12:02.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:02.136+0000 7fdda697f700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-30T23:12:02.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:02.136+0000 7fdda697f700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-30T23:12:02.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:02.136+0000 7fdda697f700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-30T23:12:05.145 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-30T23:12:05.157 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-30T23:12:05.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:05.196+0000 7f9be0cc3700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-30T23:12:05.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:05.196+0000 7f9be0cc3700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-30T23:12:05.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:05.196+0000 7f9be0cc3700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-30T23:12:05.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:05.196+0000 7f9be0cc3700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-30T23:12:05.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:05.196+0000 7f9be0cc3700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-30T23:12:05.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:05.196+0000 7f9be0cc3700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-30T23:12:08.221 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-30T23:12:08.277 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-30T23:12:08.295 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-30T23:12:08.295 INFO:tasks.ceph:role: osd.4 2023-11-30T23:12:08.295 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-30T23:12:08.295 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-30T23:12:08.379 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-30T23:12:08.379 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-30T23:12:08.379 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-30T23:12:08.379 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 2023-11-30T23:12:08.379 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-30T23:12:08.379 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-11-30T23:12:08.379 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-30T23:12:08.379 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-30T23:12:08.379 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-30T23:12:08.380 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-30T23:12:08.380 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-11-30T23:12:08.381 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-30T23:12:08.401 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-30T23:12:08.411 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: /sbin/restorecon: command not found 2023-11-30T23:12:08.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T23:12:08.412 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-30T23:12:08.424 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-30T23:12:08.424 INFO:tasks.ceph:role: osd.5 2023-11-30T23:12:08.424 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-30T23:12:08.424 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-30T23:12:08.465 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-30T23:12:08.465 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-30T23:12:08.465 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-30T23:12:08.465 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 2023-11-30T23:12:08.465 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-30T23:12:08.465 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-11-30T23:12:08.465 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-30T23:12:08.465 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-30T23:12:08.465 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-30T23:12:08.466 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-30T23:12:08.466 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-11-30T23:12:08.467 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-30T23:12:08.486 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-30T23:12:08.539 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: /sbin/restorecon: command not found 2023-11-30T23:12:08.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T23:12:08.540 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-30T23:12:08.557 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-30T23:12:08.557 INFO:tasks.ceph:role: osd.6 2023-11-30T23:12:08.557 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-30T23:12:08.557 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-30T23:12:08.597 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-30T23:12:08.597 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-30T23:12:08.597 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-30T23:12:08.597 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 2023-11-30T23:12:08.597 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-30T23:12:08.597 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-11-30T23:12:08.597 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-30T23:12:08.597 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-30T23:12:08.597 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-30T23:12:08.597 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-30T23:12:08.598 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-11-30T23:12:08.598 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-30T23:12:08.623 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-30T23:12:08.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T23:12:08.632 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: /sbin/restorecon: command not found 2023-11-30T23:12:08.632 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-30T23:12:08.689 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-30T23:12:08.689 INFO:tasks.ceph:role: osd.7 2023-11-30T23:12:08.689 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-30T23:12:08.689 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-30T23:12:08.730 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-30T23:12:08.730 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-30T23:12:08.730 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-30T23:12:08.730 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 2023-11-30T23:12:08.730 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-30T23:12:08.730 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-11-30T23:12:08.731 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-30T23:12:08.731 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-30T23:12:08.731 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-30T23:12:08.731 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-30T23:12:08.733 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-11-30T23:12:08.733 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-30T23:12:08.752 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-30T23:12:08.807 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: /sbin/restorecon: command not found 2023-11-30T23:12:08.808 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T23:12:08.808 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-30T23:12:08.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:08.881+0000 7f3686615700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-30T23:12:08.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:08.881+0000 7f3686615700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-30T23:12:08.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:08.881+0000 7f3686615700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-30T23:12:08.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:08.881+0000 7f3686615700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-30T23:12:08.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:08.881+0000 7f3686615700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-30T23:12:08.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:08.885+0000 7f3686615700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-30T23:12:11.891 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-30T23:12:11.908 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-30T23:12:11.956 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:11.953+0000 7f8cfd72b700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-30T23:12:11.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:11.953+0000 7f8cfd72b700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-30T23:12:11.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:11.953+0000 7f8cfd72b700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-30T23:12:11.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:11.953+0000 7f8cfd72b700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-30T23:12:11.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:11.953+0000 7f8cfd72b700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-30T23:12:11.957 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:11.953+0000 7f8cfd72b700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-30T23:12:14.971 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-30T23:12:14.984 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-30T23:12:15.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:15.069+0000 7f285748c700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-30T23:12:15.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:15.069+0000 7f285748c700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-30T23:12:15.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:15.069+0000 7f285748c700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-30T23:12:15.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:15.069+0000 7f285748c700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-30T23:12:15.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:15.069+0000 7f285748c700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-30T23:12:15.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:15.069+0000 7f285748c700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-30T23:12:18.086 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-30T23:12:18.103 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-30T23:12:18.145 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:18.141+0000 7f7e96ad6700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-30T23:12:18.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:18.141+0000 7f7e96ad6700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-30T23:12:18.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:18.141+0000 7f7e96ad6700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-30T23:12:18.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:18.141+0000 7f7e96ad6700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-30T23:12:18.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:18.141+0000 7f7e96ad6700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-30T23:12:18.146 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:18.141+0000 7f7e96ad6700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-30T23:12:21.150 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-30T23:12:21.207 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-30T23:12:21.208 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:12:21.208 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-30T23:12:21.225 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:12:21.225 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-30T23:12:21.281 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:12:21.281 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-30T23:12:21.290 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:12:21.290 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-30T23:12:21.300 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:12:21.300 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-30T23:12:21.311 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:12:21.311 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-30T23:12:21.325 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:12:21.325 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-30T23:12:21.342 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:12:21.342 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-30T23:12:21.356 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:12:21.356 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-30T23:12:21.419 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:12:21.419 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-30T23:12:21.429 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:12:21.430 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-30T23:12:21.445 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:12:21.445 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-30T23:12:21.502 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:12:21.502 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-30T23:12:21.509 INFO:tasks.ceph:Adding keys to all mons... 2023-11-30T23:12:21.509 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-30T23:12:21.511 DEBUG:teuthology.orchestra.run.smithi156:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-30T23:12:21.523 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.y] 2023-11-30T23:12:21.523 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC4FmllQOd+KxAAh1PiUcrcA3XqO0X66DactQ== 2023-11-30T23:12:21.523 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.a] 2023-11-30T23:12:21.523 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC4Fmllz2rfMhAAnvLHcuZpbw5LYCY9JNwbCA== 2023-11-30T23:12:21.523 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.0] 2023-11-30T23:12:21.523 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC7FmllP7jxJBAA360UXlH/+gROntcFdRmBFA== 2023-11-30T23:12:21.523 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.1] 2023-11-30T23:12:21.524 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC/FmllF4iPARAAVLqeHaF8m/M9/s6gvCFNPA== 2023-11-30T23:12:21.524 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.2] 2023-11-30T23:12:21.524 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDCFmll/O1ECBAAeA+IBYxdyGCBQgtAiEqT5Q== 2023-11-30T23:12:21.524 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.3] 2023-11-30T23:12:21.524 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDFFmllvjLwCxAAC+WYJUonbfe0W8lacC3PnQ== 2023-11-30T23:12:21.524 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.x] 2023-11-30T23:12:21.524 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC4Fmll9haCLhAArg3GXHjB8g0j6nonhjSDtA== 2023-11-30T23:12:21.524 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.b] 2023-11-30T23:12:21.524 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC4FmllabfWNhAA7Ul74mN77oyRRm6U/lGWMA== 2023-11-30T23:12:21.524 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.4] 2023-11-30T23:12:21.524 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDIFmllY83LNBAAgxoo7p5JOP9GLdELjGEe7Q== 2023-11-30T23:12:21.524 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.5] 2023-11-30T23:12:21.524 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDLFmllFvvvOBAAynw8SQLT5hIDfwQvPRihqw== 2023-11-30T23:12:21.524 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.6] 2023-11-30T23:12:21.525 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDPFmllQLtXBBAAjdJPy9nFpIbC6Wxy8Zsm1A== 2023-11-30T23:12:21.525 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.7] 2023-11-30T23:12:21.525 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDSFmllX82WCBAAB47CiM18j7HrPp6l8UMc9Q== 2023-11-30T23:12:21.525 INFO:teuthology.orchestra.run.smithi156.stdout:[client.0] 2023-11-30T23:12:21.525 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQC4FmllxukZOxAAkCQ3T5eMFqiuPkZAwn8BDw== 2023-11-30T23:12:21.526 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2023-11-30T23:12:21.526 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQC4FmllQOd+KxAAh1PiUcrcA3XqO0X66DactQ== 2023-11-30T23:12:21.526 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-11-30T23:12:21.526 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQC4Fmllz2rfMhAAnvLHcuZpbw5LYCY9JNwbCA== 2023-11-30T23:12:21.527 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2023-11-30T23:12:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQC7FmllP7jxJBAA360UXlH/+gROntcFdRmBFA== 2023-11-30T23:12:21.527 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2023-11-30T23:12:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQC/FmllF4iPARAAVLqeHaF8m/M9/s6gvCFNPA== 2023-11-30T23:12:21.527 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2023-11-30T23:12:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDCFmll/O1ECBAAeA+IBYxdyGCBQgtAiEqT5Q== 2023-11-30T23:12:21.527 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2023-11-30T23:12:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDFFmllvjLwCxAAC+WYJUonbfe0W8lacC3PnQ== 2023-11-30T23:12:21.527 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2023-11-30T23:12:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQC4Fmll9haCLhAArg3GXHjB8g0j6nonhjSDtA== 2023-11-30T23:12:21.527 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-11-30T23:12:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQC4FmllabfWNhAA7Ul74mN77oyRRm6U/lGWMA== 2023-11-30T23:12:21.527 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2023-11-30T23:12:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDIFmllY83LNBAAgxoo7p5JOP9GLdELjGEe7Q== 2023-11-30T23:12:21.527 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2023-11-30T23:12:21.528 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDLFmllFvvvOBAAynw8SQLT5hIDfwQvPRihqw== 2023-11-30T23:12:21.528 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.6] 2023-11-30T23:12:21.528 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDPFmllQLtXBBAAjdJPy9nFpIbC6Wxy8Zsm1A== 2023-11-30T23:12:21.528 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.7] 2023-11-30T23:12:21.528 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDSFmllX82WCBAAB47CiM18j7HrPp6l8UMc9Q== 2023-11-30T23:12:21.528 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2023-11-30T23:12:21.528 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQC4FmllxukZOxAAkCQ3T5eMFqiuPkZAwn8BDw== 2023-11-30T23:12:21.528 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-30T23:12:21.575 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-30T23:12:21.606 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:12:21.609 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:12:21.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-30T23:12:21.671 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-30T23:12:21.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T23:12:21.727 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T23:12:21.819 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T23:12:21.821 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T23:12:21.873 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T23:12:21.875 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T23:12:21.924 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T23:12:21.926 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T23:12:21.972 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-30T23:12:21.974 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-30T23:12:22.025 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-30T23:12:22.027 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-30T23:12:22.080 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T23:12:22.083 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T23:12:22.129 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T23:12:22.131 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T23:12:22.179 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T23:12:22.181 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T23:12:22.230 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T23:12:22.271 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-30T23:12:22.353 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-30T23:12:22.356 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-30T23:12:22.414 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-30T23:12:22.415 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-30T23:12:22.429 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-30T23:12:22.547 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-30T23:12:22.563 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-30T23:12:22.581 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-30T23:12:22.714 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-30T23:12:22.731 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-30T23:12:22.744 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-30T23:12:22.858 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-30T23:12:22.871 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-30T23:12:22.873 DEBUG:teuthology.orchestra.run.smithi156:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-30T23:12:22.879 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-30T23:12:22.879 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-30T23:12:22.879 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-30T23:12:22.923 INFO:tasks.ceph.mon.a:Started 2023-11-30T23:12:22.923 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-30T23:12:22.923 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-30T23:12:22.926 INFO:tasks.ceph.mon.b:Started 2023-11-30T23:12:22.927 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-30T23:12:22.927 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-30T23:12:22.929 INFO:tasks.ceph.mon.c:Started 2023-11-30T23:12:22.929 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-30T23:12:22.929 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-30T23:12:22.929 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-30T23:12:22.932 INFO:tasks.ceph.mgr.y:Started 2023-11-30T23:12:22.932 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-30T23:12:22.932 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-30T23:12:22.935 INFO:tasks.ceph.mgr.x:Started 2023-11-30T23:12:22.936 INFO:tasks.ceph:Setting crush tunables to default 2023-11-30T23:12:22.936 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2023-11-30T23:12:23.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656f59e700 1 Processor -- start 2023-11-30T23:12:23.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656f59e700 1 -- start start 2023-11-30T23:12:23.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656f59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f657006f440 0x7f6570146600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:23.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656f59e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f65700b8050 0x7f65700710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:23.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656f59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6570147470 con 0x7f65700715f0 2023-11-30T23:12:23.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656f59e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6570071a80 con 0x7f65700b8050 2023-11-30T23:12:23.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656f59e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657006f820 con 0x7f657006f440 2023-11-30T23:12:23.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656ed9d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f65700715f0 0x7f6570140330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50224/0 (socket says 172.21.15.73:50224) 2023-11-30T23:12:23.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656ed9d700 1 -- 172.21.15.73:0/399748898 learned_addr learned my addr 172.21.15.73:0/399748898 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:23.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656e59c700 1 --2- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f657006f440 0x7f6570146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656dd9b700 1 --2- 172.21.15.73:0/399748898 >> v2:172.21.15.156:3300/0 conn(0x7f65700b8050 0x7f65700710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656e59c700 1 -- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f657006f440 msgr2=0x7f6570146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-30T23:12:23.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656e59c700 1 -- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f657006f440 msgr2=0x7f6570146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-30T23:12:23.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656e59c700 1 --2- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f657006f440 0x7f6570146600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-30T23:12:23.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656dd9b700 1 -- 172.21.15.73:0/399748898 >> v2:172.21.15.156:3300/0 conn(0x7f65700b8050 msgr2=0x7f65700710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-30T23:12:23.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656dd9b700 1 -- 172.21.15.73:0/399748898 >> v2:172.21.15.156:3300/0 conn(0x7f65700b8050 msgr2=0x7f65700710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-30T23:12:23.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656dd9b700 1 --2- 172.21.15.73:0/399748898 >> v2:172.21.15.156:3300/0 conn(0x7f65700b8050 0x7f65700710b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-30T23:12:23.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656e59c700 1 --2- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f657006f440 0x7f6570146600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-30T23:12:23.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.043+0000 7f656dd9b700 1 --2- 172.21.15.73:0/399748898 >> v2:172.21.15.156:3300/0 conn(0x7f65700b8050 0x7f65700710b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-30T23:12:23.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.247+0000 7f656e59c700 1 --2- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f657006f440 0x7f6570146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.247+0000 7f656dd9b700 1 --2- 172.21.15.73:0/399748898 >> v2:172.21.15.156:3300/0 conn(0x7f65700b8050 0x7f65700710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.247+0000 7f656dd9b700 1 -- 172.21.15.73:0/399748898 >> v2:172.21.15.156:3300/0 conn(0x7f65700b8050 msgr2=0x7f65700710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-30T23:12:23.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.247+0000 7f656dd9b700 1 -- 172.21.15.73:0/399748898 >> v2:172.21.15.156:3300/0 conn(0x7f65700b8050 msgr2=0x7f65700710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-30T23:12:23.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.247+0000 7f656e59c700 1 -- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f657006f440 msgr2=0x7f6570146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-30T23:12:23.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.247+0000 7f656e59c700 1 -- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f657006f440 msgr2=0x7f6570146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-30T23:12:23.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.247+0000 7f656e59c700 1 --2- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f657006f440 0x7f6570146600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-30T23:12:23.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.247+0000 7f656dd9b700 1 --2- 172.21.15.73:0/399748898 >> v2:172.21.15.156:3300/0 conn(0x7f65700b8050 0x7f65700710b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-30T23:12:23.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.247+0000 7f656e59c700 1 --2- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f657006f440 0x7f6570146600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-30T23:12:23.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.247+0000 7f656dd9b700 1 --2- 172.21.15.73:0/399748898 >> v2:172.21.15.156:3300/0 conn(0x7f65700b8050 0x7f65700710b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-30T23:12:23.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656d59a700 1 -- 172.21.15.73:0/399748898 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282668093 0 0) 0x7f6570147470 con 0x7f65700715f0 2023-11-30T23:12:23.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656d59a700 1 -- 172.21.15.73:0/399748898 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65580035d0 con 0x7f65700715f0 2023-11-30T23:12:23.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656d59a700 1 -- 172.21.15.73:0/399748898 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2425976722 0 0) 0x7f65580035d0 con 0x7f65700715f0 2023-11-30T23:12:23.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656d59a700 1 -- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f657006f440 msgr2=0x7f6570146600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-30T23:12:23.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656d59a700 1 --2- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f657006f440 0x7f6570146600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656d59a700 1 -- 172.21.15.73:0/399748898 >> v2:172.21.15.156:3300/0 conn(0x7f65700b8050 msgr2=0x7f65700710b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-30T23:12:23.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656d59a700 1 --2- 172.21.15.73:0/399748898 >> v2:172.21.15.156:3300/0 conn(0x7f65700b8050 0x7f65700710b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656d59a700 1 -- 172.21.15.73:0/399748898 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6570146e20 con 0x7f65700715f0 2023-11-30T23:12:23.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656d59a700 1 -- 172.21.15.73:0/399748898 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3856460137 0 0) 0x7f65680019f0 con 0x7f65700715f0 2023-11-30T23:12:23.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656d59a700 1 -- 172.21.15.73:0/399748898 >> v1:172.21.15.73:6789/0 conn(0x7f65700715f0 legacy=0x7f6570140330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:23.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656d59a700 1 --2- 172.21.15.73:0/399748898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6558003a20 0x7f6558003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:23.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656d59a700 1 --2- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6558004870 0x7f6558004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:23.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656d59a700 1 --2- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f657006f440 0x7f6558005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:23.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656d59a700 1 -- 172.21.15.73:0/399748898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6570071a80 con 0x7f6558003a20 2023-11-30T23:12:23.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656d59a700 1 -- 172.21.15.73:0/399748898 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657006f820 con 0x7f6558004870 2023-11-30T23:12:23.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656d59a700 1 -- 172.21.15.73:0/399748898 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655800bae0 con 0x7f657006f440 2023-11-30T23:12:23.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656e59c700 1 --2- 172.21.15.73:0/399748898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6558003a20 0x7f6558003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656ed9d700 1 --2- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f657006f440 0x7f6558005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.279+0000 7f656dd9b700 1 --2- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6558004870 0x7f6558004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.283+0000 7f656ed9d700 1 -- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6558004870 msgr2=0x7f6558004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:23.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.283+0000 7f656ed9d700 1 --2- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6558004870 0x7f6558004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.283+0000 7f656ed9d700 1 -- 172.21.15.73:0/399748898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6558003a20 msgr2=0x7f6558003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:23.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.283+0000 7f656ed9d700 1 --2- 172.21.15.73:0/399748898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6558003a20 0x7f6558003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.283+0000 7f656ed9d700 1 -- 172.21.15.73:0/399748898 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65580035d0 con 0x7f657006f440 2023-11-30T23:12:23.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.283+0000 7f656ed9d700 1 --2- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f657006f440 0x7f6558005230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f656800a830 tx=0x7f65580058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=344841641659cbd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:23.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.283+0000 7f656d59a700 1 -- 172.21.15.73:0/399748898 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65680072d0 con 0x7f657006f440 2023-11-30T23:12:23.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.283+0000 7f656d59a700 1 -- 172.21.15.73:0/399748898 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6568007430 con 0x7f657006f440 2023-11-30T23:12:23.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.283+0000 7f656d59a700 1 -- 172.21.15.73:0/399748898 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65680077a0 con 0x7f657006f440 2023-11-30T23:12:23.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.287+0000 7f656f59e700 1 -- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f657006f440 msgr2=0x7f6558005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:23.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.287+0000 7f656f59e700 1 --2- 172.21.15.73:0/399748898 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f657006f440 0x7f6558005230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f656800a830 tx=0x7f65580058a0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.287+0000 7f656ed9d700 1 -- 172.21.15.73:0/399748898 reap_dead start 2023-11-30T23:12:23.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.287+0000 7f656f59e700 1 -- 172.21.15.73:0/399748898 shutdown_connections 2023-11-30T23:12:23.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.287+0000 7f656f59e700 1 -- 172.21.15.73:0/399748898 >> 172.21.15.73:0/399748898 conn(0x7f65700b8c60 msgr2=0x7f65700b9070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:23.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.287+0000 7f656f59e700 1 -- 172.21.15.73:0/399748898 shutdown_connections 2023-11-30T23:12:23.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.287+0000 7f656f59e700 1 -- 172.21.15.73:0/399748898 wait complete. 2023-11-30T23:12:23.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656f59e700 1 Processor -- start 2023-11-30T23:12:23.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656f59e700 1 -- start start 2023-11-30T23:12:23.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656f59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f657006f440 0x7f65700af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:23.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656f59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65700b1f20 0x7f65700b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:23.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656f59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6570140f70 0x7f65701413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:23.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656f59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65700b28e0 con 0x7f65700b1f20 2023-11-30T23:12:23.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656f59e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65700b0000 con 0x7f657006f440 2023-11-30T23:12:23.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656f59e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65700b02a0 con 0x7f6570140f70 2023-11-30T23:12:23.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65700b1f20 0x7f65700b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65700b1f20 0x7f65700b23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44548/0 (socket says 172.21.15.73:44548) 2023-11-30T23:12:23.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656dd9b700 1 -- 172.21.15.73:0/3299221319 learned_addr learned my addr 172.21.15.73:0/3299221319 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:23.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656ed9d700 1 --2- 172.21.15.73:0/3299221319 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6570140f70 0x7f65701413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656e59c700 1 --2- 172.21.15.73:0/3299221319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f657006f440 0x7f65700af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656dd9b700 1 -- 172.21.15.73:0/3299221319 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6570140f70 msgr2=0x7f65701413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:23.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656dd9b700 1 --2- 172.21.15.73:0/3299221319 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6570140f70 0x7f65701413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656dd9b700 1 -- 172.21.15.73:0/3299221319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f657006f440 msgr2=0x7f65700af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:23.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656dd9b700 1 --2- 172.21.15.73:0/3299221319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f657006f440 0x7f65700af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656dd9b700 1 -- 172.21.15.73:0/3299221319 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700b0580 con 0x7f65700b1f20 2023-11-30T23:12:23.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.291+0000 7f656dd9b700 1 --2- 172.21.15.73:0/3299221319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65700b1f20 0x7f65700b23a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6560004700 tx=0x7f656000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:23.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.295+0000 7f655effd700 1 -- 172.21.15.73:0/3299221319 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6560016460 con 0x7f65700b1f20 2023-11-30T23:12:23.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.295+0000 7f655effd700 1 -- 172.21.15.73:0/3299221319 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656000c070 con 0x7f65700b1f20 2023-11-30T23:12:23.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.295+0000 7f655effd700 1 -- 172.21.15.73:0/3299221319 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6560016820 con 0x7f65700b1f20 2023-11-30T23:12:23.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.295+0000 7f656f59e700 1 -- 172.21.15.73:0/3299221319 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65700b1a90 con 0x7f65700b1f20 2023-11-30T23:12:23.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.295+0000 7f656f59e700 1 -- 172.21.15.73:0/3299221319 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65700b2d00 con 0x7f65700b1f20 2023-11-30T23:12:23.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.295+0000 7f655effd700 1 -- 172.21.15.73:0/3299221319 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6560005d40 con 0x7f65700b1f20 2023-11-30T23:12:23.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.295+0000 7f655effd700 1 -- 172.21.15.73:0/3299221319 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6560006810 con 0x7f65700b1f20 2023-11-30T23:12:23.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.295+0000 7f656f59e700 1 -- 172.21.15.73:0/3299221319 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65700b0770 con 0x7f65700b1f20 2023-11-30T23:12:23.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.299+0000 7f655effd700 1 -- 172.21.15.73:0/3299221319 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f656003db10 con 0x7f65700b1f20 2023-11-30T23:12:23.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.371+0000 7f656f59e700 1 -- 172.21.15.73:0/3299221319 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f65700681c0 con 0x7f65700b1f20 2023-11-30T23:12:23.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.375+0000 7f655effd700 1 -- 172.21.15.73:0/3299221319 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f656002c020 con 0x7f65700b1f20 2023-11-30T23:12:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.375+0000 7f656f59e700 1 -- 172.21.15.73:0/3299221319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65700b1f20 msgr2=0x7f65700b23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.375+0000 7f656f59e700 1 --2- 172.21.15.73:0/3299221319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65700b1f20 0x7f65700b23a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6560004700 tx=0x7f656000eb20 comp rx=0 tx=0).stop 2023-11-30T23:12:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.375+0000 7f656f59e700 1 -- 172.21.15.73:0/3299221319 shutdown_connections 2023-11-30T23:12:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.375+0000 7f656f59e700 1 --2- 172.21.15.73:0/3299221319 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6570140f70 0x7f65701413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.375+0000 7f656f59e700 1 --2- 172.21.15.73:0/3299221319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65700b1f20 0x7f65700b23a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.375+0000 7f656f59e700 1 --2- 172.21.15.73:0/3299221319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f657006f440 0x7f65700af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.375+0000 7f656f59e700 1 -- 172.21.15.73:0/3299221319 >> 172.21.15.73:0/3299221319 conn(0x7f65700b8c60 msgr2=0x7f6570071c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.375+0000 7f656f59e700 1 -- 172.21.15.73:0/3299221319 shutdown_connections 2023-11-30T23:12:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:23.375+0000 7f656f59e700 1 -- 172.21.15.73:0/3299221319 wait complete. 2023-11-30T23:12:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2023-11-30T23:12:23.392 INFO:tasks.ceph:check_enable_crimson: False 2023-11-30T23:12:23.392 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-30T23:12:23.392 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:12:23.392 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-30T23:12:23.408 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:12:23.408 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-30T23:12:23.419 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:12:23.419 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-30T23:12:23.433 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:12:23.433 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-30T23:12:23.448 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:12:23.448 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-30T23:12:23.464 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:12:23.464 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-30T23:12:23.482 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:23.479+0000 7f293bb3d2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T23:12:23.499 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:23.497+0000 7fe5fc4f72c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-30T23:12:23.512 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:12:23.512 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-30T23:12:23.568 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-30T23:12:23.568 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-30T23:12:23.583 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new bbf1c93f-0775-4780-8524-cf25792d9aa6 0 2023-11-30T23:12:23.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.685+0000 7f3264935700 1 Processor -- start 2023-11-30T23:12:23.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.685+0000 7f3264935700 1 -- start start 2023-11-30T23:12:23.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.685+0000 7f3264935700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32600b6d90 0x7f32600b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:23.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.685+0000 7f3264935700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3260140c60 0x7f3260150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:23.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.685+0000 7f3264935700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326006c3d0 con 0x7f3260140820 2023-11-30T23:12:23.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.685+0000 7f3264935700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f326006bd60 con 0x7f3260140c60 2023-11-30T23:12:23.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.685+0000 7f3264935700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326006cc10 con 0x7f32600b6d90 2023-11-30T23:12:23.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f325ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32600b6d90 0x7f32600b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f325e59c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f3260140820 0x7f3260146750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37390/0 (socket says 172.21.15.156:37390) 2023-11-30T23:12:23.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f325e59c700 1 -- 172.21.15.156:0/1729446905 learned_addr learned my addr 172.21.15.156:0/1729446905 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-11-30T23:12:23.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f325f59e700 1 --2- 172.21.15.156:0/1729446905 >> v2:172.21.15.156:3300/0 conn(0x7f3260140c60 0x7f3260150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f325dd9b700 1 -- 172.21.15.156:0/1729446905 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261996660 0 0) 0x7f326006c3d0 con 0x7f3260140820 2023-11-30T23:12:23.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f325dd9b700 1 -- 172.21.15.156:0/1729446905 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32480035d0 con 0x7f3260140820 2023-11-30T23:12:23.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f325ed9d700 1 -- 172.21.15.156:0/1729446905 >> v2:172.21.15.156:3300/0 conn(0x7f3260140c60 msgr2=0x7f3260150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:23.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f325ed9d700 1 --2- 172.21.15.156:0/1729446905 >> v2:172.21.15.156:3300/0 conn(0x7f3260140c60 0x7f3260150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f325ed9d700 1 -- 172.21.15.156:0/1729446905 >> v1:172.21.15.156:6789/0 conn(0x7f3260140820 legacy=0x7f3260146750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:23.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f325ed9d700 1 -- 172.21.15.156:0/1729446905 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326006d0a0 con 0x7f32600b6d90 2023-11-30T23:12:23.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f325f59e700 1 --2- 172.21.15.156:0/1729446905 >> v2:172.21.15.156:3300/0 conn(0x7f3260140c60 0x7f3260150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:23.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f325ed9d700 1 --2- 172.21.15.156:0/1729446905 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32600b6d90 0x7f32600b4c00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3258009d90 tx=0x7f325800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2df3f7269ffed710 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:23.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f325dd9b700 1 -- 172.21.15.156:0/1729446905 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325800e070 con 0x7f32600b6d90 2023-11-30T23:12:23.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f325dd9b700 1 -- 172.21.15.156:0/1729446905 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325800bb20 con 0x7f32600b6d90 2023-11-30T23:12:23.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f325dd9b700 1 -- 172.21.15.156:0/1729446905 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258012430 con 0x7f32600b6d90 2023-11-30T23:12:23.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f3264935700 1 -- 172.21.15.156:0/1729446905 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32600b6d90 msgr2=0x7f32600b4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:23.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f3264935700 1 --2- 172.21.15.156:0/1729446905 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32600b6d90 0x7f32600b4c00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3258009d90 tx=0x7f325800b330 comp rx=0 tx=0).stop 2023-11-30T23:12:23.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f3264935700 1 -- 172.21.15.156:0/1729446905 shutdown_connections 2023-11-30T23:12:23.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f3264935700 1 --2- 172.21.15.156:0/1729446905 >> v2:172.21.15.156:3300/0 conn(0x7f3260140c60 0x7f3260150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f3264935700 1 --2- 172.21.15.156:0/1729446905 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32600b6d90 0x7f32600b4c00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f3264935700 1 -- 172.21.15.156:0/1729446905 >> 172.21.15.156:0/1729446905 conn(0x7f326006a360 msgr2=0x7f326006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:23.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f3264935700 1 -- 172.21.15.156:0/1729446905 shutdown_connections 2023-11-30T23:12:23.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f3264935700 1 -- 172.21.15.156:0/1729446905 wait complete. 2023-11-30T23:12:23.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f3264935700 1 Processor -- start 2023-11-30T23:12:23.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.689+0000 7f3264935700 1 -- start start 2023-11-30T23:12:23.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f3264935700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32600b6d90 0x7f3260136b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:23.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f3264935700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3260140820 0x7f32601389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:23.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f3264935700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3260140c60 0x7f32601defd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:23.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f3264935700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3260135660 con 0x7f3260140c60 2023-11-30T23:12:23.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f3264935700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3260135f00 con 0x7f32600b6d90 2023-11-30T23:12:23.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f3264935700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32600b1fc0 con 0x7f3260140820 2023-11-30T23:12:23.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f325e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3260140820 0x7f32601389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f325e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3260140820 0x7f32601389c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53772/0 (socket says 172.21.15.156:53772) 2023-11-30T23:12:23.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f325e59c700 1 -- 172.21.15.156:0/1299038754 learned_addr learned my addr 172.21.15.156:0/1299038754 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-30T23:12:23.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f325ed9d700 1 --2- 172.21.15.156:0/1299038754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32600b6d90 0x7f3260136b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f325f59e700 1 --2- 172.21.15.156:0/1299038754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3260140c60 0x7f32601defd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f325e59c700 1 -- 172.21.15.156:0/1299038754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32600b6d90 msgr2=0x7f3260136b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:23.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f325e59c700 1 --2- 172.21.15.156:0/1299038754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32600b6d90 0x7f3260136b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f325e59c700 1 -- 172.21.15.156:0/1299038754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3260140c60 msgr2=0x7f32601defd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:23.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f325e59c700 1 --2- 172.21.15.156:0/1299038754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3260140c60 0x7f32601defd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f325e59c700 1 -- 172.21.15.156:0/1299038754 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32500094b0 con 0x7f3260140820 2023-11-30T23:12:23.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f325ed9d700 1 --2- 172.21.15.156:0/1299038754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32600b6d90 0x7f3260136b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:23.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f325e59c700 1 --2- 172.21.15.156:0/1299038754 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3260140820 0x7f32601389c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f325400c730 tx=0x7f325400ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:23.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f32477fe700 1 -- 172.21.15.156:0/1299038754 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254005d90 con 0x7f3260140820 2023-11-30T23:12:23.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f32477fe700 1 -- 172.21.15.156:0/1299038754 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32540070d0 con 0x7f3260140820 2023-11-30T23:12:23.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f32477fe700 1 -- 172.21.15.156:0/1299038754 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254007480 con 0x7f3260140820 2023-11-30T23:12:23.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f3264935700 1 -- 172.21.15.156:0/1299038754 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3258009a70 con 0x7f3260140820 2023-11-30T23:12:23.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.693+0000 7f3264935700 1 -- 172.21.15.156:0/1299038754 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3260135b90 con 0x7f3260140820 2023-11-30T23:12:23.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.697+0000 7f32477fe700 1 -- 172.21.15.156:0/1299038754 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f325401c440 con 0x7f3260140820 2023-11-30T23:12:23.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.697+0000 7f3264935700 1 -- 172.21.15.156:0/1299038754 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3260136090 con 0x7f3260140820 2023-11-30T23:12:23.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.697+0000 7f32477fe700 1 -- 172.21.15.156:0/1299038754 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3254012780 con 0x7f3260140820 2023-11-30T23:12:23.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.697+0000 7f32477fe700 1 -- 172.21.15.156:0/1299038754 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f3254017070 con 0x7f3260140820 2023-11-30T23:12:23.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.773+0000 7f3264935700 1 -- 172.21.15.156:0/1299038754 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bbf1c93f-0775-4780-8524-cf25792d9aa6", "id": 0} v 0) v1 -- 0x7f32600681c0 con 0x7f3260140820 2023-11-30T23:12:23.786 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.781+0000 7f32477fe700 1 -- 172.21.15.156:0/1299038754 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bbf1c93f-0775-4780-8524-cf25792d9aa6", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3254012a60 con 0x7f3260140820 2023-11-30T23:12:23.786 INFO:teuthology.orchestra.run.smithi156.stdout:0 2023-11-30T23:12:23.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.785+0000 7f3264935700 1 -- 172.21.15.156:0/1299038754 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3260140820 msgr2=0x7f32601389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:23.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.785+0000 7f3264935700 1 --2- 172.21.15.156:0/1299038754 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3260140820 0x7f32601389c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f325400c730 tx=0x7f325400ca40 comp rx=0 tx=0).stop 2023-11-30T23:12:23.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.785+0000 7f3264935700 1 -- 172.21.15.156:0/1299038754 shutdown_connections 2023-11-30T23:12:23.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.785+0000 7f3264935700 1 --2- 172.21.15.156:0/1299038754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3260140c60 0x7f32601defd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.785+0000 7f3264935700 1 --2- 172.21.15.156:0/1299038754 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3260140820 0x7f32601389c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.785+0000 7f3264935700 1 --2- 172.21.15.156:0/1299038754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32600b6d90 0x7f3260136b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.785+0000 7f3264935700 1 -- 172.21.15.156:0/1299038754 >> 172.21.15.156:0/1299038754 conn(0x7f326006a360 msgr2=0x7f326013be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:23.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.785+0000 7f3264935700 1 -- 172.21.15.156:0/1299038754 shutdown_connections 2023-11-30T23:12:23.788 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.785+0000 7f3264935700 1 -- 172.21.15.156:0/1299038754 wait complete. 2023-11-30T23:12:23.800 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 9d9dd122-9a42-4588-a0d2-50d13b13eba8 1 2023-11-30T23:12:23.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f4589aa7700 1 Processor -- start 2023-11-30T23:12:23.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f4589aa7700 1 -- start start 2023-11-30T23:12:23.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f4589aa7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f45840b2a00 0x7f45841479e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:23.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f4589aa7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f45840b2de0 0x7f458414ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:23.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f4589aa7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45840713e0 con 0x7f4584071870 2023-11-30T23:12:23.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f4589aa7700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f458406b040 con 0x7f45840b2a00 2023-11-30T23:12:23.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f4589aa7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f458413ec10 con 0x7f45840b2de0 2023-11-30T23:12:23.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f45892a6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f45840b2de0 0x7f458414ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f457bfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4584071870 0x7f45840b4aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37402/0 (socket says 172.21.15.156:37402) 2023-11-30T23:12:23.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f457bfff700 1 -- 172.21.15.156:0/600282287 learned_addr learned my addr 172.21.15.156:0/600282287 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-11-30T23:12:23.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f4588aa5700 1 --2- 172.21.15.156:0/600282287 >> v2:172.21.15.73:3300/0 conn(0x7f45840b2a00 0x7f45841479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f45892a6700 1 -- 172.21.15.156:0/600282287 >> v2:172.21.15.73:3300/0 conn(0x7f45840b2a00 msgr2=0x7f45841479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:23.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f457b7fe700 1 -- 172.21.15.156:0/600282287 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118534928 0 0) 0x7f45840713e0 con 0x7f4584071870 2023-11-30T23:12:23.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f45892a6700 1 --2- 172.21.15.156:0/600282287 >> v2:172.21.15.73:3300/0 conn(0x7f45840b2a00 0x7f45841479e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f45892a6700 1 -- 172.21.15.156:0/600282287 >> v1:172.21.15.156:6789/0 conn(0x7f4584071870 legacy=0x7f45840b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:23.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f45892a6700 1 -- 172.21.15.156:0/600282287 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45840b51b0 con 0x7f45840b2de0 2023-11-30T23:12:23.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f45892a6700 1 --2- 172.21.15.156:0/600282287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45840b2de0 0x7f458414ed10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f45840b0290 tx=0x7f457c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f490a761b77b5554 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:23.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f457b7fe700 1 -- 172.21.15.156:0/600282287 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c00e070 con 0x7f45840b2de0 2023-11-30T23:12:23.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f457b7fe700 1 -- 172.21.15.156:0/600282287 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457c00bbd0 con 0x7f45840b2de0 2023-11-30T23:12:23.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f457b7fe700 1 -- 172.21.15.156:0/600282287 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c012430 con 0x7f45840b2de0 2023-11-30T23:12:23.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f4589aa7700 1 -- 172.21.15.156:0/600282287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45840b2de0 msgr2=0x7f458414ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:23.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f4589aa7700 1 --2- 172.21.15.156:0/600282287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45840b2de0 0x7f458414ed10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f45840b0290 tx=0x7f457c00b330 comp rx=0 tx=0).stop 2023-11-30T23:12:23.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f4589aa7700 1 -- 172.21.15.156:0/600282287 shutdown_connections 2023-11-30T23:12:23.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f4589aa7700 1 --2- 172.21.15.156:0/600282287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45840b2de0 0x7f458414ed10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f4589aa7700 1 --2- 172.21.15.156:0/600282287 >> v2:172.21.15.73:3300/0 conn(0x7f45840b2a00 0x7f45841479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f4589aa7700 1 -- 172.21.15.156:0/600282287 >> 172.21.15.156:0/600282287 conn(0x7f45840b8c60 msgr2=0x7f45840b9070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:23.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f4589aa7700 1 -- 172.21.15.156:0/600282287 shutdown_connections 2023-11-30T23:12:23.918 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.909+0000 7f4589aa7700 1 -- 172.21.15.156:0/600282287 wait complete. 2023-11-30T23:12:23.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f4589aa7700 1 Processor -- start 2023-11-30T23:12:23.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f4589aa7700 1 -- start start 2023-11-30T23:12:23.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f4589aa7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4584071870 0x7f45840acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:23.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f4589aa7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45840b2a00 0x7f45840ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:23.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f4589aa7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45840b2de0 0x7f45840ad820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:23.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f4589aa7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458413d590 con 0x7f4584071870 2023-11-30T23:12:23.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f4589aa7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45841db9b0 con 0x7f45840b2de0 2023-11-30T23:12:23.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f4589aa7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45841dc240 con 0x7f45840b2a00 2023-11-30T23:12:23.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f457bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45840b2a00 0x7f45840ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f457bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45840b2a00 0x7f45840ad2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53776/0 (socket says 172.21.15.156:53776) 2023-11-30T23:12:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f45892a6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45840b2de0 0x7f45840ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f457bfff700 1 -- 172.21.15.156:0/3386680364 learned_addr learned my addr 172.21.15.156:0/3386680364 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-30T23:12:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f4588aa5700 1 --2- 172.21.15.156:0/3386680364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4584071870 0x7f45840acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f45892a6700 1 -- 172.21.15.156:0/3386680364 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45840b2a00 msgr2=0x7f45840ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f45892a6700 1 --2- 172.21.15.156:0/3386680364 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45840b2a00 0x7f45840ad2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f45892a6700 1 -- 172.21.15.156:0/3386680364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4584071870 msgr2=0x7f45840acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f45892a6700 1 --2- 172.21.15.156:0/3386680364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4584071870 0x7f45840acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f45892a6700 1 -- 172.21.15.156:0/3386680364 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c009a70 con 0x7f45840b2de0 2023-11-30T23:12:23.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f45892a6700 1 --2- 172.21.15.156:0/3386680364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45840b2de0 0x7f45840ad820 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f457c016000 tx=0x7f457c004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:23.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f45797fa700 1 -- 172.21.15.156:0/3386680364 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c012430 con 0x7f45840b2de0 2023-11-30T23:12:23.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f45797fa700 1 -- 172.21.15.156:0/3386680364 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457c020070 con 0x7f45840b2de0 2023-11-30T23:12:23.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f45797fa700 1 -- 172.21.15.156:0/3386680364 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c004280 con 0x7f45840b2de0 2023-11-30T23:12:23.924 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f4589aa7700 1 -- 172.21.15.156:0/3386680364 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45840aef70 con 0x7f45840b2de0 2023-11-30T23:12:23.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f4589aa7700 1 -- 172.21.15.156:0/3386680364 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45841dbbf0 con 0x7f45840b2de0 2023-11-30T23:12:23.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f45797fa700 1 -- 172.21.15.156:0/3386680364 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f457c0046e0 con 0x7f45840b2de0 2023-11-30T23:12:23.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f45797fa700 1 -- 172.21.15.156:0/3386680364 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f457c022070 con 0x7f45840b2de0 2023-11-30T23:12:23.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.913+0000 7f4589aa7700 1 -- 172.21.15.156:0/3386680364 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45840681c0 con 0x7f45840b2de0 2023-11-30T23:12:23.925 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.917+0000 7f45797fa700 1 -- 172.21.15.156:0/3386680364 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f457c046b10 con 0x7f45840b2de0 2023-11-30T23:12:23.998 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:23.993+0000 7f4589aa7700 1 -- 172.21.15.156:0/3386680364 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9d9dd122-9a42-4588-a0d2-50d13b13eba8", "id": 1} v 0) v1 -- 0x7f45841dc380 con 0x7f45840b2de0 2023-11-30T23:12:24.005 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.001+0000 7f45797fa700 1 -- 172.21.15.156:0/3386680364 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d9dd122-9a42-4588-a0d2-50d13b13eba8", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f457c035030 con 0x7f45840b2de0 2023-11-30T23:12:24.005 INFO:teuthology.orchestra.run.smithi156.stdout:1 2023-11-30T23:12:24.006 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.001+0000 7f4589aa7700 1 -- 172.21.15.156:0/3386680364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45840b2de0 msgr2=0x7f45840ad820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.001+0000 7f4589aa7700 1 --2- 172.21.15.156:0/3386680364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45840b2de0 0x7f45840ad820 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f457c016000 tx=0x7f457c004af0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.001+0000 7f4589aa7700 1 -- 172.21.15.156:0/3386680364 shutdown_connections 2023-11-30T23:12:24.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.001+0000 7f4589aa7700 1 --2- 172.21.15.156:0/3386680364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45840b2de0 0x7f45840ad820 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.001+0000 7f4589aa7700 1 --2- 172.21.15.156:0/3386680364 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f45840b2a00 0x7f45840ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.001+0000 7f4589aa7700 1 --2- 172.21.15.156:0/3386680364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4584071870 0x7f45840acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.001+0000 7f4589aa7700 1 -- 172.21.15.156:0/3386680364 >> 172.21.15.156:0/3386680364 conn(0x7f45840b8c60 msgr2=0x7f45840b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:24.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.001+0000 7f4589aa7700 1 -- 172.21.15.156:0/3386680364 shutdown_connections 2023-11-30T23:12:24.007 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.001+0000 7f4589aa7700 1 -- 172.21.15.156:0/3386680364 wait complete. 2023-11-30T23:12:24.019 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 68ff4f1e-ec45-42e0-bb83-fe03598e4940 2 2023-11-30T23:12:24.104 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:24.099+0000 7f293bb3d2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T23:12:24.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaf0944700 1 Processor -- start 2023-11-30T23:12:24.132 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaf0944700 1 -- start start 2023-11-30T23:12:24.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaf0944700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7feaec149b90 0x7feaec0b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaf0944700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaec0b4150 0x7feaec150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.133 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaf0944700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaec0b3370 con 0x7feaec0b9130 2023-11-30T23:12:24.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaf0944700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaec0b5b30 con 0x7feaec149b90 2023-11-30T23:12:24.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaf0944700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaec0b4ea0 con 0x7feaec0b4150 2023-11-30T23:12:24.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaeb7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7feaec0b9130 0x7feaec0b2040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37418/0 (socket says 172.21.15.156:37418) 2023-11-30T23:12:24.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaeb7fe700 1 -- 172.21.15.156:0/2905042618 learned_addr learned my addr 172.21.15.156:0/2905042618 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-11-30T23:12:24.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaebfff700 1 --2- 172.21.15.156:0/2905042618 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaec0b4150 0x7feaec150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaeaffd700 1 --2- 172.21.15.156:0/2905042618 >> v2:172.21.15.73:3300/0 conn(0x7feaec149b90 0x7feaec0b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaea7fc700 1 -- 172.21.15.156:0/2905042618 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424233325 0 0) 0x7feaec0b3370 con 0x7feaec0b9130 2023-11-30T23:12:24.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaea7fc700 1 -- 172.21.15.156:0/2905042618 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fead40035d0 con 0x7feaec0b9130 2023-11-30T23:12:24.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaebfff700 1 -- 172.21.15.156:0/2905042618 >> v2:172.21.15.73:3300/0 conn(0x7feaec149b90 msgr2=0x7feaec0b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:24.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaebfff700 1 --2- 172.21.15.156:0/2905042618 >> v2:172.21.15.73:3300/0 conn(0x7feaec149b90 0x7feaec0b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaebfff700 1 -- 172.21.15.156:0/2905042618 >> v1:172.21.15.156:6789/0 conn(0x7feaec0b9130 legacy=0x7feaec0b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.134 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaebfff700 1 -- 172.21.15.156:0/2905042618 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec0b9510 con 0x7feaec0b4150 2023-11-30T23:12:24.135 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaebfff700 1 --2- 172.21.15.156:0/2905042618 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaec0b4150 0x7feaec150ec0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feadc009850 tx=0x7feadc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d319d656be29e32d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:24.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaea7fc700 1 -- 172.21.15.156:0/2905042618 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc011830 con 0x7feaec0b4150 2023-11-30T23:12:24.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaea7fc700 1 -- 172.21.15.156:0/2905042618 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc011990 con 0x7feaec0b4150 2023-11-30T23:12:24.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaea7fc700 1 -- 172.21.15.156:0/2905042618 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc011d40 con 0x7feaec0b4150 2023-11-30T23:12:24.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaf0944700 1 -- 172.21.15.156:0/2905042618 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaec0b4150 msgr2=0x7feaec150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaf0944700 1 --2- 172.21.15.156:0/2905042618 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaec0b4150 0x7feaec150ec0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feadc009850 tx=0x7feadc009b60 comp rx=0 tx=0).stop 2023-11-30T23:12:24.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaf0944700 1 -- 172.21.15.156:0/2905042618 shutdown_connections 2023-11-30T23:12:24.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaf0944700 1 --2- 172.21.15.156:0/2905042618 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaec0b4150 0x7feaec150ec0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaf0944700 1 --2- 172.21.15.156:0/2905042618 >> v2:172.21.15.73:3300/0 conn(0x7feaec149b90 0x7feaec0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.129+0000 7feaf0944700 1 -- 172.21.15.156:0/2905042618 >> 172.21.15.156:0/2905042618 conn(0x7feaec071ca0 msgr2=0x7feaec0720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:24.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.133+0000 7feaf0944700 1 -- 172.21.15.156:0/2905042618 shutdown_connections 2023-11-30T23:12:24.136 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.133+0000 7feaf0944700 1 -- 172.21.15.156:0/2905042618 wait complete. 2023-11-30T23:12:24.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.133+0000 7feaf0944700 1 Processor -- start 2023-11-30T23:12:24.137 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.133+0000 7feaf0944700 1 -- start start 2023-11-30T23:12:24.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.133+0000 7feaf0944700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaec0b4150 0x7feaec143a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.133+0000 7feaf0944700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaec0b9130 0x7feaec146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.133+0000 7feaf0944700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaec149b90 0x7feaec144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.133+0000 7feaf0944700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaec1df770 con 0x7feaec0b4150 2023-11-30T23:12:24.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.133+0000 7feaf0944700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaec147480 con 0x7feaec0b9130 2023-11-30T23:12:24.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.133+0000 7feaf0944700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaec1447c0 con 0x7feaec149b90 2023-11-30T23:12:24.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.133+0000 7feaeaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaec0b9130 0x7feaec146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.133+0000 7feaebfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaec149b90 0x7feaec144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.133+0000 7feaeaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaec0b9130 0x7feaec146f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50344/0 (socket says 172.21.15.156:50344) 2023-11-30T23:12:24.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.133+0000 7feaeaffd700 1 -- 172.21.15.156:0/2308449538 learned_addr learned my addr 172.21.15.156:0/2308449538 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-30T23:12:24.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.133+0000 7feaeb7fe700 1 --2- 172.21.15.156:0/2308449538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaec0b4150 0x7feaec143a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.140 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.137+0000 7feaebfff700 1 -- 172.21.15.156:0/2308449538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaec0b9130 msgr2=0x7feaec146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.137+0000 7feaebfff700 1 --2- 172.21.15.156:0/2308449538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaec0b9130 0x7feaec146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.137+0000 7feaebfff700 1 -- 172.21.15.156:0/2308449538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaec0b4150 msgr2=0x7feaec143a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.137+0000 7feaebfff700 1 --2- 172.21.15.156:0/2308449538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaec0b4150 0x7feaec143a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.137+0000 7feaebfff700 1 -- 172.21.15.156:0/2308449538 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc0094b0 con 0x7feaec149b90 2023-11-30T23:12:24.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.137+0000 7feaeaffd700 1 --2- 172.21.15.156:0/2308449538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaec0b9130 0x7feaec146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:24.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.137+0000 7feaebfff700 1 --2- 172.21.15.156:0/2308449538 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaec149b90 0x7feaec144280 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7feadc016000 tx=0x7feadc004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:24.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.137+0000 7fead3fff700 1 -- 172.21.15.156:0/2308449538 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc004300 con 0x7feaec149b90 2023-11-30T23:12:24.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.137+0000 7fead3fff700 1 -- 172.21.15.156:0/2308449538 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc01f070 con 0x7feaec149b90 2023-11-30T23:12:24.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.137+0000 7feaf0944700 1 -- 172.21.15.156:0/2308449538 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaec1df0f0 con 0x7feaec149b90 2023-11-30T23:12:24.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.137+0000 7fead3fff700 1 -- 172.21.15.156:0/2308449538 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc0036c0 con 0x7feaec149b90 2023-11-30T23:12:24.141 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.137+0000 7feaf0944700 1 -- 172.21.15.156:0/2308449538 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaec1df390 con 0x7feaec149b90 2023-11-30T23:12:24.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.137+0000 7fead3fff700 1 -- 172.21.15.156:0/2308449538 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7feadc021030 con 0x7feaec149b90 2023-11-30T23:12:24.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.137+0000 7fead3fff700 1 -- 172.21.15.156:0/2308449538 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7feadc01acd0 con 0x7feaec149b90 2023-11-30T23:12:24.142 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.137+0000 7feaf0944700 1 -- 172.21.15.156:0/2308449538 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaec0b3d40 con 0x7feaec149b90 2023-11-30T23:12:24.142 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:24.137+0000 7fe5fc4f72c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-30T23:12:24.144 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.141+0000 7fead3fff700 1 -- 172.21.15.156:0/2308449538 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7feadc015020 con 0x7feaec149b90 2023-11-30T23:12:24.163 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:24.159+0000 7f293bb3d2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T23:12:24.199 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:24.197+0000 7fe5fc4f72c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-30T23:12:24.219 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.217+0000 7feaf0944700 1 -- 172.21.15.156:0/2308449538 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd new", "uuid": "68ff4f1e-ec45-42e0-bb83-fe03598e4940", "id": 2} v 0) v1 -- 0x7feaec0681c0 con 0x7feaec149b90 2023-11-30T23:12:24.227 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.225+0000 7fead3fff700 1 -- 172.21.15.156:0/2308449538 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "68ff4f1e-ec45-42e0-bb83-fe03598e4940", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7feadc01a450 con 0x7feaec149b90 2023-11-30T23:12:24.227 INFO:teuthology.orchestra.run.smithi156.stdout:2 2023-11-30T23:12:24.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.225+0000 7feaf0944700 1 -- 172.21.15.156:0/2308449538 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaec149b90 msgr2=0x7feaec144280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.225+0000 7feaf0944700 1 --2- 172.21.15.156:0/2308449538 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaec149b90 0x7feaec144280 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7feadc016000 tx=0x7feadc004770 comp rx=0 tx=0).stop 2023-11-30T23:12:24.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.225+0000 7feaf0944700 1 -- 172.21.15.156:0/2308449538 shutdown_connections 2023-11-30T23:12:24.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.225+0000 7feaf0944700 1 --2- 172.21.15.156:0/2308449538 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7feaec149b90 0x7feaec144280 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.225+0000 7feaf0944700 1 --2- 172.21.15.156:0/2308449538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feaec0b9130 0x7feaec146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.225+0000 7feaf0944700 1 --2- 172.21.15.156:0/2308449538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaec0b4150 0x7feaec143a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.225+0000 7feaf0944700 1 -- 172.21.15.156:0/2308449538 >> 172.21.15.156:0/2308449538 conn(0x7feaec071ca0 msgr2=0x7feaec0b7040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:24.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.225+0000 7feaf0944700 1 -- 172.21.15.156:0/2308449538 shutdown_connections 2023-11-30T23:12:24.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.225+0000 7feaf0944700 1 -- 172.21.15.156:0/2308449538 wait complete. 2023-11-30T23:12:24.241 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new e4b08c98-6a4d-4ec8-a245-59a35f70a16f 3 2023-11-30T23:12:24.305 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:24.299+0000 7f293bb3d2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T23:12:24.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.345+0000 7f681347d700 1 Processor -- start 2023-11-30T23:12:24.350 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.345+0000 7f681347d700 1 -- start start 2023-11-30T23:12:24.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f680c140a50 0x7f680c149d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f680c14a2c0 0x7f680c150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c0b4e70 con 0x7f680c0bc8b0 2023-11-30T23:12:24.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680c0b5da0 con 0x7f680c14a2c0 2023-11-30T23:12:24.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680c0bcc90 con 0x7f680c140a50 2023-11-30T23:12:24.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f6811c7a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f680c140a50 0x7f680c149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.352 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f6811c7a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f680c140a50 0x7f680c149d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50358/0 (socket says 172.21.15.156:50358) 2023-11-30T23:12:24.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f6811c7a700 1 -- 172.21.15.156:0/3392483931 learned_addr learned my addr 172.21.15.156:0/3392483931 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-30T23:12:24.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f6812c7c700 1 --2- 172.21.15.156:0/3392483931 >> v2:172.21.15.73:3300/0 conn(0x7f680c14a2c0 0x7f680c150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f6811c7a700 1 -- 172.21.15.156:0/3392483931 >> v2:172.21.15.73:3300/0 conn(0x7f680c14a2c0 msgr2=0x7f680c150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:24.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f6811c7a700 1 --2- 172.21.15.156:0/3392483931 >> v2:172.21.15.73:3300/0 conn(0x7f680c14a2c0 0x7f680c150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f6811c7a700 1 -- 172.21.15.156:0/3392483931 >> v1:172.21.15.156:6789/0 conn(0x7f680c0bc8b0 legacy=0x7f680c140340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f6811c7a700 1 -- 172.21.15.156:0/3392483931 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c0b4040 con 0x7f680c140a50 2023-11-30T23:12:24.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f6811c7a700 1 --2- 172.21.15.156:0/3392483931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f680c140a50 0x7f680c149d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f680c14ac40 tx=0x7f67fc009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7397fb55af8d2607 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:24.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f6811479700 1 -- 172.21.15.156:0/3392483931 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc00b8a0 con 0x7f680c140a50 2023-11-30T23:12:24.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f6811479700 1 -- 172.21.15.156:0/3392483931 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc00ba00 con 0x7f680c140a50 2023-11-30T23:12:24.353 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f6811479700 1 -- 172.21.15.156:0/3392483931 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc00bd90 con 0x7f680c140a50 2023-11-30T23:12:24.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 -- 172.21.15.156:0/3392483931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f680c140a50 msgr2=0x7f680c149d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 --2- 172.21.15.156:0/3392483931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f680c140a50 0x7f680c149d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f680c14ac40 tx=0x7f67fc009bf0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 -- 172.21.15.156:0/3392483931 shutdown_connections 2023-11-30T23:12:24.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 --2- 172.21.15.156:0/3392483931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f680c140a50 0x7f680c149d80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 --2- 172.21.15.156:0/3392483931 >> v2:172.21.15.73:3300/0 conn(0x7f680c14a2c0 0x7f680c150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 -- 172.21.15.156:0/3392483931 >> 172.21.15.156:0/3392483931 conn(0x7f680c071ee0 msgr2=0x7f680c0bbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:24.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 -- 172.21.15.156:0/3392483931 shutdown_connections 2023-11-30T23:12:24.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 -- 172.21.15.156:0/3392483931 wait complete. 2023-11-30T23:12:24.355 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 Processor -- start 2023-11-30T23:12:24.355 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:24.349+0000 7fe5fc4f72c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-30T23:12:24.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 -- start start 2023-11-30T23:12:24.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f680c0bc8b0 0x7f680c148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f680c14a2c0 0x7f680c1df3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f680c1df900 0x7f680c13a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c144010 con 0x7f680c0bc8b0 2023-11-30T23:12:24.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c141930 con 0x7f680c1df900 2023-11-30T23:12:24.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f681347d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c13bca0 con 0x7f680c14a2c0 2023-11-30T23:12:24.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f6812c7c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f680c1df900 0x7f680c13a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f6812c7c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f680c1df900 0x7f680c13a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50366/0 (socket says 172.21.15.156:50366) 2023-11-30T23:12:24.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f6812c7c700 1 -- 172.21.15.156:0/838910289 learned_addr learned my addr 172.21.15.156:0/838910289 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-30T23:12:24.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.349+0000 7f6811c7a700 1 --2- 172.21.15.156:0/838910289 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f680c14a2c0 0x7f680c1df3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.353+0000 7f681247b700 1 --2- 172.21.15.156:0/838910289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f680c0bc8b0 0x7f680c148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.353+0000 7f6812c7c700 1 -- 172.21.15.156:0/838910289 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f680c14a2c0 msgr2=0x7f680c1df3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.353+0000 7f6812c7c700 1 --2- 172.21.15.156:0/838910289 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f680c14a2c0 0x7f680c1df3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.353+0000 7f6812c7c700 1 -- 172.21.15.156:0/838910289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f680c0bc8b0 msgr2=0x7f680c148620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.353+0000 7f6812c7c700 1 --2- 172.21.15.156:0/838910289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f680c0bc8b0 0x7f680c148620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.353+0000 7f6812c7c700 1 -- 172.21.15.156:0/838910289 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc009570 con 0x7f680c1df900 2023-11-30T23:12:24.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.353+0000 7f681247b700 1 --2- 172.21.15.156:0/838910289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f680c0bc8b0 0x7f680c148620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:12:24.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.353+0000 7f6812c7c700 1 --2- 172.21.15.156:0/838910289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f680c1df900 0x7f680c13a050 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6804007ec0 tx=0x7f680400e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:24.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.353+0000 7f6802ffd700 1 -- 172.21.15.156:0/838910289 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680400ede0 con 0x7f680c1df900 2023-11-30T23:12:24.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.353+0000 7f6802ffd700 1 -- 172.21.15.156:0/838910289 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6804014420 con 0x7f680c1df900 2023-11-30T23:12:24.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.353+0000 7f681347d700 1 -- 172.21.15.156:0/838910289 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680c1dfd90 con 0x7f680c1df900 2023-11-30T23:12:24.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.353+0000 7f6802ffd700 1 -- 172.21.15.156:0/838910289 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68040147d0 con 0x7f680c1df900 2023-11-30T23:12:24.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.353+0000 7f681347d700 1 -- 172.21.15.156:0/838910289 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680c13b650 con 0x7f680c1df900 2023-11-30T23:12:24.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.353+0000 7f6802ffd700 1 -- 172.21.15.156:0/838910289 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6804014c30 con 0x7f680c1df900 2023-11-30T23:12:24.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.353+0000 7f6802ffd700 1 -- 172.21.15.156:0/838910289 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f680401d3c0 con 0x7f680c1df900 2023-11-30T23:12:24.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.353+0000 7f681347d700 1 -- 172.21.15.156:0/838910289 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680c1df0e0 con 0x7f680c1df900 2023-11-30T23:12:24.361 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.357+0000 7f6802ffd700 1 -- 172.21.15.156:0/838910289 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f680c1df0e0 con 0x7f680c1df900 2023-11-30T23:12:24.435 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.433+0000 7f681347d700 1 -- 172.21.15.156:0/838910289 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e4b08c98-6a4d-4ec8-a245-59a35f70a16f", "id": 3} v 0) v1 -- 0x7f680c0b4ad0 con 0x7f680c1df900 2023-11-30T23:12:24.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.437+0000 7f6802ffd700 1 -- 172.21.15.156:0/838910289 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e4b08c98-6a4d-4ec8-a245-59a35f70a16f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f680401e460 con 0x7f680c1df900 2023-11-30T23:12:24.475 INFO:teuthology.orchestra.run.smithi156.stdout:3 2023-11-30T23:12:24.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.441+0000 7f681347d700 1 -- 172.21.15.156:0/838910289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f680c1df900 msgr2=0x7f680c13a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.441+0000 7f681347d700 1 --2- 172.21.15.156:0/838910289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f680c1df900 0x7f680c13a050 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6804007ec0 tx=0x7f680400e3c0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.441+0000 7f681347d700 1 -- 172.21.15.156:0/838910289 shutdown_connections 2023-11-30T23:12:24.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.441+0000 7f681347d700 1 --2- 172.21.15.156:0/838910289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f680c1df900 0x7f680c13a050 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.441+0000 7f681347d700 1 --2- 172.21.15.156:0/838910289 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f680c14a2c0 0x7f680c1df3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.441+0000 7f681347d700 1 --2- 172.21.15.156:0/838910289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f680c0bc8b0 0x7f680c148620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.441+0000 7f681347d700 1 -- 172.21.15.156:0/838910289 >> 172.21.15.156:0/838910289 conn(0x7f680c071ee0 msgr2=0x7f680c066490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:24.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.441+0000 7f681347d700 1 -- 172.21.15.156:0/838910289 shutdown_connections 2023-11-30T23:12:24.477 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.441+0000 7f681347d700 1 -- 172.21.15.156:0/838910289 wait complete. 2023-11-30T23:12:24.477 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new d0922b0e-5170-474d-b270-ddb5adc858cc 4 2023-11-30T23:12:24.499 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:24.495+0000 7f293bb3d2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T23:12:24.548 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:24.543+0000 7f293bb3d2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T23:12:24.552 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:24.549+0000 7fe5fc4f72c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-30T23:12:24.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.585+0000 7fc14f59e700 1 Processor -- start 2023-11-30T23:12:24.590 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.585+0000 7fc14f59e700 1 -- start start 2023-11-30T23:12:24.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14f59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1500b8050 0x7fc1500710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14f59e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc1500715f0 0x7fc150140330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14f59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc150147470 con 0x7fc15006f440 2023-11-30T23:12:24.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14f59e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc150071a80 con 0x7fc1500715f0 2023-11-30T23:12:24.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14f59e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15006f820 con 0x7fc1500b8050 2023-11-30T23:12:24.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14dd9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1500b8050 0x7fc1500710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14ed9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc1500715f0 0x7fc150140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14dd9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1500b8050 0x7fc1500710b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53806/0 (socket says 172.21.15.156:53806) 2023-11-30T23:12:24.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14dd9b700 1 -- 172.21.15.156:0/3451904863 learned_addr learned my addr 172.21.15.156:0/3451904863 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-30T23:12:24.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14dd9b700 1 -- 172.21.15.156:0/3451904863 >> v2:172.21.15.156:3300/0 conn(0x7fc1500715f0 msgr2=0x7fc150140330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:24.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14dd9b700 1 --2- 172.21.15.156:0/3451904863 >> v2:172.21.15.156:3300/0 conn(0x7fc1500715f0 0x7fc150140330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14dd9b700 1 -- 172.21.15.156:0/3451904863 >> v1:172.21.15.73:6789/0 conn(0x7fc15006f440 legacy=0x7fc150146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14dd9b700 1 -- 172.21.15.156:0/3451904863 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc150146e20 con 0x7fc1500b8050 2023-11-30T23:12:24.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14dd9b700 1 --2- 172.21.15.156:0/3451904863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1500b8050 0x7fc1500710b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc144009910 tx=0x7fc144009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e994f9c540e3c3ad server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:24.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14d59a700 1 -- 172.21.15.156:0/3451904863 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc144011830 con 0x7fc1500b8050 2023-11-30T23:12:24.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14d59a700 1 -- 172.21.15.156:0/3451904863 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc144011990 con 0x7fc1500b8050 2023-11-30T23:12:24.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14d59a700 1 -- 172.21.15.156:0/3451904863 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc144011d40 con 0x7fc1500b8050 2023-11-30T23:12:24.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14f59e700 1 -- 172.21.15.156:0/3451904863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1500b8050 msgr2=0x7fc1500710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14f59e700 1 --2- 172.21.15.156:0/3451904863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1500b8050 0x7fc1500710b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc144009910 tx=0x7fc144009c20 comp rx=0 tx=0).stop 2023-11-30T23:12:24.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14f59e700 1 -- 172.21.15.156:0/3451904863 shutdown_connections 2023-11-30T23:12:24.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14f59e700 1 --2- 172.21.15.156:0/3451904863 >> v2:172.21.15.156:3300/0 conn(0x7fc1500715f0 0x7fc150140330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14f59e700 1 --2- 172.21.15.156:0/3451904863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1500b8050 0x7fc1500710b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14f59e700 1 -- 172.21.15.156:0/3451904863 >> 172.21.15.156:0/3451904863 conn(0x7fc1500b8c60 msgr2=0x7fc1500b9070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:24.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14f59e700 1 -- 172.21.15.156:0/3451904863 shutdown_connections 2023-11-30T23:12:24.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.589+0000 7fc14f59e700 1 -- 172.21.15.156:0/3451904863 wait complete. 2023-11-30T23:12:24.595 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14f59e700 1 Processor -- start 2023-11-30T23:12:24.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14f59e700 1 -- start start 2023-11-30T23:12:24.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14f59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc15006f440 0x7fc1500aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14f59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1500715f0 0x7fc1500b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.596 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14f59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1500b8050 0x7fc1500af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14f59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1500b0f30 con 0x7fc15006f440 2023-11-30T23:12:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14f59e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1500b0880 con 0x7fc1500b8050 2023-11-30T23:12:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14f59e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1501442d0 con 0x7fc1500715f0 2023-11-30T23:12:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14ed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1500b8050 0x7fc1500af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14dd9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1500715f0 0x7fc1500b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14ed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1500b8050 0x7fc1500af1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:50382/0 (socket says 172.21.15.156:50382) 2023-11-30T23:12:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14ed9d700 1 -- 172.21.15.156:0/1894206184 learned_addr learned my addr 172.21.15.156:0/1894206184 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-30T23:12:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14e59c700 1 --2- 172.21.15.156:0/1894206184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc15006f440 0x7fc1500aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.598 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14ed9d700 1 -- 172.21.15.156:0/1894206184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1500715f0 msgr2=0x7fc1500b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14ed9d700 1 --2- 172.21.15.156:0/1894206184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1500715f0 0x7fc1500b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14ed9d700 1 -- 172.21.15.156:0/1894206184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc15006f440 msgr2=0x7fc1500aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14ed9d700 1 --2- 172.21.15.156:0/1894206184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc15006f440 0x7fc1500aff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14ed9d700 1 -- 172.21.15.156:0/1894206184 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc144009570 con 0x7fc1500b8050 2023-11-30T23:12:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14e59c700 1 --2- 172.21.15.156:0/1894206184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc15006f440 0x7fc1500aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:12:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14ed9d700 1 --2- 172.21.15.156:0/1894206184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1500b8050 0x7fc1500af1e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc14800eb60 tx=0x7fc14800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc13effd700 1 -- 172.21.15.156:0/1894206184 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc148009740 con 0x7fc1500b8050 2023-11-30T23:12:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc13effd700 1 -- 172.21.15.156:0/1894206184 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14800c850 con 0x7fc1500b8050 2023-11-30T23:12:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14f59e700 1 -- 172.21.15.156:0/1894206184 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1501dc030 con 0x7fc1500b8050 2023-11-30T23:12:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc13effd700 1 -- 172.21.15.156:0/1894206184 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14800cbe0 con 0x7fc1500b8050 2023-11-30T23:12:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14f59e700 1 -- 172.21.15.156:0/1894206184 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1500af720 con 0x7fc1500b8050 2023-11-30T23:12:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc13effd700 1 -- 172.21.15.156:0/1894206184 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc148005a40 con 0x7fc1500b8050 2023-11-30T23:12:24.599 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc13effd700 1 -- 172.21.15.156:0/1894206184 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc148006840 con 0x7fc1500b8050 2023-11-30T23:12:24.600 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.593+0000 7fc14f59e700 1 -- 172.21.15.156:0/1894206184 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1500b06e0 con 0x7fc1500b8050 2023-11-30T23:12:24.601 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.597+0000 7fc13effd700 1 -- 172.21.15.156:0/1894206184 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fc1500b06e0 con 0x7fc1500b8050 2023-11-30T23:12:24.603 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:24.597+0000 7fe5fc4f72c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-30T23:12:24.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.669+0000 7fc14f59e700 1 -- 172.21.15.156:0/1894206184 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d0922b0e-5170-474d-b270-ddb5adc858cc", "id": 4} v 0) v1 -- 0x7fc1500b10a0 con 0x7fc1500b8050 2023-11-30T23:12:24.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.677+0000 7fc13effd700 1 -- 172.21.15.156:0/1894206184 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d0922b0e-5170-474d-b270-ddb5adc858cc", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc148021060 con 0x7fc1500b8050 2023-11-30T23:12:24.682 INFO:teuthology.orchestra.run.smithi156.stdout:4 2023-11-30T23:12:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.677+0000 7fc14f59e700 1 -- 172.21.15.156:0/1894206184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1500b8050 msgr2=0x7fc1500af1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.677+0000 7fc14f59e700 1 --2- 172.21.15.156:0/1894206184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1500b8050 0x7fc1500af1e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc14800eb60 tx=0x7fc14800ee70 comp rx=0 tx=0).stop 2023-11-30T23:12:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.677+0000 7fc14f59e700 1 -- 172.21.15.156:0/1894206184 shutdown_connections 2023-11-30T23:12:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.677+0000 7fc14f59e700 1 --2- 172.21.15.156:0/1894206184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1500b8050 0x7fc1500af1e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.677+0000 7fc14f59e700 1 --2- 172.21.15.156:0/1894206184 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc1500715f0 0x7fc1500b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.677+0000 7fc14f59e700 1 --2- 172.21.15.156:0/1894206184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc15006f440 0x7fc1500aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.677+0000 7fc14f59e700 1 -- 172.21.15.156:0/1894206184 >> 172.21.15.156:0/1894206184 conn(0x7fc1500b8c60 msgr2=0x7fc1500b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:24.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.677+0000 7fc14f59e700 1 -- 172.21.15.156:0/1894206184 shutdown_connections 2023-11-30T23:12:24.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.677+0000 7fc14f59e700 1 -- 172.21.15.156:0/1894206184 wait complete. 2023-11-30T23:12:24.698 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new f2791a77-db25-479c-95d5-ea7f77458685 5 2023-11-30T23:12:24.728 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:24.723+0000 7f293bb3d2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T23:12:24.779 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:24.773+0000 7fe5fc4f72c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-30T23:12:24.790 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:24.787+0000 7f293bb3d2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-30T23:12:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.805+0000 7fdcf3fff700 1 Processor -- start 2023-11-30T23:12:24.809 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.805+0000 7fdcf3fff700 1 -- start start 2023-11-30T23:12:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.805+0000 7fdcf3fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdcf40aef60 0x7fdcf414e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.805+0000 7fdcf3fff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf40b2750 con 0x7fdcf406aee0 2023-11-30T23:12:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.805+0000 7fdcf3fff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf40afd40 con 0x7fdcf40b1470 2023-11-30T23:12:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.805+0000 7fdcf3fff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf413d370 con 0x7fdcf40aef60 2023-11-30T23:12:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.805+0000 7fdcf27fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fdcf40b1470 0x7fdcf40ae850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37434/0 (socket says 172.21.15.156:37434) 2023-11-30T23:12:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.805+0000 7fdcf27fc700 1 -- 172.21.15.156:0/3876337725 learned_addr learned my addr 172.21.15.156:0/3876337725 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-11-30T23:12:24.810 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.805+0000 7fdcf37fe700 1 --2- 172.21.15.156:0/3876337725 >> v2:172.21.15.73:3300/0 conn(0x7fdcf40aef60 0x7fdcf414e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.805+0000 7fdcf1ffb700 1 -- 172.21.15.156:0/3876337725 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226889855 0 0) 0x7fdcf40afd40 con 0x7fdcf40b1470 2023-11-30T23:12:24.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.805+0000 7fdcf1ffb700 1 -- 172.21.15.156:0/3876337725 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcdc0035d0 con 0x7fdcf40b1470 2023-11-30T23:12:24.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.805+0000 7fdcf37fe700 1 -- 172.21.15.156:0/3876337725 >> v1:172.21.15.156:6789/0 conn(0x7fdcf40b1470 legacy=0x7fdcf40ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.805+0000 7fdcf37fe700 1 -- 172.21.15.156:0/3876337725 >> v1:172.21.15.73:6789/0 conn(0x7fdcf406aee0 legacy=0x7fdcf413cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.805+0000 7fdcf37fe700 1 -- 172.21.15.156:0/3876337725 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf406b2c0 con 0x7fdcf40aef60 2023-11-30T23:12:24.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.805+0000 7fdcf37fe700 1 --2- 172.21.15.156:0/3876337725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcf40aef60 0x7fdcf414e400 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00aea0 tx=0x7fdcec00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc045b6f342941b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:24.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf1ffb700 1 -- 172.21.15.156:0/3876337725 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec00cb10 con 0x7fdcf40aef60 2023-11-30T23:12:24.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf1ffb700 1 -- 172.21.15.156:0/3876337725 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec00cc70 con 0x7fdcf40aef60 2023-11-30T23:12:24.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf1ffb700 1 -- 172.21.15.156:0/3876337725 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec00a2e0 con 0x7fdcf40aef60 2023-11-30T23:12:24.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf3fff700 1 -- 172.21.15.156:0/3876337725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcf40aef60 msgr2=0x7fdcf414e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.812 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf3fff700 1 --2- 172.21.15.156:0/3876337725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcf40aef60 0x7fdcf414e400 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00aea0 tx=0x7fdcec00c330 comp rx=0 tx=0).stop 2023-11-30T23:12:24.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf3fff700 1 -- 172.21.15.156:0/3876337725 shutdown_connections 2023-11-30T23:12:24.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf3fff700 1 --2- 172.21.15.156:0/3876337725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcf40aef60 0x7fdcf414e400 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf3fff700 1 -- 172.21.15.156:0/3876337725 >> 172.21.15.156:0/3876337725 conn(0x7fdcf406a180 msgr2=0x7fdcf406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:24.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf3fff700 1 -- 172.21.15.156:0/3876337725 shutdown_connections 2023-11-30T23:12:24.813 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf3fff700 1 -- 172.21.15.156:0/3876337725 wait complete. 2023-11-30T23:12:24.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf3fff700 1 Processor -- start 2023-11-30T23:12:24.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf3fff700 1 -- start start 2023-11-30T23:12:24.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf3fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdcf406aee0 0x7fdcf413e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcf40aef60 0x7fdcf41448d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcf40b1470 0x7fdcf41db730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:24.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf3fff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf41db2e0 con 0x7fdcf40b1470 2023-11-30T23:12:24.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf3fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf4145480 con 0x7fdcf40aef60 2023-11-30T23:12:24.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf3fff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf413ef40 con 0x7fdcf406aee0 2023-11-30T23:12:24.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdcf406aee0 0x7fdcf413e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.815 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf2ffd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdcf406aee0 0x7fdcf413e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53824/0 (socket says 172.21.15.156:53824) 2023-11-30T23:12:24.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf2ffd700 1 -- 172.21.15.156:0/1316334070 learned_addr learned my addr 172.21.15.156:0/1316334070 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-30T23:12:24.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf27fc700 1 --2- 172.21.15.156:0/1316334070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcf40aef60 0x7fdcf41448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf37fe700 1 --2- 172.21.15.156:0/1316334070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcf40b1470 0x7fdcf41db730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:24.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf2ffd700 1 -- 172.21.15.156:0/1316334070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcf40aef60 msgr2=0x7fdcf41448d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf2ffd700 1 --2- 172.21.15.156:0/1316334070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcf40aef60 0x7fdcf41448d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf2ffd700 1 -- 172.21.15.156:0/1316334070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcf40b1470 msgr2=0x7fdcf41db730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf2ffd700 1 --2- 172.21.15.156:0/1316334070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcf40b1470 0x7fdcf41db730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf2ffd700 1 -- 172.21.15.156:0/1316334070 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcec00ab80 con 0x7fdcf406aee0 2023-11-30T23:12:24.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf37fe700 1 --2- 172.21.15.156:0/1316334070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcf40b1470 0x7fdcf41db730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:12:24.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf2ffd700 1 --2- 172.21.15.156:0/1316334070 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdcf406aee0 0x7fdcf413e0f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdce400c540 tx=0x7fdce400c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:24.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcdb7fe700 1 -- 172.21.15.156:0/1316334070 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40052d0 con 0x7fdcf406aee0 2023-11-30T23:12:24.816 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcdb7fe700 1 -- 172.21.15.156:0/1316334070 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce4005430 con 0x7fdcf406aee0 2023-11-30T23:12:24.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf3fff700 1 -- 172.21.15.156:0/1316334070 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf413e830 con 0x7fdcf406aee0 2023-11-30T23:12:24.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcdb7fe700 1 -- 172.21.15.156:0/1316334070 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40055a0 con 0x7fdcf406aee0 2023-11-30T23:12:24.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcf3fff700 1 -- 172.21.15.156:0/1316334070 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf40b8080 con 0x7fdcf406aee0 2023-11-30T23:12:24.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcdb7fe700 1 -- 172.21.15.156:0/1316334070 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdce4003c00 con 0x7fdcf406aee0 2023-11-30T23:12:24.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.809+0000 7fdcdb7fe700 1 -- 172.21.15.156:0/1316334070 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fdce4011db0 con 0x7fdcf406aee0 2023-11-30T23:12:24.817 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.813+0000 7fdcf3fff700 1 -- 172.21.15.156:0/1316334070 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf4144ff0 con 0x7fdcf406aee0 2023-11-30T23:12:24.819 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.813+0000 7fdcdb7fe700 1 -- 172.21.15.156:0/1316334070 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fdce4017070 con 0x7fdcf406aee0 2023-11-30T23:12:24.841 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:24.837+0000 7fe5fc4f72c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-30T23:12:24.853 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:24.847+0000 7f293bb3d2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T23:12:24.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.889+0000 7fdcf3fff700 1 -- 172.21.15.156:0/1316334070 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f2791a77-db25-479c-95d5-ea7f77458685", "id": 5} v 0) v1 -- 0x7fdcf40681c0 con 0x7fdcf406aee0 2023-11-30T23:12:24.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.897+0000 7fdcdb7fe700 1 -- 172.21.15.156:0/1316334070 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f2791a77-db25-479c-95d5-ea7f77458685", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdce4011590 con 0x7fdcf406aee0 2023-11-30T23:12:24.901 INFO:teuthology.orchestra.run.smithi156.stdout:5 2023-11-30T23:12:24.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.897+0000 7fdcf3fff700 1 -- 172.21.15.156:0/1316334070 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdcf406aee0 msgr2=0x7fdcf413e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:24.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.897+0000 7fdcf3fff700 1 --2- 172.21.15.156:0/1316334070 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdcf406aee0 0x7fdcf413e0f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdce400c540 tx=0x7fdce400c900 comp rx=0 tx=0).stop 2023-11-30T23:12:24.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.897+0000 7fdcf3fff700 1 -- 172.21.15.156:0/1316334070 shutdown_connections 2023-11-30T23:12:24.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.897+0000 7fdcf3fff700 1 --2- 172.21.15.156:0/1316334070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcf40b1470 0x7fdcf41db730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.897+0000 7fdcf3fff700 1 --2- 172.21.15.156:0/1316334070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcf40aef60 0x7fdcf41448d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.897+0000 7fdcf3fff700 1 --2- 172.21.15.156:0/1316334070 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdcf406aee0 0x7fdcf413e0f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:24.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.897+0000 7fdcf3fff700 1 -- 172.21.15.156:0/1316334070 >> 172.21.15.156:0/1316334070 conn(0x7fdcf406a180 msgr2=0x7fdcf4138880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:24.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.897+0000 7fdcf3fff700 1 -- 172.21.15.156:0/1316334070 shutdown_connections 2023-11-30T23:12:24.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:24.897+0000 7fdcf3fff700 1 -- 172.21.15.156:0/1316334070 wait complete. 2023-11-30T23:12:24.905 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:24.901+0000 7fe5fc4f72c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-30T23:12:24.913 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new f86c2fe9-ec8b-406e-af26-5dc65c926382 6 2023-11-30T23:12:25.018 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.013+0000 7f3394e3a700 1 Processor -- start 2023-11-30T23:12:25.019 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.013+0000 7f3394e3a700 1 -- start start 2023-11-30T23:12:25.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f3394e3a700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33900b7180 0x7f33900b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:25.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f3394e3a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3390144e20 0x7f33900b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:25.020 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f3394e3a700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33900b2060 con 0x7f33900b6440 2023-11-30T23:12:25.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f3394e3a700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33900b7560 con 0x7f33900b7180 2023-11-30T23:12:25.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f3394e3a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33900b1d80 con 0x7f3390144e20 2023-11-30T23:12:25.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f338e59c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33900b7180 0x7f33900b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:25.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f338dd9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f33900b6440 0x7f3390144710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37448/0 (socket says 172.21.15.156:37448) 2023-11-30T23:12:25.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f338ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3390144e20 0x7f33900b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:25.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f338dd9b700 1 -- 172.21.15.156:0/1356792459 learned_addr learned my addr 172.21.15.156:0/1356792459 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-11-30T23:12:25.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f338d59a700 1 -- 172.21.15.156:0/1356792459 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720831715 0 0) 0x7f33900b2060 con 0x7f33900b6440 2023-11-30T23:12:25.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f338d59a700 1 -- 172.21.15.156:0/1356792459 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33780035d0 con 0x7f33900b6440 2023-11-30T23:12:25.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f338ed9d700 1 -- 172.21.15.156:0/1356792459 >> v2:172.21.15.156:3300/0 conn(0x7f33900b7180 msgr2=0x7f33900b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:25.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f338ed9d700 1 --2- 172.21.15.156:0/1356792459 >> v2:172.21.15.156:3300/0 conn(0x7f33900b7180 0x7f33900b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f338ed9d700 1 -- 172.21.15.156:0/1356792459 >> v1:172.21.15.156:6789/0 conn(0x7f33900b6440 legacy=0x7f3390144710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:25.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f338ed9d700 1 -- 172.21.15.156:0/1356792459 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33900b4e90 con 0x7f3390144e20 2023-11-30T23:12:25.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f338ed9d700 1 --2- 172.21.15.156:0/1356792459 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3390144e20 0x7f33900b4030 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3388009d90 tx=0x7f338800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76b666f3276a1ee7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:25.021 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f338d59a700 1 -- 172.21.15.156:0/1356792459 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338800e070 con 0x7f3390144e20 2023-11-30T23:12:25.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f338d59a700 1 -- 172.21.15.156:0/1356792459 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338800bb20 con 0x7f3390144e20 2023-11-30T23:12:25.022 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f338d59a700 1 -- 172.21.15.156:0/1356792459 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388012430 con 0x7f3390144e20 2023-11-30T23:12:25.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f3394e3a700 1 -- 172.21.15.156:0/1356792459 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3390144e20 msgr2=0x7f33900b4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:25.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f3394e3a700 1 --2- 172.21.15.156:0/1356792459 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3390144e20 0x7f33900b4030 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3388009d90 tx=0x7f338800b330 comp rx=0 tx=0).stop 2023-11-30T23:12:25.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f3394e3a700 1 -- 172.21.15.156:0/1356792459 shutdown_connections 2023-11-30T23:12:25.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f3394e3a700 1 --2- 172.21.15.156:0/1356792459 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3390144e20 0x7f33900b4030 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f3394e3a700 1 --2- 172.21.15.156:0/1356792459 >> v2:172.21.15.156:3300/0 conn(0x7f33900b7180 0x7f33900b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f3394e3a700 1 -- 172.21.15.156:0/1356792459 >> 172.21.15.156:0/1356792459 conn(0x7f339006a5a0 msgr2=0x7f339006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:25.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f3394e3a700 1 -- 172.21.15.156:0/1356792459 shutdown_connections 2023-11-30T23:12:25.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f3394e3a700 1 -- 172.21.15.156:0/1356792459 wait complete. 2023-11-30T23:12:25.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f3394e3a700 1 Processor -- start 2023-11-30T23:12:25.023 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.017+0000 7f3394e3a700 1 -- start start 2023-11-30T23:12:25.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f3394e3a700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33900b6440 0x7f339013c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:25.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f3394e3a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33900b7180 0x7f33901dd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:25.025 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f3394e3a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3390144e20 0x7f339013ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f3394e3a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339013cdc0 con 0x7f33900b7180 2023-11-30T23:12:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f3394e3a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33901cc7d0 con 0x7f3390144e20 2023-11-30T23:12:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f3394e3a700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33901413c0 con 0x7f33900b6440 2023-11-30T23:12:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f338e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33900b6440 0x7f339013c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f338ed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3390144e20 0x7f339013ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f338e59c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33900b6440 0x7f339013c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53838/0 (socket says 172.21.15.156:53838) 2023-11-30T23:12:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f338e59c700 1 -- 172.21.15.156:0/906827963 learned_addr learned my addr 172.21.15.156:0/906827963 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-30T23:12:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f338dd9b700 1 --2- 172.21.15.156:0/906827963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33900b7180 0x7f33901dd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f338ed9d700 1 -- 172.21.15.156:0/906827963 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33900b6440 msgr2=0x7f339013c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f338ed9d700 1 --2- 172.21.15.156:0/906827963 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33900b6440 0x7f339013c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f338ed9d700 1 -- 172.21.15.156:0/906827963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33900b7180 msgr2=0x7f33901dd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f338ed9d700 1 --2- 172.21.15.156:0/906827963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33900b7180 0x7f33901dd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f338ed9d700 1 -- 172.21.15.156:0/906827963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3388009a70 con 0x7f3390144e20 2023-11-30T23:12:25.026 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f338ed9d700 1 --2- 172.21.15.156:0/906827963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3390144e20 0x7f339013ffd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3388016000 tx=0x7f3388004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:25.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f337effd700 1 -- 172.21.15.156:0/906827963 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388003c40 con 0x7f3390144e20 2023-11-30T23:12:25.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f337effd700 1 -- 172.21.15.156:0/906827963 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3388020070 con 0x7f3390144e20 2023-11-30T23:12:25.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f3394e3a700 1 -- 172.21.15.156:0/906827963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33901dd0e0 con 0x7f3390144e20 2023-11-30T23:12:25.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f337effd700 1 -- 172.21.15.156:0/906827963 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388012430 con 0x7f3390144e20 2023-11-30T23:12:25.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f3394e3a700 1 -- 172.21.15.156:0/906827963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33901ddb10 con 0x7f3390144e20 2023-11-30T23:12:25.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f337effd700 1 -- 172.21.15.156:0/906827963 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f338801b610 con 0x7f3390144e20 2023-11-30T23:12:25.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f337effd700 1 -- 172.21.15.156:0/906827963 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f3388022070 con 0x7f3390144e20 2023-11-30T23:12:25.027 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.021+0000 7f3394e3a700 1 -- 172.21.15.156:0/906827963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3390141500 con 0x7f3390144e20 2023-11-30T23:12:25.029 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.025+0000 7f337effd700 1 -- 172.21.15.156:0/906827963 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f338802b060 con 0x7f3390144e20 2023-11-30T23:12:25.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.097+0000 7f3394e3a700 1 -- 172.21.15.156:0/906827963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f86c2fe9-ec8b-406e-af26-5dc65c926382", "id": 6} v 0) v1 -- 0x7f33901dd270 con 0x7f3390144e20 2023-11-30T23:12:25.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.109+0000 7f337effd700 1 -- 172.21.15.156:0/906827963 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f86c2fe9-ec8b-406e-af26-5dc65c926382", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f338801b8c0 con 0x7f3390144e20 2023-11-30T23:12:25.113 INFO:teuthology.orchestra.run.smithi156.stdout:6 2023-11-30T23:12:25.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.113+0000 7f3394e3a700 1 -- 172.21.15.156:0/906827963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3390144e20 msgr2=0x7f339013ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:25.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.113+0000 7f3394e3a700 1 --2- 172.21.15.156:0/906827963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3390144e20 0x7f339013ffd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3388016000 tx=0x7f3388004af0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.113+0000 7f3394e3a700 1 -- 172.21.15.156:0/906827963 shutdown_connections 2023-11-30T23:12:25.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.113+0000 7f3394e3a700 1 --2- 172.21.15.156:0/906827963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3390144e20 0x7f339013ffd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.113+0000 7f3394e3a700 1 --2- 172.21.15.156:0/906827963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33900b7180 0x7f33901dd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.113+0000 7f3394e3a700 1 --2- 172.21.15.156:0/906827963 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f33900b6440 0x7f339013c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.113+0000 7f3394e3a700 1 -- 172.21.15.156:0/906827963 >> 172.21.15.156:0/906827963 conn(0x7f339006a5a0 msgr2=0x7f33900b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:25.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.113+0000 7f3394e3a700 1 -- 172.21.15.156:0/906827963 shutdown_connections 2023-11-30T23:12:25.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.113+0000 7f3394e3a700 1 -- 172.21.15.156:0/906827963 wait complete. 2023-11-30T23:12:25.131 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8 7 2023-11-30T23:12:25.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.233+0000 7fad9efe7700 1 Processor -- start 2023-11-30T23:12:25.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9efe7700 1 -- start start 2023-11-30T23:12:25.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9efe7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fad98144cd0 0x7fad9813e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:25.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9efe7700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad980b63a0 0x7fad9813e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:25.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9efe7700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad980b4fb0 con 0x7fad980b6e00 2023-11-30T23:12:25.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9efe7700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad980b5200 con 0x7fad98144cd0 2023-11-30T23:12:25.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9efe7700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad980b0eb0 con 0x7fad980b63a0 2023-11-30T23:12:25.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9e7e6700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad980b63a0 0x7fad9813e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:25.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9dfe5700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fad980b6e00 0x7fad981445c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:37452/0 (socket says 172.21.15.156:37452) 2023-11-30T23:12:25.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9dfe5700 1 -- 172.21.15.156:0/3041464980 learned_addr learned my addr 172.21.15.156:0/3041464980 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-11-30T23:12:25.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9d7e4700 1 --2- 172.21.15.156:0/3041464980 >> v2:172.21.15.73:3300/0 conn(0x7fad98144cd0 0x7fad9813e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:25.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9e7e6700 1 -- 172.21.15.156:0/3041464980 >> v2:172.21.15.73:3300/0 conn(0x7fad98144cd0 msgr2=0x7fad9813e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:25.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9e7e6700 1 --2- 172.21.15.156:0/3041464980 >> v2:172.21.15.73:3300/0 conn(0x7fad98144cd0 0x7fad9813e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9e7e6700 1 -- 172.21.15.156:0/3041464980 >> v1:172.21.15.156:6789/0 conn(0x7fad980b6e00 legacy=0x7fad981445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:25.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9cfe3700 1 -- 172.21.15.156:0/3041464980 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746839120 0 0) 0x7fad980b4fb0 con 0x7fad980b6e00 2023-11-30T23:12:25.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9e7e6700 1 -- 172.21.15.156:0/3041464980 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad980b71e0 con 0x7fad980b63a0 2023-11-30T23:12:25.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9e7e6700 1 --2- 172.21.15.156:0/3041464980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad980b63a0 0x7fad9813e910 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fad9806b0f0 tx=0x7fad9000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c41b28ee95cf3a16 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:25.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9cfe3700 1 -- 172.21.15.156:0/3041464980 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9000e070 con 0x7fad980b63a0 2023-11-30T23:12:25.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9cfe3700 1 -- 172.21.15.156:0/3041464980 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9000bbd0 con 0x7fad980b63a0 2023-11-30T23:12:25.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9cfe3700 1 -- 172.21.15.156:0/3041464980 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad90012430 con 0x7fad980b63a0 2023-11-30T23:12:25.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9efe7700 1 -- 172.21.15.156:0/3041464980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad980b63a0 msgr2=0x7fad9813e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:25.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9efe7700 1 --2- 172.21.15.156:0/3041464980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad980b63a0 0x7fad9813e910 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fad9806b0f0 tx=0x7fad9000b330 comp rx=0 tx=0).stop 2023-11-30T23:12:25.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9efe7700 1 -- 172.21.15.156:0/3041464980 shutdown_connections 2023-11-30T23:12:25.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9efe7700 1 --2- 172.21.15.156:0/3041464980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad980b63a0 0x7fad9813e910 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9efe7700 1 --2- 172.21.15.156:0/3041464980 >> v2:172.21.15.73:3300/0 conn(0x7fad98144cd0 0x7fad9813e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9efe7700 1 -- 172.21.15.156:0/3041464980 >> 172.21.15.156:0/3041464980 conn(0x7fad9806a360 msgr2=0x7fad9806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:25.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9efe7700 1 -- 172.21.15.156:0/3041464980 shutdown_connections 2023-11-30T23:12:25.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.237+0000 7fad9efe7700 1 -- 172.21.15.156:0/3041464980 wait complete. 2023-11-30T23:12:25.246 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9efe7700 1 Processor -- start 2023-11-30T23:12:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9efe7700 1 -- start start 2023-11-30T23:12:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9efe7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad980b63a0 0x7fad980a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9efe7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad980b6e00 0x7fad981d9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9efe7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad981d9cd0 0x7fad981dca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9efe7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad980aa920 con 0x7fad980b63a0 2023-11-30T23:12:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9efe7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad980a8e80 con 0x7fad981d9cd0 2023-11-30T23:12:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9efe7700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad980a9070 con 0x7fad980b6e00 2023-11-30T23:12:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9e7e6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad981d9cd0 0x7fad981dca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9d7e4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad980b6e00 0x7fad981d9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9d7e4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad980b6e00 0x7fad981d9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.156:53848/0 (socket says 172.21.15.156:53848) 2023-11-30T23:12:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9d7e4700 1 -- 172.21.15.156:0/2390079966 learned_addr learned my addr 172.21.15.156:0/2390079966 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-30T23:12:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9dfe5700 1 --2- 172.21.15.156:0/2390079966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad980b63a0 0x7fad980a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:25.247 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9e7e6700 1 -- 172.21.15.156:0/2390079966 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad980b6e00 msgr2=0x7fad981d9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:25.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9e7e6700 1 --2- 172.21.15.156:0/2390079966 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad980b6e00 0x7fad981d9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9e7e6700 1 -- 172.21.15.156:0/2390079966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad980b63a0 msgr2=0x7fad980a9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:25.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9e7e6700 1 --2- 172.21.15.156:0/2390079966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad980b63a0 0x7fad980a9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9e7e6700 1 -- 172.21.15.156:0/2390079966 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad90009a70 con 0x7fad981d9cd0 2023-11-30T23:12:25.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9d7e4700 1 --2- 172.21.15.156:0/2390079966 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad980b6e00 0x7fad981d9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:25.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9e7e6700 1 --2- 172.21.15.156:0/2390079966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad981d9cd0 0x7fad981dca20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad90016000 tx=0x7fad90004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:25.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad8a7fc700 1 -- 172.21.15.156:0/2390079966 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad90012430 con 0x7fad981d9cd0 2023-11-30T23:12:25.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad8a7fc700 1 -- 172.21.15.156:0/2390079966 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad90020070 con 0x7fad981d9cd0 2023-11-30T23:12:25.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad8a7fc700 1 -- 172.21.15.156:0/2390079966 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad90004280 con 0x7fad981d9cd0 2023-11-30T23:12:25.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9efe7700 1 -- 172.21.15.156:0/2390079966 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad980a9670 con 0x7fad981d9cd0 2023-11-30T23:12:25.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad9efe7700 1 -- 172.21.15.156:0/2390079966 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad98142290 con 0x7fad981d9cd0 2023-11-30T23:12:25.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad8a7fc700 1 -- 172.21.15.156:0/2390079966 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fad900046e0 con 0x7fad981d9cd0 2023-11-30T23:12:25.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.241+0000 7fad8a7fc700 1 -- 172.21.15.156:0/2390079966 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fad90022070 con 0x7fad981d9cd0 2023-11-30T23:12:25.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.245+0000 7fad9efe7700 1 -- 172.21.15.156:0/2390079966 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad980a9860 con 0x7fad981d9cd0 2023-11-30T23:12:25.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.245+0000 7fad8a7fc700 1 -- 172.21.15.156:0/2390079966 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fad9002c060 con 0x7fad981d9cd0 2023-11-30T23:12:25.266 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:25.263+0000 7f293bb3d2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-30T23:12:25.324 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:25.321+0000 7fe5fc4f72c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-30T23:12:25.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.321+0000 7fad9efe7700 1 -- 172.21.15.156:0/2390079966 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8", "id": 7} v 0) v1 -- 0x7fad980681c0 con 0x7fad981d9cd0 2023-11-30T23:12:25.334 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.329+0000 7fad8a7fc700 1 -- 172.21.15.156:0/2390079966 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fad90027480 con 0x7fad981d9cd0 2023-11-30T23:12:25.334 INFO:teuthology.orchestra.run.smithi156.stdout:7 2023-11-30T23:12:25.335 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.333+0000 7fad9efe7700 1 -- 172.21.15.156:0/2390079966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad981d9cd0 msgr2=0x7fad981dca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:25.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.333+0000 7fad9efe7700 1 --2- 172.21.15.156:0/2390079966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad981d9cd0 0x7fad981dca20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad90016000 tx=0x7fad90004af0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.333+0000 7fad9efe7700 1 -- 172.21.15.156:0/2390079966 shutdown_connections 2023-11-30T23:12:25.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.333+0000 7fad9efe7700 1 --2- 172.21.15.156:0/2390079966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad981d9cd0 0x7fad981dca20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.333+0000 7fad9efe7700 1 --2- 172.21.15.156:0/2390079966 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fad980b6e00 0x7fad981d9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.333+0000 7fad9efe7700 1 --2- 172.21.15.156:0/2390079966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad980b63a0 0x7fad980a9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.333+0000 7fad9efe7700 1 -- 172.21.15.156:0/2390079966 >> 172.21.15.156:0/2390079966 conn(0x7fad9806a360 msgr2=0x7fad9813be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:25.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.333+0000 7fad9efe7700 1 -- 172.21.15.156:0/2390079966 shutdown_connections 2023-11-30T23:12:25.336 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-30T23:12:25.333+0000 7fad9efe7700 1 -- 172.21.15.156:0/2390079966 wait complete. 2023-11-30T23:12:25.348 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-30T23:12:25.348 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-30T23:12:25.350 INFO:tasks.ceph.osd.0:Started 2023-11-30T23:12:25.350 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-30T23:12:25.350 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-30T23:12:25.357 INFO:tasks.ceph.osd.1:Started 2023-11-30T23:12:25.357 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-30T23:12:25.357 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-30T23:12:25.359 INFO:tasks.ceph.osd.2:Started 2023-11-30T23:12:25.360 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-30T23:12:25.360 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-30T23:12:25.361 INFO:tasks.ceph.osd.3:Started 2023-11-30T23:12:25.361 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-30T23:12:25.362 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-30T23:12:25.363 INFO:tasks.ceph.osd.4:Started 2023-11-30T23:12:25.364 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-30T23:12:25.364 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-30T23:12:25.366 INFO:tasks.ceph.osd.5:Started 2023-11-30T23:12:25.366 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-30T23:12:25.366 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-30T23:12:25.368 INFO:tasks.ceph.osd.6:Started 2023-11-30T23:12:25.368 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-30T23:12:25.368 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-30T23:12:25.371 INFO:tasks.ceph.osd.7:Started 2023-11-30T23:12:25.371 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T23:12:25.402 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:25.399+0000 7f293bb3d2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T23:12:25.458 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:25.453+0000 7fe5fc4f72c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-30T23:12:25.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.467+0000 7fc54cebb700 1 Processor -- start 2023-11-30T23:12:25.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc54cebb700 1 -- start start 2023-11-30T23:12:25.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc54cebb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc5480b2710 0x7fc5480b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:25.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc54cebb700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc548146cc0 con 0x7fc548143250 2023-11-30T23:12:25.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc54cebb700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5480b1fe0 con 0x7fc5480aefa0 2023-11-30T23:12:25.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc54cebb700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5480b1dc0 con 0x7fc5480b2710 2023-11-30T23:12:25.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc5477fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc5480b2710 0x7fc5480b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:25.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc547fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc548143250 0x7fc5481436c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50262/0 (socket says 172.21.15.73:50262) 2023-11-30T23:12:25.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc547fff700 1 -- 172.21.15.73:0/3562926248 learned_addr learned my addr 172.21.15.73:0/3562926248 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:25.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc5477fe700 1 -- 172.21.15.73:0/3562926248 >> v1:172.21.15.156:6789/0 conn(0x7fc5480aefa0 legacy=0x7fc548147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:25.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc5477fe700 1 -- 172.21.15.73:0/3562926248 >> v1:172.21.15.73:6789/0 conn(0x7fc548143250 legacy=0x7fc5481436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:25.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc5477fe700 1 -- 172.21.15.73:0/3562926248 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54806f280 con 0x7fc5480b2710 2023-11-30T23:12:25.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc5467fc700 1 -- 172.21.15.73:0/3562926248 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319562461 0 0) 0x7fc548146cc0 con 0x7fc548143250 2023-11-30T23:12:25.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc5477fe700 1 --2- 172.21.15.73:0/3562926248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5480b2710 0x7fc5480b1880 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc538009850 tx=0x7fc538009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ee0b0fa6797fb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:25.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc5467fc700 1 -- 172.21.15.73:0/3562926248 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc538011830 con 0x7fc5480b2710 2023-11-30T23:12:25.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc5467fc700 1 -- 172.21.15.73:0/3562926248 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc538011990 con 0x7fc5480b2710 2023-11-30T23:12:25.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc5467fc700 1 -- 172.21.15.73:0/3562926248 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc538011d20 con 0x7fc5480b2710 2023-11-30T23:12:25.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc54cebb700 1 -- 172.21.15.73:0/3562926248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5480b2710 msgr2=0x7fc5480b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:25.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc54cebb700 1 --2- 172.21.15.73:0/3562926248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5480b2710 0x7fc5480b1880 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc538009850 tx=0x7fc538009b60 comp rx=0 tx=0).stop 2023-11-30T23:12:25.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc54cebb700 1 -- 172.21.15.73:0/3562926248 shutdown_connections 2023-11-30T23:12:25.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc54cebb700 1 --2- 172.21.15.73:0/3562926248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5480b2710 0x7fc5480b1880 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc54cebb700 1 -- 172.21.15.73:0/3562926248 >> 172.21.15.73:0/3562926248 conn(0x7fc54806ab90 msgr2=0x7fc5480b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:25.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc54cebb700 1 -- 172.21.15.73:0/3562926248 shutdown_connections 2023-11-30T23:12:25.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.471+0000 7fc54cebb700 1 -- 172.21.15.73:0/3562926248 wait complete. 2023-11-30T23:12:25.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc54cebb700 1 Processor -- start 2023-11-30T23:12:25.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc54cebb700 1 -- start start 2023-11-30T23:12:25.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc54cebb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5480aefa0 0x7fc5481df640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:25.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc54cebb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5480b2710 0x7fc5480719a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:25.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc54cebb700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc548143250 0x7fc548071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:25.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc54cebb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5480708b0 con 0x7fc5480b2710 2023-11-30T23:12:25.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc54cebb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc548135190 con 0x7fc5480aefa0 2023-11-30T23:12:25.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc54cebb700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5481356c0 con 0x7fc548143250 2023-11-30T23:12:25.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc546ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5480b2710 0x7fc5480719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:25.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc547fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc548143250 0x7fc548071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:25.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc5477fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5480aefa0 0x7fc5481df640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:25.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc546ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5480b2710 0x7fc5480719a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44592/0 (socket says 172.21.15.73:44592) 2023-11-30T23:12:25.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc546ffd700 1 -- 172.21.15.73:0/618354192 learned_addr learned my addr 172.21.15.73:0/618354192 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:25.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc547fff700 1 -- 172.21.15.73:0/618354192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5480aefa0 msgr2=0x7fc5481df640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:25.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc547fff700 1 --2- 172.21.15.73:0/618354192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5480aefa0 0x7fc5481df640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc547fff700 1 -- 172.21.15.73:0/618354192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5480b2710 msgr2=0x7fc5480719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:25.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc547fff700 1 --2- 172.21.15.73:0/618354192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5480b2710 0x7fc5480719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc547fff700 1 -- 172.21.15.73:0/618354192 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5380094b0 con 0x7fc548143250 2023-11-30T23:12:25.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc546ffd700 1 --2- 172.21.15.73:0/618354192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5480b2710 0x7fc5480719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:25.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc547fff700 1 --2- 172.21.15.73:0/618354192 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc548143250 0x7fc548071ee0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc54000cbe0 tx=0x7fc54000cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:25.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc53ffff700 1 -- 172.21.15.73:0/618354192 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54000aa40 con 0x7fc548143250 2023-11-30T23:12:25.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc53ffff700 1 -- 172.21.15.73:0/618354192 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54000abc0 con 0x7fc548143250 2023-11-30T23:12:25.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc54cebb700 1 -- 172.21.15.73:0/618354192 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc548071580 con 0x7fc548143250 2023-11-30T23:12:25.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc53ffff700 1 -- 172.21.15.73:0/618354192 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5400070d0 con 0x7fc548143250 2023-11-30T23:12:25.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc54cebb700 1 -- 172.21.15.73:0/618354192 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc548135320 con 0x7fc548143250 2023-11-30T23:12:25.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc53ffff700 1 -- 172.21.15.73:0/618354192 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc540007530 con 0x7fc548143250 2023-11-30T23:12:25.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.475+0000 7fc53ffff700 1 -- 172.21.15.73:0/618354192 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc54001d440 con 0x7fc548143250 2023-11-30T23:12:25.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.479+0000 7fc54cebb700 1 -- 172.21.15.73:0/618354192 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc54806ffb0 con 0x7fc548143250 2023-11-30T23:12:25.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.483+0000 7fc53ffff700 1 -- 172.21.15.73:0/618354192 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fc54806ffb0 con 0x7fc548143250 2023-11-30T23:12:25.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.547+0000 7fc54cebb700 1 -- 172.21.15.73:0/618354192 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc54804ed80 con 0x7fc548143250 2023-11-30T23:12:25.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.547+0000 7fc53ffff700 1 -- 172.21.15.73:0/618354192 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc540018070 con 0x7fc548143250 2023-11-30T23:12:25.553 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:25.553 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":10,"fsid":"a677cb6a-4a54-4567-a30d-f0fa4bc22b17","created":"2023-11-30T23:12:23.260968+0000","modified":"2023-11-30T23:12:25.326689+0000","last_up_change":"0.000000","last_in_change":"2023-11-30T23:12:25.326689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bbf1c93f-0775-4780-8524-cf25792d9aa6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d9dd122-9a42-4588-a0d2-50d13b13eba8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"68ff4f1e-ec45-42e0-bb83-fe03598e4940","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e4b08c98-6a4d-4ec8-a245-59a35f70a16f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d0922b0e-5170-474d-b270-ddb5adc858cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f2791a77-db25-479c-95d5-ea7f77458685","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f86c2fe9-ec8b-406e-af26-5dc65c926382","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T23:12:25.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.551+0000 7fc54cebb700 1 -- 172.21.15.73:0/618354192 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc548143250 msgr2=0x7fc548071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:25.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.551+0000 7fc54cebb700 1 --2- 172.21.15.73:0/618354192 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc548143250 0x7fc548071ee0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc54000cbe0 tx=0x7fc54000cef0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.551+0000 7fc54cebb700 1 -- 172.21.15.73:0/618354192 shutdown_connections 2023-11-30T23:12:25.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.551+0000 7fc54cebb700 1 --2- 172.21.15.73:0/618354192 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc548143250 0x7fc548071ee0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.551+0000 7fc54cebb700 1 --2- 172.21.15.73:0/618354192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5480b2710 0x7fc5480719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.551+0000 7fc54cebb700 1 --2- 172.21.15.73:0/618354192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5480aefa0 0x7fc5481df640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:25.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.551+0000 7fc54cebb700 1 -- 172.21.15.73:0/618354192 >> 172.21.15.73:0/618354192 conn(0x7fc54806ab90 msgr2=0x7fc5480b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:25.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.551+0000 7fc54cebb700 1 -- 172.21.15.73:0/618354192 shutdown_connections 2023-11-30T23:12:25.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:25.551+0000 7fc54cebb700 1 -- 172.21.15.73:0/618354192 wait complete. 2023-11-30T23:12:25.565 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-30T23:12:25.565 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-30T23:12:25.725 INFO:tasks.ceph.osd.4.smithi156.stderr:2023-11-30T23:12:25.721+0000 7f1d0e6dc700 -1 Falling back to public interface 2023-11-30T23:12:25.731 INFO:tasks.ceph.osd.3.smithi073.stderr:2023-11-30T23:12:25.727+0000 7f9788810700 -1 Falling back to public interface 2023-11-30T23:12:25.737 INFO:tasks.ceph.osd.5.smithi156.stderr:2023-11-30T23:12:25.733+0000 7f2082bf5700 -1 Falling back to public interface 2023-11-30T23:12:25.741 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-30T23:12:25.737+0000 7fe949068700 -1 Falling back to public interface 2023-11-30T23:12:25.748 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:25.743+0000 7f293bb3d2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T23:12:25.759 INFO:tasks.ceph.osd.1.smithi073.stderr:2023-11-30T23:12:25.755+0000 7fa242bdb700 -1 Falling back to public interface 2023-11-30T23:12:25.790 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:25.785+0000 7fe5fc4f72c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-30T23:12:25.913 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:25.907+0000 7f293bb3d2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T23:12:25.960 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:25.957+0000 7fe5fc4f72c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-30T23:12:25.979 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:25.975+0000 7f293bb3d2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T23:12:25.987 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-30T23:12:25.983+0000 7fc66ec9a700 -1 Falling back to public interface 2023-11-30T23:12:25.995 INFO:tasks.ceph.osd.2.smithi073.stderr:2023-11-30T23:12:25.991+0000 7f966a38e700 -1 Falling back to public interface 2023-11-30T23:12:26.000 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-30T23:12:25.997+0000 7f032ba1b700 -1 Falling back to public interface 2023-11-30T23:12:26.027 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:26.025+0000 7fe5fc4f72c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-30T23:12:26.038 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:26.035+0000 7f293bb3d2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T23:12:26.081 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:26.077+0000 7fe5fc4f72c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-30T23:12:26.371 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-30T23:12:26.476 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.467+0000 7f0977fff700 1 Processor -- start 2023-11-30T23:12:26.477 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.467+0000 7f0977fff700 1 -- start start 2023-11-30T23:12:26.477 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.467+0000 7f0977fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f09700207c0 0x7f0970020c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:26.477 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.467+0000 7f0977fff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0970006ae0 con 0x7f09700cfcf0 2023-11-30T23:12:26.477 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.467+0000 7f0977fff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097003a060 con 0x7f0970006700 2023-11-30T23:12:26.477 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.467+0000 7f0977fff700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097003a340 con 0x7f09700207c0 2023-11-30T23:12:26.478 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f09777fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f09700cfcf0 0x7f09700d7080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50278/0 (socket says 172.21.15.73:50278) 2023-11-30T23:12:26.478 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f09777fe700 1 -- 172.21.15.73:0/521274989 learned_addr learned my addr 172.21.15.73:0/521274989 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:26.478 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f09767fc700 1 --2- 172.21.15.73:0/521274989 >> v2:172.21.15.156:3300/0 conn(0x7f09700207c0 0x7f0970020c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:26.478 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f0975ffb700 1 -- 172.21.15.73:0/521274989 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205325091 0 0) 0x7f0970006ae0 con 0x7f09700cfcf0 2023-11-30T23:12:26.478 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f0975ffb700 1 -- 172.21.15.73:0/521274989 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09600035d0 con 0x7f09700cfcf0 2023-11-30T23:12:26.478 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f09767fc700 1 -- 172.21.15.73:0/521274989 >> v1:172.21.15.156:6789/0 conn(0x7f0970006700 legacy=0x7f097001bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:26.479 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f09767fc700 1 -- 172.21.15.73:0/521274989 >> v1:172.21.15.73:6789/0 conn(0x7f09700cfcf0 legacy=0x7f09700d7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:26.479 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f09767fc700 1 -- 172.21.15.73:0/521274989 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097003a620 con 0x7f09700207c0 2023-11-30T23:12:26.479 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f09767fc700 1 --2- 172.21.15.73:0/521274989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09700207c0 0x7f0970020c20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f096c009850 tx=0x7f096c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d33eba6e298b96f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:26.479 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f0975ffb700 1 -- 172.21.15.73:0/521274989 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c011830 con 0x7f09700207c0 2023-11-30T23:12:26.479 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f0975ffb700 1 -- 172.21.15.73:0/521274989 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c011990 con 0x7f09700207c0 2023-11-30T23:12:26.479 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f0977fff700 1 -- 172.21.15.73:0/521274989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09700207c0 msgr2=0x7f0970020c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:26.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f0977fff700 1 --2- 172.21.15.73:0/521274989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09700207c0 0x7f0970020c20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f096c009850 tx=0x7f096c009b60 comp rx=0 tx=0).stop 2023-11-30T23:12:26.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f0977fff700 1 -- 172.21.15.73:0/521274989 shutdown_connections 2023-11-30T23:12:26.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f0977fff700 1 --2- 172.21.15.73:0/521274989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09700207c0 0x7f0970020c20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:26.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f0977fff700 1 -- 172.21.15.73:0/521274989 >> 172.21.15.73:0/521274989 conn(0x7f097000add0 msgr2=0x7f0970006d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:26.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f0977fff700 1 -- 172.21.15.73:0/521274989 shutdown_connections 2023-11-30T23:12:26.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f0977fff700 1 -- 172.21.15.73:0/521274989 wait complete. 2023-11-30T23:12:26.484 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f0977fff700 1 Processor -- start 2023-11-30T23:12:26.484 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.471+0000 7f0977fff700 1 -- start start 2023-11-30T23:12:26.484 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f0977fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0970006700 0x7f09700c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:26.484 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f0977fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09700207c0 0x7f09701626e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:26.484 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f0977fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09700cfcf0 0x7f09700c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:26.485 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f0977fff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0970162250 con 0x7f0970006700 2023-11-30T23:12:26.485 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f0977fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09700c9360 con 0x7f09700cfcf0 2023-11-30T23:12:26.485 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f0977fff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0970021650 con 0x7f09700207c0 2023-11-30T23:12:26.485 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f0976ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0970006700 0x7f09700c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:26.485 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f0976ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0970006700 0x7f09700c8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44602/0 (socket says 172.21.15.73:44602) 2023-11-30T23:12:26.485 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f0976ffd700 1 -- 172.21.15.73:0/2609427790 learned_addr learned my addr 172.21.15.73:0/2609427790 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:26.485 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f09767fc700 1 --2- 172.21.15.73:0/2609427790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09700207c0 0x7f09701626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:26.485 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f09777fe700 1 --2- 172.21.15.73:0/2609427790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09700cfcf0 0x7f09700c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:26.485 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f0976ffd700 1 -- 172.21.15.73:0/2609427790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09700207c0 msgr2=0x7f09701626e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:26.485 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f0976ffd700 1 --2- 172.21.15.73:0/2609427790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09700207c0 0x7f09701626e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:26.485 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f0976ffd700 1 -- 172.21.15.73:0/2609427790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09700cfcf0 msgr2=0x7f09700c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:26.485 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f0976ffd700 1 --2- 172.21.15.73:0/2609427790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09700cfcf0 0x7f09700c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:26.485 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f0976ffd700 1 -- 172.21.15.73:0/2609427790 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096c0094b0 con 0x7f0970006700 2023-11-30T23:12:26.485 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f0976ffd700 1 --2- 172.21.15.73:0/2609427790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0970006700 0x7f09700c8e20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0978065e20 tx=0x7f0978066190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:26.486 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f095f7fe700 1 -- 172.21.15.73:0/2609427790 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978067570 con 0x7f0970006700 2023-11-30T23:12:26.486 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f095f7fe700 1 -- 172.21.15.73:0/2609427790 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09780676d0 con 0x7f0970006700 2023-11-30T23:12:26.486 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f0977fff700 1 -- 172.21.15.73:0/2609427790 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09700c95b0 con 0x7f0970006700 2023-11-30T23:12:26.486 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f095f7fe700 1 -- 172.21.15.73:0/2609427790 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978066730 con 0x7f0970006700 2023-11-30T23:12:26.486 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f0977fff700 1 -- 172.21.15.73:0/2609427790 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0970161e70 con 0x7f0970006700 2023-11-30T23:12:26.486 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f095f7fe700 1 -- 172.21.15.73:0/2609427790 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0978066c50 con 0x7f0970006700 2023-11-30T23:12:26.486 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.475+0000 7f095f7fe700 1 -- 172.21.15.73:0/2609427790 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0978072020 con 0x7f0970006700 2023-11-30T23:12:26.486 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.479+0000 7f0977fff700 1 -- 172.21.15.73:0/2609427790 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09700059c0 con 0x7f0970006700 2023-11-30T23:12:26.486 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.479+0000 7f095f7fe700 1 -- 172.21.15.73:0/2609427790 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f0978072610 con 0x7f0970006700 2023-11-30T23:12:26.547 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.543+0000 7f0977fff700 1 -- 172.21.15.73:0/2609427790 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0970162000 con 0x7f0970006700 2023-11-30T23:12:26.548 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.543+0000 7f095f7fe700 1 -- 172.21.15.73:0/2609427790 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f09780a1090 con 0x7f0970006700 2023-11-30T23:12:26.549 INFO:teuthology.misc.health.smithi073.stdout: 2023-11-30T23:12:26.549 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":10,"fsid":"a677cb6a-4a54-4567-a30d-f0fa4bc22b17","created":"2023-11-30T23:12:23.260968+0000","modified":"2023-11-30T23:12:25.326689+0000","last_up_change":"0.000000","last_in_change":"2023-11-30T23:12:25.326689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bbf1c93f-0775-4780-8524-cf25792d9aa6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d9dd122-9a42-4588-a0d2-50d13b13eba8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"68ff4f1e-ec45-42e0-bb83-fe03598e4940","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e4b08c98-6a4d-4ec8-a245-59a35f70a16f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d0922b0e-5170-474d-b270-ddb5adc858cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f2791a77-db25-479c-95d5-ea7f77458685","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f86c2fe9-ec8b-406e-af26-5dc65c926382","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T23:12:26.550 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.547+0000 7f0977fff700 1 -- 172.21.15.73:0/2609427790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0970006700 msgr2=0x7f09700c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:26.550 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.547+0000 7f0977fff700 1 --2- 172.21.15.73:0/2609427790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0970006700 0x7f09700c8e20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0978065e20 tx=0x7f0978066190 comp rx=0 tx=0).stop 2023-11-30T23:12:26.550 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.547+0000 7f0977fff700 1 -- 172.21.15.73:0/2609427790 shutdown_connections 2023-11-30T23:12:26.550 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.547+0000 7f0977fff700 1 --2- 172.21.15.73:0/2609427790 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09700cfcf0 0x7f09700c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:26.550 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.547+0000 7f0977fff700 1 --2- 172.21.15.73:0/2609427790 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09700207c0 0x7f09701626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:26.551 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.547+0000 7f0977fff700 1 --2- 172.21.15.73:0/2609427790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0970006700 0x7f09700c8e20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:26.551 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.547+0000 7f0977fff700 1 -- 172.21.15.73:0/2609427790 >> 172.21.15.73:0/2609427790 conn(0x7f097000add0 msgr2=0x7f097003c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:26.551 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.547+0000 7f0977fff700 1 -- 172.21.15.73:0/2609427790 shutdown_connections 2023-11-30T23:12:26.551 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:26.547+0000 7f0977fff700 1 -- 172.21.15.73:0/2609427790 wait complete. 2023-11-30T23:12:26.560 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-30T23:12:26.959 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:26.955+0000 7f293bb3d2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T23:12:27.006 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:27.001+0000 7fe5fc4f72c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-30T23:12:27.024 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:27.019+0000 7f293bb3d2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T23:12:27.077 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:27.073+0000 7fe5fc4f72c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-30T23:12:27.177 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:27.171+0000 7f293bb3d2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T23:12:27.234 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:27.231+0000 7f293bb3d2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T23:12:27.243 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:27.241+0000 7fe5fc4f72c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-30T23:12:27.297 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:27.291+0000 7f293bb3d2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T23:12:27.303 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:27.301+0000 7fe5fc4f72c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-30T23:12:27.371 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:27.369+0000 7fe5fc4f72c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-30T23:12:27.452 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:27.447+0000 7f293bb3d2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T23:12:27.545 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:27.541+0000 7fe5fc4f72c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-30T23:12:27.648 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:27.643+0000 7f293bb3d2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T23:12:27.769 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:27.765+0000 7fe5fc4f72c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-30T23:12:28.313 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:28.307+0000 7f293bb3d2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T23:12:28.470 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-30T23:12:28.465+0000 7fe5fc4f72c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-30T23:12:29.081 INFO:tasks.ceph.osd.5.smithi156.stderr:2023-11-30T23:12:29.077+0000 7f2082bf5700 -1 osd.5 0 log_to_monitors true 2023-11-30T23:12:29.325 INFO:tasks.ceph.osd.4.smithi156.stderr:2023-11-30T23:12:29.321+0000 7f1d0e6dc700 -1 osd.4 0 log_to_monitors true 2023-11-30T23:12:29.356 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:29.351+0000 7f2922bbd700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-30T23:12:29.357 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:12:29.355+0000 7f2922bbd700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-30T23:12:29.455 INFO:tasks.ceph.osd.1.smithi073.stderr:2023-11-30T23:12:29.451+0000 7fa242bdb700 -1 osd.1 0 log_to_monitors true 2023-11-30T23:12:29.550 INFO:tasks.ceph.osd.3.smithi073.stderr:2023-11-30T23:12:29.543+0000 7f9788810700 -1 osd.3 0 log_to_monitors true 2023-11-30T23:12:29.638 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-30T23:12:29.635+0000 7fc66ec9a700 -1 osd.0 0 log_to_monitors true 2023-11-30T23:12:29.673 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-30T23:12:29.669+0000 7fe949068700 -1 osd.6 0 log_to_monitors true 2023-11-30T23:12:29.797 INFO:tasks.ceph.osd.2.smithi073.stderr:2023-11-30T23:12:29.791+0000 7f966a38e700 -1 osd.2 0 log_to_monitors true 2023-11-30T23:12:29.799 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-30T23:12:29.793+0000 7f032ba1b700 -1 osd.7 0 log_to_monitors true 2023-11-30T23:12:32.643 INFO:tasks.ceph.osd.5.smithi156.stderr:2023-11-30T23:12:32.637+0000 7f207fbbc700 -1 osd.5 0 waiting for initial osdmap 2023-11-30T23:12:32.649 INFO:tasks.ceph.osd.5.smithi156.stderr:2023-11-30T23:12:32.645+0000 7f20764e6700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-30T23:12:32.654 INFO:tasks.ceph.osd.4.smithi156.stderr:2023-11-30T23:12:32.649+0000 7f1d09cf8700 -1 osd.4 0 waiting for initial osdmap 2023-11-30T23:12:32.657 INFO:tasks.ceph.osd.4.smithi156.stderr:2023-11-30T23:12:32.653+0000 7f1d01fcd700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-30T23:12:32.695 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-30T23:12:32.693+0000 7f0327037700 -1 osd.7 0 waiting for initial osdmap 2023-11-30T23:12:32.699 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-30T23:12:32.697+0000 7fe944684700 -1 osd.6 0 waiting for initial osdmap 2023-11-30T23:12:32.700 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-30T23:12:32.697+0000 7f031f30c700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-30T23:12:32.706 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-30T23:12:32.701+0000 7fe93c959700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-30T23:12:33.367 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-30T23:12:33.402 INFO:tasks.ceph.osd.2.smithi073.stderr:2023-11-30T23:12:33.395+0000 7f96659aa700 -1 osd.2 0 waiting for initial osdmap 2023-11-30T23:12:33.405 INFO:tasks.ceph.osd.1.smithi073.stderr:2023-11-30T23:12:33.399+0000 7fa23fba2700 -1 osd.1 0 waiting for initial osdmap 2023-11-30T23:12:33.407 INFO:tasks.ceph.osd.2.smithi073.stderr:2023-11-30T23:12:33.403+0000 7f965dc7f700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-30T23:12:33.419 INFO:tasks.ceph.osd.3.smithi073.stderr:2023-11-30T23:12:33.415+0000 7f9783e2c700 -1 osd.3 0 waiting for initial osdmap 2023-11-30T23:12:33.419 INFO:tasks.ceph.osd.1.smithi073.stderr:2023-11-30T23:12:33.415+0000 7fa2364cc700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-30T23:12:33.425 INFO:tasks.ceph.osd.3.smithi073.stderr:2023-11-30T23:12:33.419+0000 7f977c101700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-30T23:12:33.427 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-30T23:12:33.423+0000 7fc66bc61700 -1 osd.0 0 waiting for initial osdmap 2023-11-30T23:12:33.432 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-11-30T23:12:33.427+0000 7fc66258b700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-30T23:12:33.470 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835f004700 1 Processor -- start 2023-11-30T23:12:33.471 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835f004700 1 -- start start 2023-11-30T23:12:33.472 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835f004700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8358073380 0x7f83580aec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:33.472 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835f004700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83580b10f0 0x7f8358141c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:33.472 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835f004700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83580ae3d0 con 0x7f835806b6a0 2023-11-30T23:12:33.472 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835f004700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83580afba0 con 0x7f8358073380 2023-11-30T23:12:33.472 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835f004700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8358073760 con 0x7f83580b10f0 2023-11-30T23:12:33.472 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835e002700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8358073380 0x7f83580aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:33.473 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835e002700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8358073380 0x7f83580aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43390/0 (socket says 172.21.15.73:43390) 2023-11-30T23:12:33.473 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835e002700 1 -- 172.21.15.73:0/2008236415 learned_addr learned my addr 172.21.15.73:0/2008236415 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:33.473 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835e803700 1 --2- 172.21.15.73:0/2008236415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83580b10f0 0x7f8358141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:33.473 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835e002700 1 -- 172.21.15.73:0/2008236415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83580b10f0 msgr2=0x7f8358141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:33.473 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835e002700 1 --2- 172.21.15.73:0/2008236415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83580b10f0 0x7f8358141c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:33.473 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835e002700 1 -- 172.21.15.73:0/2008236415 >> v1:172.21.15.156:6789/0 conn(0x7f835806b6a0 legacy=0x7f8358141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:33.473 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835e002700 1 -- 172.21.15.73:0/2008236415 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83580af1a0 con 0x7f8358073380 2023-11-30T23:12:33.473 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835e002700 1 --2- 172.21.15.73:0/2008236415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8358073380 0x7f83580aec60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8350009e50 tx=0x7f835000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d442a4437555703a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:33.473 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835d000700 1 -- 172.21.15.73:0/2008236415 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835000e070 con 0x7f8358073380 2023-11-30T23:12:33.473 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835d000700 1 -- 172.21.15.73:0/2008236415 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835000b910 con 0x7f8358073380 2023-11-30T23:12:33.473 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835d000700 1 -- 172.21.15.73:0/2008236415 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835000bcc0 con 0x7f8358073380 2023-11-30T23:12:33.474 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835f004700 1 -- 172.21.15.73:0/2008236415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8358073380 msgr2=0x7f83580aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:33.474 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835f004700 1 --2- 172.21.15.73:0/2008236415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8358073380 0x7f83580aec60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8350009e50 tx=0x7f835000b330 comp rx=0 tx=0).stop 2023-11-30T23:12:33.474 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835f004700 1 -- 172.21.15.73:0/2008236415 shutdown_connections 2023-11-30T23:12:33.475 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835f004700 1 --2- 172.21.15.73:0/2008236415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83580b10f0 0x7f8358141c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:33.475 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835f004700 1 --2- 172.21.15.73:0/2008236415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8358073380 0x7f83580aec60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:33.475 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835f004700 1 -- 172.21.15.73:0/2008236415 >> 172.21.15.73:0/2008236415 conn(0x7f835806a180 msgr2=0x7f835806a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:33.475 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835f004700 1 -- 172.21.15.73:0/2008236415 shutdown_connections 2023-11-30T23:12:33.475 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.467+0000 7f835f004700 1 -- 172.21.15.73:0/2008236415 wait complete. 2023-11-30T23:12:33.479 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.471+0000 7f835f004700 1 Processor -- start 2023-11-30T23:12:33.479 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.471+0000 7f835f004700 1 -- start start 2023-11-30T23:12:33.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.471+0000 7f835f004700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f835806b6a0 0x7f83581cd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:33.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.471+0000 7f835f004700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8358073380 0x7f83581dcb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:33.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.471+0000 7f835f004700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83580b10f0 0x7f8358141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:33.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.471+0000 7f835f004700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83581cd2e0 con 0x7f8358073380 2023-11-30T23:12:33.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.471+0000 7f835f004700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8358142600 con 0x7f835806b6a0 2023-11-30T23:12:33.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.471+0000 7f835f004700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8358142b10 con 0x7f83580b10f0 2023-11-30T23:12:33.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.471+0000 7f835d801700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8358073380 0x7f83581dcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:33.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.471+0000 7f835d801700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8358073380 0x7f83581dcb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43396/0 (socket says 172.21.15.73:43396) 2023-11-30T23:12:33.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.471+0000 7f835e002700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f835806b6a0 0x7f83581cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:33.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.471+0000 7f835d801700 1 -- 172.21.15.73:0/189440089 learned_addr learned my addr 172.21.15.73:0/189440089 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:33.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.471+0000 7f835e803700 1 --2- 172.21.15.73:0/189440089 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83580b10f0 0x7f8358141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:33.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.471+0000 7f835d801700 1 -- 172.21.15.73:0/189440089 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83580b10f0 msgr2=0x7f8358141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:33.480 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.471+0000 7f835d801700 1 --2- 172.21.15.73:0/189440089 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83580b10f0 0x7f8358141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:33.481 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.471+0000 7f835d801700 1 -- 172.21.15.73:0/189440089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f835806b6a0 msgr2=0x7f83581cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:33.481 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.471+0000 7f835d801700 1 --2- 172.21.15.73:0/189440089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f835806b6a0 0x7f83581cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:33.481 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.471+0000 7f835d801700 1 -- 172.21.15.73:0/189440089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8350009b30 con 0x7f8358073380 2023-11-30T23:12:33.481 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.475+0000 7f835d801700 1 --2- 172.21.15.73:0/189440089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8358073380 0x7f83581dcb70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f834800c500 tx=0x7f834800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:33.481 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.475+0000 7f834e7fc700 1 -- 172.21.15.73:0/189440089 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83480052d0 con 0x7f8358073380 2023-11-30T23:12:33.481 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.475+0000 7f834e7fc700 1 -- 172.21.15.73:0/189440089 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8348005430 con 0x7f8358073380 2023-11-30T23:12:33.481 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.475+0000 7f835f004700 1 -- 172.21.15.73:0/189440089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83581cb5f0 con 0x7f8358073380 2023-11-30T23:12:33.481 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.475+0000 7f834e7fc700 1 -- 172.21.15.73:0/189440089 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83480055a0 con 0x7f8358073380 2023-11-30T23:12:33.481 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.475+0000 7f835f004700 1 -- 172.21.15.73:0/189440089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83581cbbb0 con 0x7f8358073380 2023-11-30T23:12:33.481 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.475+0000 7f835f004700 1 -- 172.21.15.73:0/189440089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83581cd450 con 0x7f8358073380 2023-11-30T23:12:33.482 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.475+0000 7f834e7fc700 1 -- 172.21.15.73:0/189440089 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 85172+0+0 (secure 0 0 0) 0x7f83480038e0 con 0x7f8358073380 2023-11-30T23:12:33.482 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.475+0000 7f834e7fc700 1 --2- 172.21.15.73:0/189440089 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f833c065a40 0x7f833c067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:33.482 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.475+0000 7f835e002700 1 --2- 172.21.15.73:0/189440089 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f833c065a40 0x7f833c067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:33.482 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.475+0000 7f834e7fc700 1 -- 172.21.15.73:0/189440089 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f83480815c0 con 0x7f8358073380 2023-11-30T23:12:33.482 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.475+0000 7f835e002700 1 --2- 172.21.15.73:0/189440089 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f833c065a40 0x7f833c067f00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f835000b370 tx=0x7f8350009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:33.488 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.483+0000 7f834e7fc700 1 -- 172.21.15.73:0/189440089 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f83581cd450 con 0x7f8358073380 2023-11-30T23:12:33.642 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.639+0000 7f835f004700 1 -- 172.21.15.73:0/189440089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83581cd450 con 0x7f8358073380 2023-11-30T23:12:33.643 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.639+0000 7f834e7fc700 1 -- 172.21.15.73:0/189440089 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f83581cd450 con 0x7f8358073380 2023-11-30T23:12:33.643 INFO:teuthology.misc.health.smithi073.stdout: 2023-11-30T23:12:33.643 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":12,"fsid":"a677cb6a-4a54-4567-a30d-f0fa4bc22b17","created":"2023-11-30T23:12:23.260968+0000","modified":"2023-11-30T23:12:31.048649+0000","last_up_change":"0.000000","last_in_change":"2023-11-30T23:12:25.326689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bbf1c93f-0775-4780-8524-cf25792d9aa6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d9dd122-9a42-4588-a0d2-50d13b13eba8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"68ff4f1e-ec45-42e0-bb83-fe03598e4940","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e4b08c98-6a4d-4ec8-a245-59a35f70a16f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d0922b0e-5170-474d-b270-ddb5adc858cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f2791a77-db25-479c-95d5-ea7f77458685","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f86c2fe9-ec8b-406e-af26-5dc65c926382","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T23:12:33.645 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.639+0000 7f835f004700 1 -- 172.21.15.73:0/189440089 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f833c065a40 msgr2=0x7f833c067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:33.645 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.639+0000 7f835f004700 1 --2- 172.21.15.73:0/189440089 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f833c065a40 0x7f833c067f00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f835000b370 tx=0x7f8350009000 comp rx=0 tx=0).stop 2023-11-30T23:12:33.645 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.639+0000 7f835f004700 1 -- 172.21.15.73:0/189440089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8358073380 msgr2=0x7f83581dcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:33.645 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.639+0000 7f835f004700 1 --2- 172.21.15.73:0/189440089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8358073380 0x7f83581dcb70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f834800c500 tx=0x7f834800c810 comp rx=0 tx=0).stop 2023-11-30T23:12:33.646 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.639+0000 7f835f004700 1 -- 172.21.15.73:0/189440089 shutdown_connections 2023-11-30T23:12:33.646 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.639+0000 7f835f004700 1 --2- 172.21.15.73:0/189440089 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f83580b10f0 0x7f8358141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:33.646 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.639+0000 7f835f004700 1 --2- 172.21.15.73:0/189440089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8358073380 0x7f83581dcb70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:33.646 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.639+0000 7f835f004700 1 --2- 172.21.15.73:0/189440089 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f833c065a40 0x7f833c067f00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:33.646 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.639+0000 7f835f004700 1 --2- 172.21.15.73:0/189440089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f835806b6a0 0x7f83581cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:33.646 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.639+0000 7f835f004700 1 -- 172.21.15.73:0/189440089 >> 172.21.15.73:0/189440089 conn(0x7f835806a180 msgr2=0x7f83580b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:33.646 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.643+0000 7f835f004700 1 -- 172.21.15.73:0/189440089 shutdown_connections 2023-11-30T23:12:33.646 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:33.643+0000 7f835f004700 1 -- 172.21.15.73:0/189440089 wait complete. 2023-11-30T23:12:33.656 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-30T23:12:40.463 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-30T23:12:40.572 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.567+0000 7f01c359e700 1 Processor -- start 2023-11-30T23:12:40.572 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.567+0000 7f01c359e700 1 -- start start 2023-11-30T23:12:40.573 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.567+0000 7f01c359e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01c40b09a0 0x7f01c4070470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:40.573 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.567+0000 7f01c359e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f01c40709b0 0x7f01c414d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:40.573 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.567+0000 7f01c359e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c4143530 con 0x7f01c40b05c0 2023-11-30T23:12:40.573 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.567+0000 7f01c359e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c40b1a90 con 0x7f01c40709b0 2023-11-30T23:12:40.573 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.567+0000 7f01c359e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c4142c20 con 0x7f01c40b09a0 2023-11-30T23:12:40.575 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.567+0000 7f01c2d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f01c40709b0 0x7f01c414d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:40.575 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.567+0000 7f01c1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01c40b09a0 0x7f01c4070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:40.575 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.567+0000 7f01c2d9d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f01c40709b0 0x7f01c414d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:58326/0 (socket says 172.21.15.73:58326) 2023-11-30T23:12:40.575 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.567+0000 7f01c1d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01c40b09a0 0x7f01c4070470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:58358/0 (socket says 172.21.15.73:58358) 2023-11-30T23:12:40.575 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c2d9d700 1 -- 172.21.15.73:0/3963110178 learned_addr learned my addr 172.21.15.73:0/3963110178 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:40.575 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.567+0000 7f01c259c700 1 --1- 172.21.15.73:0/3963110178 >> v1:172.21.15.156:6789/0 conn(0x7f01c40b05c0 0x7f01c40aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.73:36404/0 (socket says 172.21.15.73:36404) 2023-11-30T23:12:40.575 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c2d9d700 1 -- 172.21.15.73:0/3963110178 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01c40b09a0 msgr2=0x7f01c4070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:40.575 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c2d9d700 1 --2- 172.21.15.73:0/3963110178 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01c40b09a0 0x7f01c4070470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:40.575 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c2d9d700 1 -- 172.21.15.73:0/3963110178 >> v1:172.21.15.156:6789/0 conn(0x7f01c40b05c0 legacy=0x7f01c40aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:40.576 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c2d9d700 1 -- 172.21.15.73:0/3963110178 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c40b1d70 con 0x7f01c40709b0 2023-11-30T23:12:40.576 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c2d9d700 1 --2- 172.21.15.73:0/3963110178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01c40709b0 0x7f01c414d4c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009e50 tx=0x7f01bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b2c33fc7963a74 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:40.576 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c159a700 1 -- 172.21.15.73:0/3963110178 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc00e070 con 0x7f01c40709b0 2023-11-30T23:12:40.576 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c159a700 1 -- 172.21.15.73:0/3963110178 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc00b910 con 0x7f01c40709b0 2023-11-30T23:12:40.576 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c159a700 1 -- 172.21.15.73:0/3963110178 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc00bcc0 con 0x7f01c40709b0 2023-11-30T23:12:40.577 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c359e700 1 -- 172.21.15.73:0/3963110178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01c40709b0 msgr2=0x7f01c414d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:40.577 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c359e700 1 --2- 172.21.15.73:0/3963110178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01c40709b0 0x7f01c414d4c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009e50 tx=0x7f01bc00b330 comp rx=0 tx=0).stop 2023-11-30T23:12:40.577 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c359e700 1 -- 172.21.15.73:0/3963110178 shutdown_connections 2023-11-30T23:12:40.577 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c359e700 1 --2- 172.21.15.73:0/3963110178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01c40709b0 0x7f01c414d4c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:40.577 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c359e700 1 --2- 172.21.15.73:0/3963110178 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01c40b09a0 0x7f01c4070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:40.577 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c359e700 1 -- 172.21.15.73:0/3963110178 >> 172.21.15.73:0/3963110178 conn(0x7f01c40b83e0 msgr2=0x7f01c40b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:40.577 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c359e700 1 -- 172.21.15.73:0/3963110178 shutdown_connections 2023-11-30T23:12:40.578 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c359e700 1 -- 172.21.15.73:0/3963110178 wait complete. 2023-11-30T23:12:40.578 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c359e700 1 Processor -- start 2023-11-30T23:12:40.579 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.571+0000 7f01c359e700 1 -- start start 2023-11-30T23:12:40.579 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c359e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01c40709b0 0x7f01c406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:40.579 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c40b05c0 0x7f01c41de9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:40.579 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c359e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01c40b09a0 0x7f01c41ce550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:40.579 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c359e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c41d5c20 con 0x7f01c40b05c0 2023-11-30T23:12:40.579 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c359e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c41457f0 con 0x7f01c40b09a0 2023-11-30T23:12:40.579 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c359e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c4146b70 con 0x7f01c40709b0 2023-11-30T23:12:40.579 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c1d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c40b05c0 0x7f01c41de9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:40.580 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c2d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01c40b09a0 0x7f01c41ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:40.580 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c2d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01c40b09a0 0x7f01c41ce550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:58342/0 (socket says 172.21.15.73:58342) 2023-11-30T23:12:40.580 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c2d9d700 1 -- 172.21.15.73:0/4122490420 learned_addr learned my addr 172.21.15.73:0/4122490420 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:40.580 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c259c700 1 --2- 172.21.15.73:0/4122490420 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01c40709b0 0x7f01c406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:40.581 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c2d9d700 1 -- 172.21.15.73:0/4122490420 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01c40709b0 msgr2=0x7f01c406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:40.581 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c2d9d700 1 --2- 172.21.15.73:0/4122490420 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01c40709b0 0x7f01c406ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:40.581 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c2d9d700 1 -- 172.21.15.73:0/4122490420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c40b05c0 msgr2=0x7f01c41de9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:40.581 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c2d9d700 1 --2- 172.21.15.73:0/4122490420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c40b05c0 0x7f01c41de9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:40.581 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c2d9d700 1 -- 172.21.15.73:0/4122490420 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc009b30 con 0x7f01c40b09a0 2023-11-30T23:12:40.582 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c2d9d700 1 --2- 172.21.15.73:0/4122490420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01c40b09a0 0x7f01c41ce550 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f01bc00b680 tx=0x7f01bc004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:40.582 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01baffd700 1 -- 172.21.15.73:0/4122490420 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc0048b0 con 0x7f01c40b09a0 2023-11-30T23:12:40.582 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c359e700 1 -- 172.21.15.73:0/4122490420 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c41def10 con 0x7f01c40b09a0 2023-11-30T23:12:40.582 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01baffd700 1 -- 172.21.15.73:0/4122490420 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc0092e0 con 0x7f01c40b09a0 2023-11-30T23:12:40.582 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01baffd700 1 -- 172.21.15.73:0/4122490420 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc01c660 con 0x7f01c40b09a0 2023-11-30T23:12:40.582 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.575+0000 7f01c359e700 1 -- 172.21.15.73:0/4122490420 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c4143eb0 con 0x7f01c40b09a0 2023-11-30T23:12:40.583 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.579+0000 7f01c359e700 1 -- 172.21.15.73:0/4122490420 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c40b4c20 con 0x7f01c40b09a0 2023-11-30T23:12:40.583 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.579+0000 7f01baffd700 1 -- 172.21.15.73:0/4122490420 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f01bc01c7c0 con 0x7f01c40b09a0 2023-11-30T23:12:40.583 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.579+0000 7f01baffd700 1 --2- 172.21.15.73:0/4122490420 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f01a4065ad0 0x7f01a4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:40.583 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.579+0000 7f01baffd700 1 -- 172.21.15.73:0/4122490420 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f01bc084aa0 con 0x7f01c40b09a0 2023-11-30T23:12:40.584 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.579+0000 7f01c259c700 1 --2- 172.21.15.73:0/4122490420 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f01a4065ad0 0x7f01a4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:40.584 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.579+0000 7f01c259c700 1 --2- 172.21.15.73:0/4122490420 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f01a4065ad0 0x7f01a4067f90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f01b4000f60 tx=0x7f01b4007f30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:40.593 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.587+0000 7f01baffd700 1 -- 172.21.15.73:0/4122490420 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f01bc052720 con 0x7f01c40b09a0 2023-11-30T23:12:40.762 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.759+0000 7f01c359e700 1 -- 172.21.15.73:0/4122490420 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01c40af710 con 0x7f01c40b09a0 2023-11-30T23:12:40.764 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.759+0000 7f01baffd700 1 -- 172.21.15.73:0/4122490420 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f01bc055d40 con 0x7f01c40b09a0 2023-11-30T23:12:40.765 INFO:teuthology.misc.health.smithi073.stdout: 2023-11-30T23:12:40.765 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":16,"fsid":"a677cb6a-4a54-4567-a30d-f0fa4bc22b17","created":"2023-11-30T23:12:23.260968+0000","modified":"2023-11-30T23:12:36.660230+0000","last_up_change":"2023-11-30T23:12:33.649318+0000","last_in_change":"2023-11-30T23:12:25.326689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-30T23:12:34.413317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbf1c93f-0775-4780-8524-cf25792d9aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36686},{"type":"v1","addr":"172.21.15.73:6817","nonce":36686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36686},{"type":"v1","addr":"172.21.15.73:6819","nonce":36686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36686},{"type":"v1","addr":"172.21.15.73:6823","nonce":36686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36686},{"type":"v1","addr":"172.21.15.73:6821","nonce":36686}]},"public_addr":"172.21.15.73:6817/36686","cluster_addr":"172.21.15.73:6819/36686","heartbeat_back_addr":"172.21.15.73:6823/36686","heartbeat_front_addr":"172.21.15.73:6821/36686","state":["exists","up"]},{"osd":1,"uuid":"9d9dd122-9a42-4588-a0d2-50d13b13eba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36687},{"type":"v1","addr":"172.21.15.73:6809","nonce":36687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":36687},{"type":"v1","addr":"172.21.15.73:6811","nonce":36687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36687},{"type":"v1","addr":"172.21.15.73:6815","nonce":36687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36687},{"type":"v1","addr":"172.21.15.73:6813","nonce":36687}]},"public_addr":"172.21.15.73:6809/36687","cluster_addr":"172.21.15.73:6811/36687","heartbeat_back_addr":"172.21.15.73:6815/36687","heartbeat_front_addr":"172.21.15.73:6813/36687","state":["exists","up"]},{"osd":2,"uuid":"68ff4f1e-ec45-42e0-bb83-fe03598e4940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36688},{"type":"v1","addr":"172.21.15.73:6825","nonce":36688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36688},{"type":"v1","addr":"172.21.15.73:6827","nonce":36688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36688},{"type":"v1","addr":"172.21.15.73:6831","nonce":36688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36688},{"type":"v1","addr":"172.21.15.73:6829","nonce":36688}]},"public_addr":"172.21.15.73:6825/36688","cluster_addr":"172.21.15.73:6827/36688","heartbeat_back_addr":"172.21.15.73:6831/36688","heartbeat_front_addr":"172.21.15.73:6829/36688","state":["exists","up"]},{"osd":3,"uuid":"e4b08c98-6a4d-4ec8-a245-59a35f70a16f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36685},{"type":"v1","addr":"172.21.15.73:6801","nonce":36685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36685},{"type":"v1","addr":"172.21.15.73:6803","nonce":36685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":36685},{"type":"v1","addr":"172.21.15.73:6807","nonce":36685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36685},{"type":"v1","addr":"172.21.15.73:6805","nonce":36685}]},"public_addr":"172.21.15.73:6801/36685","cluster_addr":"172.21.15.73:6803/36685","heartbeat_back_addr":"172.21.15.73:6807/36685","heartbeat_front_addr":"172.21.15.73:6805/36685","state":["exists","up"]},{"osd":4,"uuid":"d0922b0e-5170-474d-b270-ddb5adc858cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":36908},{"type":"v1","addr":"172.21.15.156:6801","nonce":36908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":36908},{"type":"v1","addr":"172.21.15.156:6803","nonce":36908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":36908},{"type":"v1","addr":"172.21.15.156:6807","nonce":36908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":36908},{"type":"v1","addr":"172.21.15.156:6805","nonce":36908}]},"public_addr":"172.21.15.156:6801/36908","cluster_addr":"172.21.15.156:6803/36908","heartbeat_back_addr":"172.21.15.156:6807/36908","heartbeat_front_addr":"172.21.15.156:6805/36908","state":["exists","up"]},{"osd":5,"uuid":"f2791a77-db25-479c-95d5-ea7f77458685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":36909},{"type":"v1","addr":"172.21.15.156:6809","nonce":36909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":36909},{"type":"v1","addr":"172.21.15.156:6811","nonce":36909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":36909},{"type":"v1","addr":"172.21.15.156:6815","nonce":36909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":36909},{"type":"v1","addr":"172.21.15.156:6813","nonce":36909}]},"public_addr":"172.21.15.156:6809/36909","cluster_addr":"172.21.15.156:6811/36909","heartbeat_back_addr":"172.21.15.156:6815/36909","heartbeat_front_addr":"172.21.15.156:6813/36909","state":["exists","up"]},{"osd":6,"uuid":"f86c2fe9-ec8b-406e-af26-5dc65c926382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":36910},{"type":"v1","addr":"172.21.15.156:6817","nonce":36910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":36910},{"type":"v1","addr":"172.21.15.156:6819","nonce":36910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":36910},{"type":"v1","addr":"172.21.15.156:6823","nonce":36910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":36910},{"type":"v1","addr":"172.21.15.156:6821","nonce":36910}]},"public_addr":"172.21.15.156:6817/36910","cluster_addr":"172.21.15.156:6819/36910","heartbeat_back_addr":"172.21.15.156:6823/36910","heartbeat_front_addr":"172.21.15.156:6821/36910","state":["exists","up"]},{"osd":7,"uuid":"56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":36911},{"type":"v1","addr":"172.21.15.156:6825","nonce":36911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":36911},{"type":"v1","addr":"172.21.15.156:6827","nonce":36911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":36911},{"type":"v1","addr":"172.21.15.156:6831","nonce":36911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":36911},{"type":"v1","addr":"172.21.15.156:6829","nonce":36911}]},"public_addr":"172.21.15.156:6825/36911","cluster_addr":"172.21.15.156:6827/36911","heartbeat_back_addr":"172.21.15.156:6831/36911","heartbeat_front_addr":"172.21.15.156:6829/36911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.597534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.505493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.811871+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.586741+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.366817+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.101605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.627496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.829046+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T23:12:40.767 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.763+0000 7f01c359e700 1 -- 172.21.15.73:0/4122490420 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f01a4065ad0 msgr2=0x7f01a4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:40.767 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.763+0000 7f01c359e700 1 --2- 172.21.15.73:0/4122490420 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f01a4065ad0 0x7f01a4067f90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f01b4000f60 tx=0x7f01b4007f30 comp rx=0 tx=0).stop 2023-11-30T23:12:40.767 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.763+0000 7f01c359e700 1 -- 172.21.15.73:0/4122490420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01c40b09a0 msgr2=0x7f01c41ce550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:40.767 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.763+0000 7f01c359e700 1 --2- 172.21.15.73:0/4122490420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01c40b09a0 0x7f01c41ce550 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f01bc00b680 tx=0x7f01bc004af0 comp rx=0 tx=0).stop 2023-11-30T23:12:40.768 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.763+0000 7f01c359e700 1 -- 172.21.15.73:0/4122490420 shutdown_connections 2023-11-30T23:12:40.768 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.763+0000 7f01c359e700 1 --2- 172.21.15.73:0/4122490420 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f01a4065ad0 0x7f01a4067f90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:40.768 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.763+0000 7f01c359e700 1 --2- 172.21.15.73:0/4122490420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01c40b09a0 0x7f01c41ce550 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:40.768 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.763+0000 7f01c359e700 1 --2- 172.21.15.73:0/4122490420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c40b05c0 0x7f01c41de9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:40.768 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.763+0000 7f01c359e700 1 --2- 172.21.15.73:0/4122490420 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01c40709b0 0x7f01c406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:40.768 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.763+0000 7f01c359e700 1 -- 172.21.15.73:0/4122490420 >> 172.21.15.73:0/4122490420 conn(0x7f01c40b83e0 msgr2=0x7f01c40b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:40.768 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.763+0000 7f01c359e700 1 -- 172.21.15.73:0/4122490420 shutdown_connections 2023-11-30T23:12:40.768 INFO:teuthology.misc.health.smithi073.stderr:2023-11-30T23:12:40.763+0000 7f01c359e700 1 -- 172.21.15.73:0/4122490420 wait complete. 2023-11-30T23:12:40.778 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-30T23:12:40.778 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-30T23:12:40.778 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-30T23:12:40.779 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-30T23:12:40.781 INFO:tasks.ceph.mds.a:Started 2023-11-30T23:12:40.781 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-30T23:12:40.781 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-30T23:12:40.784 INFO:tasks.ceph.mds.b:Started 2023-11-30T23:12:40.784 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-30T23:12:40.784 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T23:12:40.870 INFO:tasks.ceph.mds.b.smithi156.stdout:starting mds.b at 2023-11-30T23:12:40.873 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2023-11-30T23:12:40.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.883+0000 7f9341555700 1 Processor -- start 2023-11-30T23:12:40.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.883+0000 7f9341555700 1 -- start start 2023-11-30T23:12:40.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9341555700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f933c147c50 0x7f933c1480b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:40.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9341555700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f933c13e120 0x7f933c13e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:40.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9341555700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933c1485f0 con 0x7f933c0b9ff0 2023-11-30T23:12:40.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9341555700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f933c0b82e0 con 0x7f933c13e120 2023-11-30T23:12:40.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9341555700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0b1550 con 0x7f933c147c50 2023-11-30T23:12:40.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9340d54700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f933c13e120 0x7f933c13e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:40.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f933b7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f933c147c50 0x7f933c1480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:40.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f933bfff700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f933c0b9ff0 0x7f933c0b7bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.73:36406/0 (socket says 172.21.15.73:36406) 2023-11-30T23:12:40.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f933bfff700 1 -- 172.21.15.73:0/2204670187 learned_addr learned my addr 172.21.15.73:0/2204670187 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:40.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9340d54700 1 -- 172.21.15.73:0/2204670187 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f933c147c50 msgr2=0x7f933c1480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:40.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9340d54700 1 --2- 172.21.15.73:0/2204670187 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f933c147c50 0x7f933c1480b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:40.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9340d54700 1 -- 172.21.15.73:0/2204670187 >> v1:172.21.15.156:6789/0 conn(0x7f933c0b9ff0 legacy=0x7f933c0b7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:40.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9340d54700 1 -- 172.21.15.73:0/2204670187 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c0ba3d0 con 0x7f933c13e120 2023-11-30T23:12:40.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9340d54700 1 --2- 172.21.15.73:0/2204670187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f933c13e120 0x7f933c13e5b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9334009dc0 tx=0x7f933400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c65b0670ea9f0b9e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:40.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f933affd700 1 -- 172.21.15.73:0/2204670187 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933400e070 con 0x7f933c13e120 2023-11-30T23:12:40.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f933affd700 1 -- 172.21.15.73:0/2204670187 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9334003a40 con 0x7f933c13e120 2023-11-30T23:12:40.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f933affd700 1 -- 172.21.15.73:0/2204670187 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9334003dd0 con 0x7f933c13e120 2023-11-30T23:12:40.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9341555700 1 -- 172.21.15.73:0/2204670187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f933c13e120 msgr2=0x7f933c13e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:40.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9341555700 1 --2- 172.21.15.73:0/2204670187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f933c13e120 0x7f933c13e5b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9334009dc0 tx=0x7f933400b330 comp rx=0 tx=0).stop 2023-11-30T23:12:40.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9341555700 1 -- 172.21.15.73:0/2204670187 shutdown_connections 2023-11-30T23:12:40.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9341555700 1 --2- 172.21.15.73:0/2204670187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f933c13e120 0x7f933c13e5b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:40.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9341555700 1 --2- 172.21.15.73:0/2204670187 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f933c147c50 0x7f933c1480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:40.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9341555700 1 -- 172.21.15.73:0/2204670187 >> 172.21.15.73:0/2204670187 conn(0x7f933c06a180 msgr2=0x7f933c06a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:40.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9341555700 1 -- 172.21.15.73:0/2204670187 shutdown_connections 2023-11-30T23:12:40.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.887+0000 7f9341555700 1 -- 172.21.15.73:0/2204670187 wait complete. 2023-11-30T23:12:40.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f9341555700 1 Processor -- start 2023-11-30T23:12:40.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f9341555700 1 -- start start 2023-11-30T23:12:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f9341555700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f933c0b9ff0 0x7f933c0ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f9341555700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f933c13e120 0x7f933c143890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f9341555700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f933c147c50 0x7f933c143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f9341555700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c143440 con 0x7f933c0b9ff0 2023-11-30T23:12:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f9341555700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0aea10 con 0x7f933c13e120 2023-11-30T23:12:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f9341555700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933c137f20 con 0x7f933c147c50 2023-11-30T23:12:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f933bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f933c0b9ff0 0x7f933c0ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f933b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f933c13e120 0x7f933c143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f9340d54700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f933c147c50 0x7f933c143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f933bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f933c0b9ff0 0x7f933c0ae4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43452/0 (socket says 172.21.15.73:43452) 2023-11-30T23:12:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f933bfff700 1 -- 172.21.15.73:0/3586857360 learned_addr learned my addr 172.21.15.73:0/3586857360 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f933bfff700 1 -- 172.21.15.73:0/3586857360 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f933c147c50 msgr2=0x7f933c143dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f933bfff700 1 --2- 172.21.15.73:0/3586857360 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f933c147c50 0x7f933c143dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f933bfff700 1 -- 172.21.15.73:0/3586857360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f933c13e120 msgr2=0x7f933c143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f933bfff700 1 --2- 172.21.15.73:0/3586857360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f933c13e120 0x7f933c143890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f933bfff700 1 -- 172.21.15.73:0/3586857360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9334009a70 con 0x7f933c0b9ff0 2023-11-30T23:12:40.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f933bfff700 1 --2- 172.21.15.73:0/3586857360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f933c0b9ff0 0x7f933c0ae4d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f932c00c780 tx=0x7f932c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:40.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f9338ff9700 1 -- 172.21.15.73:0/3586857360 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c004ca0 con 0x7f933c0b9ff0 2023-11-30T23:12:40.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f9338ff9700 1 -- 172.21.15.73:0/3586857360 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c004e00 con 0x7f933c0b9ff0 2023-11-30T23:12:40.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f9341555700 1 -- 172.21.15.73:0/3586857360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933c0ad010 con 0x7f933c0b9ff0 2023-11-30T23:12:40.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f9338ff9700 1 -- 172.21.15.73:0/3586857360 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c007310 con 0x7f933c0b9ff0 2023-11-30T23:12:40.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f9341555700 1 -- 172.21.15.73:0/3586857360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f933c0aec60 con 0x7f933c0b9ff0 2023-11-30T23:12:40.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.891+0000 7f9341555700 1 -- 172.21.15.73:0/3586857360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f933c04ed80 con 0x7f933c0b9ff0 2023-11-30T23:12:40.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.895+0000 7f9338ff9700 1 -- 172.21.15.73:0/3586857360 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f932c007470 con 0x7f933c0b9ff0 2023-11-30T23:12:40.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.895+0000 7f9338ff9700 1 --2- 172.21.15.73:0/3586857360 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9328065ad0 0x7f9328067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:40.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.895+0000 7f9338ff9700 1 -- 172.21.15.73:0/3586857360 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f932c082b40 con 0x7f933c0b9ff0 2023-11-30T23:12:40.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.895+0000 7f933b7fe700 1 --2- 172.21.15.73:0/3586857360 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9328065ad0 0x7f9328067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:40.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.895+0000 7f933b7fe700 1 --2- 172.21.15.73:0/3586857360 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9328065ad0 0x7f9328067f90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f933c1dcc30 tx=0x7f9330009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:40.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:40.903+0000 7f9338ff9700 1 -- 172.21.15.73:0/3586857360 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f932c050860 con 0x7f933c0b9ff0 2023-11-30T23:12:41.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.067+0000 7f9341555700 1 -- 172.21.15.73:0/3586857360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f933c13c410 con 0x7f933c0b9ff0 2023-11-30T23:12:41.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.067+0000 7f9338ff9700 1 -- 172.21.15.73:0/3586857360 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f932c053e80 con 0x7f933c0b9ff0 2023-11-30T23:12:41.073 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:41.073 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":16,"fsid":"a677cb6a-4a54-4567-a30d-f0fa4bc22b17","created":"2023-11-30T23:12:23.260968+0000","modified":"2023-11-30T23:12:36.660230+0000","last_up_change":"2023-11-30T23:12:33.649318+0000","last_in_change":"2023-11-30T23:12:25.326689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-30T23:12:34.413317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbf1c93f-0775-4780-8524-cf25792d9aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36686},{"type":"v1","addr":"172.21.15.73:6817","nonce":36686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36686},{"type":"v1","addr":"172.21.15.73:6819","nonce":36686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36686},{"type":"v1","addr":"172.21.15.73:6823","nonce":36686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36686},{"type":"v1","addr":"172.21.15.73:6821","nonce":36686}]},"public_addr":"172.21.15.73:6817/36686","cluster_addr":"172.21.15.73:6819/36686","heartbeat_back_addr":"172.21.15.73:6823/36686","heartbeat_front_addr":"172.21.15.73:6821/36686","state":["exists","up"]},{"osd":1,"uuid":"9d9dd122-9a42-4588-a0d2-50d13b13eba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36687},{"type":"v1","addr":"172.21.15.73:6809","nonce":36687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":36687},{"type":"v1","addr":"172.21.15.73:6811","nonce":36687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36687},{"type":"v1","addr":"172.21.15.73:6815","nonce":36687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36687},{"type":"v1","addr":"172.21.15.73:6813","nonce":36687}]},"public_addr":"172.21.15.73:6809/36687","cluster_addr":"172.21.15.73:6811/36687","heartbeat_back_addr":"172.21.15.73:6815/36687","heartbeat_front_addr":"172.21.15.73:6813/36687","state":["exists","up"]},{"osd":2,"uuid":"68ff4f1e-ec45-42e0-bb83-fe03598e4940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36688},{"type":"v1","addr":"172.21.15.73:6825","nonce":36688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36688},{"type":"v1","addr":"172.21.15.73:6827","nonce":36688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36688},{"type":"v1","addr":"172.21.15.73:6831","nonce":36688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36688},{"type":"v1","addr":"172.21.15.73:6829","nonce":36688}]},"public_addr":"172.21.15.73:6825/36688","cluster_addr":"172.21.15.73:6827/36688","heartbeat_back_addr":"172.21.15.73:6831/36688","heartbeat_front_addr":"172.21.15.73:6829/36688","state":["exists","up"]},{"osd":3,"uuid":"e4b08c98-6a4d-4ec8-a245-59a35f70a16f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36685},{"type":"v1","addr":"172.21.15.73:6801","nonce":36685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36685},{"type":"v1","addr":"172.21.15.73:6803","nonce":36685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":36685},{"type":"v1","addr":"172.21.15.73:6807","nonce":36685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36685},{"type":"v1","addr":"172.21.15.73:6805","nonce":36685}]},"public_addr":"172.21.15.73:6801/36685","cluster_addr":"172.21.15.73:6803/36685","heartbeat_back_addr":"172.21.15.73:6807/36685","heartbeat_front_addr":"172.21.15.73:6805/36685","state":["exists","up"]},{"osd":4,"uuid":"d0922b0e-5170-474d-b270-ddb5adc858cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":36908},{"type":"v1","addr":"172.21.15.156:6801","nonce":36908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":36908},{"type":"v1","addr":"172.21.15.156:6803","nonce":36908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":36908},{"type":"v1","addr":"172.21.15.156:6807","nonce":36908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":36908},{"type":"v1","addr":"172.21.15.156:6805","nonce":36908}]},"public_addr":"172.21.15.156:6801/36908","cluster_addr":"172.21.15.156:6803/36908","heartbeat_back_addr":"172.21.15.156:6807/36908","heartbeat_front_addr":"172.21.15.156:6805/36908","state":["exists","up"]},{"osd":5,"uuid":"f2791a77-db25-479c-95d5-ea7f77458685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":36909},{"type":"v1","addr":"172.21.15.156:6809","nonce":36909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":36909},{"type":"v1","addr":"172.21.15.156:6811","nonce":36909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":36909},{"type":"v1","addr":"172.21.15.156:6815","nonce":36909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":36909},{"type":"v1","addr":"172.21.15.156:6813","nonce":36909}]},"public_addr":"172.21.15.156:6809/36909","cluster_addr":"172.21.15.156:6811/36909","heartbeat_back_addr":"172.21.15.156:6815/36909","heartbeat_front_addr":"172.21.15.156:6813/36909","state":["exists","up"]},{"osd":6,"uuid":"f86c2fe9-ec8b-406e-af26-5dc65c926382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":36910},{"type":"v1","addr":"172.21.15.156:6817","nonce":36910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":36910},{"type":"v1","addr":"172.21.15.156:6819","nonce":36910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":36910},{"type":"v1","addr":"172.21.15.156:6823","nonce":36910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":36910},{"type":"v1","addr":"172.21.15.156:6821","nonce":36910}]},"public_addr":"172.21.15.156:6817/36910","cluster_addr":"172.21.15.156:6819/36910","heartbeat_back_addr":"172.21.15.156:6823/36910","heartbeat_front_addr":"172.21.15.156:6821/36910","state":["exists","up"]},{"osd":7,"uuid":"56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":36911},{"type":"v1","addr":"172.21.15.156:6825","nonce":36911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":36911},{"type":"v1","addr":"172.21.15.156:6827","nonce":36911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":36911},{"type":"v1","addr":"172.21.15.156:6831","nonce":36911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":36911},{"type":"v1","addr":"172.21.15.156:6829","nonce":36911}]},"public_addr":"172.21.15.156:6825/36911","cluster_addr":"172.21.15.156:6827/36911","heartbeat_back_addr":"172.21.15.156:6831/36911","heartbeat_front_addr":"172.21.15.156:6829/36911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.597534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.505493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.811871+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.586741+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.366817+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.101605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.627496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.829046+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T23:12:41.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.071+0000 7f9341555700 1 -- 172.21.15.73:0/3586857360 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9328065ad0 msgr2=0x7f9328067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:41.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.071+0000 7f9341555700 1 --2- 172.21.15.73:0/3586857360 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9328065ad0 0x7f9328067f90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f933c1dcc30 tx=0x7f9330009240 comp rx=0 tx=0).stop 2023-11-30T23:12:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.071+0000 7f9341555700 1 -- 172.21.15.73:0/3586857360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f933c0b9ff0 msgr2=0x7f933c0ae4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.071+0000 7f9341555700 1 --2- 172.21.15.73:0/3586857360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f933c0b9ff0 0x7f933c0ae4d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f932c00c780 tx=0x7f932c00ca90 comp rx=0 tx=0).stop 2023-11-30T23:12:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.071+0000 7f9341555700 1 -- 172.21.15.73:0/3586857360 shutdown_connections 2023-11-30T23:12:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.071+0000 7f9341555700 1 --2- 172.21.15.73:0/3586857360 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f933c147c50 0x7f933c143dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.071+0000 7f9341555700 1 --2- 172.21.15.73:0/3586857360 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9328065ad0 0x7f9328067f90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.071+0000 7f9341555700 1 --2- 172.21.15.73:0/3586857360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f933c13e120 0x7f933c143890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.071+0000 7f9341555700 1 --2- 172.21.15.73:0/3586857360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f933c0b9ff0 0x7f933c0ae4d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.071+0000 7f9341555700 1 -- 172.21.15.73:0/3586857360 >> 172.21.15.73:0/3586857360 conn(0x7f933c06a180 msgr2=0x7f933c13b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.071+0000 7f9341555700 1 -- 172.21.15.73:0/3586857360 shutdown_connections 2023-11-30T23:12:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.071+0000 7f9341555700 1 -- 172.21.15.73:0/3586857360 wait complete. 2023-11-30T23:12:41.087 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-30T23:12:34.413317+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-30T23:12:41.087 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-30T23:12:41.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.195+0000 7fc97c329700 1 Processor -- start 2023-11-30T23:12:41.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.195+0000 7fc97c329700 1 -- start start 2023-11-30T23:12:41.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.195+0000 7fc97c329700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc9740b4b70 0x7fc9740b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:41.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.195+0000 7fc97c329700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc974143fa0 0x7fc97413d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:41.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.195+0000 7fc97c329700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9740b2210 con 0x7fc974073380 2023-11-30T23:12:41.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.195+0000 7fc97c329700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97406ef20 con 0x7fc9740b4b70 2023-11-30T23:12:41.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.195+0000 7fc97c329700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc974073760 con 0x7fc974143fa0 2023-11-30T23:12:41.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.195+0000 7fc97a0c5700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc974073380 0x7fc974143890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48248/0 (socket says 172.21.15.73:48248) 2023-11-30T23:12:41.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.195+0000 7fc97a0c5700 1 -- 172.21.15.73:0/2671416445 learned_addr learned my addr 172.21.15.73:0/2671416445 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:41.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.195+0000 7fc97a8c6700 1 --2- 172.21.15.73:0/2671416445 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc974143fa0 0x7fc97413d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:41.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.195+0000 7fc9798c4700 1 --2- 172.21.15.73:0/2671416445 >> v2:172.21.15.156:3300/0 conn(0x7fc9740b4b70 0x7fc9740b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:41.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.195+0000 7fc9790c3700 1 -- 172.21.15.73:0/2671416445 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493705855 0 0) 0x7fc9740b2210 con 0x7fc974073380 2023-11-30T23:12:41.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.195+0000 7fc9790c3700 1 -- 172.21.15.73:0/2671416445 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9600035d0 con 0x7fc974073380 2023-11-30T23:12:41.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.199+0000 7fc97a8c6700 1 -- 172.21.15.73:0/2671416445 >> v2:172.21.15.156:3300/0 conn(0x7fc9740b4b70 msgr2=0x7fc9740b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:41.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.199+0000 7fc97a8c6700 1 --2- 172.21.15.73:0/2671416445 >> v2:172.21.15.156:3300/0 conn(0x7fc9740b4b70 0x7fc9740b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.199+0000 7fc97a8c6700 1 -- 172.21.15.73:0/2671416445 >> v1:172.21.15.73:6789/0 conn(0x7fc974073380 legacy=0x7fc974143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:41.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.199+0000 7fc97a8c6700 1 -- 172.21.15.73:0/2671416445 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9740b1bc0 con 0x7fc974143fa0 2023-11-30T23:12:41.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.199+0000 7fc9798c4700 1 --2- 172.21.15.73:0/2671416445 >> v2:172.21.15.156:3300/0 conn(0x7fc9740b4b70 0x7fc9740b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:41.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.199+0000 7fc97a8c6700 1 --2- 172.21.15.73:0/2671416445 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc974143fa0 0x7fc97413d2c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009d90 tx=0x7fc96c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5108032085ebe29c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:41.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.199+0000 7fc9790c3700 1 -- 172.21.15.73:0/2671416445 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00bd20 con 0x7fc974143fa0 2023-11-30T23:12:41.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.199+0000 7fc9790c3700 1 -- 172.21.15.73:0/2671416445 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c00be80 con 0x7fc974143fa0 2023-11-30T23:12:41.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.199+0000 7fc9790c3700 1 -- 172.21.15.73:0/2671416445 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c0116a0 con 0x7fc974143fa0 2023-11-30T23:12:41.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.199+0000 7fc97c329700 1 -- 172.21.15.73:0/2671416445 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc974143fa0 msgr2=0x7fc97413d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:41.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.199+0000 7fc97c329700 1 --2- 172.21.15.73:0/2671416445 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc974143fa0 0x7fc97413d2c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009d90 tx=0x7fc96c00b330 comp rx=0 tx=0).stop 2023-11-30T23:12:41.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.199+0000 7fc97c329700 1 -- 172.21.15.73:0/2671416445 shutdown_connections 2023-11-30T23:12:41.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.199+0000 7fc97c329700 1 --2- 172.21.15.73:0/2671416445 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc974143fa0 0x7fc97413d2c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.199+0000 7fc97c329700 1 --2- 172.21.15.73:0/2671416445 >> v2:172.21.15.156:3300/0 conn(0x7fc9740b4b70 0x7fc9740b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.199+0000 7fc97c329700 1 -- 172.21.15.73:0/2671416445 >> 172.21.15.73:0/2671416445 conn(0x7fc9740b51c0 msgr2=0x7fc9740b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:41.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.199+0000 7fc97c329700 1 -- 172.21.15.73:0/2671416445 shutdown_connections 2023-11-30T23:12:41.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.199+0000 7fc97c329700 1 -- 172.21.15.73:0/2671416445 wait complete. 2023-11-30T23:12:41.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97c329700 1 Processor -- start 2023-11-30T23:12:41.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97c329700 1 -- start start 2023-11-30T23:12:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97c329700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc974073380 0x7fc974071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97c329700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9740b4b70 0x7fc9741451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97c329700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc974143fa0 0x7fc9741456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97c329700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740707d0 con 0x7fc974073380 2023-11-30T23:12:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97c329700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc974146af0 con 0x7fc9740b4b70 2023-11-30T23:12:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97c329700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9741448a0 con 0x7fc974143fa0 2023-11-30T23:12:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97a0c5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc974073380 0x7fc974071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97a0c5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc974073380 0x7fc974071fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43456/0 (socket says 172.21.15.73:43456) 2023-11-30T23:12:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97a0c5700 1 -- 172.21.15.73:0/2951757708 learned_addr learned my addr 172.21.15.73:0/2951757708 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97a8c6700 1 --2- 172.21.15.73:0/2951757708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc974143fa0 0x7fc9741456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc9798c4700 1 --2- 172.21.15.73:0/2951757708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9740b4b70 0x7fc9741451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:41.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97a0c5700 1 -- 172.21.15.73:0/2951757708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc974143fa0 msgr2=0x7fc9741456e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97a0c5700 1 --2- 172.21.15.73:0/2951757708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc974143fa0 0x7fc9741456e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97a0c5700 1 -- 172.21.15.73:0/2951757708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9740b4b70 msgr2=0x7fc9741451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97a0c5700 1 --2- 172.21.15.73:0/2951757708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9740b4b70 0x7fc9741451a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97a0c5700 1 -- 172.21.15.73:0/2951757708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9640094b0 con 0x7fc974073380 2023-11-30T23:12:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc9798c4700 1 --2- 172.21.15.73:0/2951757708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9740b4b70 0x7fc9741451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:12:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97a8c6700 1 --2- 172.21.15.73:0/2951757708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc974143fa0 0x7fc9741456e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:12:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.203+0000 7fc97a0c5700 1 --2- 172.21.15.73:0/2951757708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc974073380 0x7fc974071fa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc97000c700 tx=0x7fc97000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.207+0000 7fc96affd700 1 -- 172.21.15.73:0/2951757708 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970005d90 con 0x7fc974073380 2023-11-30T23:12:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.207+0000 7fc97c329700 1 -- 172.21.15.73:0/2951757708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96c009a70 con 0x7fc974073380 2023-11-30T23:12:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.207+0000 7fc97c329700 1 -- 172.21.15.73:0/2951757708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc974146730 con 0x7fc974073380 2023-11-30T23:12:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.207+0000 7fc96affd700 1 -- 172.21.15.73:0/2951757708 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9700012f0 con 0x7fc974073380 2023-11-30T23:12:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.207+0000 7fc96affd700 1 -- 172.21.15.73:0/2951757708 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9700072d0 con 0x7fc974073380 2023-11-30T23:12:41.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.207+0000 7fc97c329700 1 -- 172.21.15.73:0/2951757708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95c005310 con 0x7fc974073380 2023-11-30T23:12:41.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.207+0000 7fc96affd700 1 -- 172.21.15.73:0/2951757708 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc970007430 con 0x7fc974073380 2023-11-30T23:12:41.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.207+0000 7fc96affd700 1 --2- 172.21.15.73:0/2951757708 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc958065ad0 0x7fc958067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:41.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.207+0000 7fc9798c4700 1 --2- 172.21.15.73:0/2951757708 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc958065ad0 0x7fc958067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:41.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.207+0000 7fc96affd700 1 -- 172.21.15.73:0/2951757708 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc9700823c0 con 0x7fc974073380 2023-11-30T23:12:41.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.211+0000 7fc9798c4700 1 --2- 172.21.15.73:0/2951757708 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc958065ad0 0x7fc958067f90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc974072740 tx=0x7fc964008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:41.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.219+0000 7fc96affd700 1 -- 172.21.15.73:0/2951757708 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fc9700500f0 con 0x7fc974073380 2023-11-30T23:12:41.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.383+0000 7fc97c329700 1 -- 172.21.15.73:0/2951757708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc95c005b40 con 0x7fc974073380 2023-11-30T23:12:41.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.383+0000 7fc96affd700 1 -- 172.21.15.73:0/2951757708 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc970053710 con 0x7fc974073380 2023-11-30T23:12:41.388 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-11-30T23:12:41.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.387+0000 7fc97c329700 1 -- 172.21.15.73:0/2951757708 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc958065ad0 msgr2=0x7fc958067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:41.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.387+0000 7fc97c329700 1 --2- 172.21.15.73:0/2951757708 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc958065ad0 0x7fc958067f90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc974072740 tx=0x7fc964008040 comp rx=0 tx=0).stop 2023-11-30T23:12:41.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.387+0000 7fc97c329700 1 -- 172.21.15.73:0/2951757708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc974073380 msgr2=0x7fc974071fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:41.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.387+0000 7fc97c329700 1 --2- 172.21.15.73:0/2951757708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc974073380 0x7fc974071fa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc97000c700 tx=0x7fc97000cac0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.387+0000 7fc97c329700 1 -- 172.21.15.73:0/2951757708 shutdown_connections 2023-11-30T23:12:41.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.387+0000 7fc97c329700 1 --2- 172.21.15.73:0/2951757708 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc974143fa0 0x7fc9741456e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.387+0000 7fc97c329700 1 --2- 172.21.15.73:0/2951757708 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc958065ad0 0x7fc958067f90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.387+0000 7fc97c329700 1 --2- 172.21.15.73:0/2951757708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9740b4b70 0x7fc9741451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.387+0000 7fc97c329700 1 --2- 172.21.15.73:0/2951757708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc974073380 0x7fc974071fa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.387+0000 7fc97c329700 1 -- 172.21.15.73:0/2951757708 >> 172.21.15.73:0/2951757708 conn(0x7fc9740b51c0 msgr2=0x7fc9740b7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:41.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.387+0000 7fc97c329700 1 -- 172.21.15.73:0/2951757708 shutdown_connections 2023-11-30T23:12:41.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.387+0000 7fc97c329700 1 -- 172.21.15.73:0/2951757708 wait complete. 2023-11-30T23:12:41.408 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T23:12:41.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc6639f700 1 Processor -- start 2023-11-30T23:12:41.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc6639f700 1 -- start start 2023-11-30T23:12:41.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc6639f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbc6006f420 0x7fbc600b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:41.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc6639f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc60140cf0 0x7fbc60146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:41.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc6639f700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6006a590 con 0x7fbc60146790 2023-11-30T23:12:41.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc6639f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6006f800 con 0x7fbc6006f420 2023-11-30T23:12:41.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc6639f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6006a220 con 0x7fbc60140cf0 2023-11-30T23:12:41.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc6539d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbc6006f420 0x7fbc600b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:41.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc65b9e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc60140cf0 0x7fbc60146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:41.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc64b9c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbc60146790 0x7fbc601405e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.73:36420/0 (socket says 172.21.15.73:36420) 2023-11-30T23:12:41.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc64b9c700 1 -- 172.21.15.73:0/3875243863 learned_addr learned my addr 172.21.15.73:0/3875243863 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc65b9e700 1 -- 172.21.15.73:0/3875243863 >> v2:172.21.15.156:3300/0 conn(0x7fbc6006f420 msgr2=0x7fbc600b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc65b9e700 1 --2- 172.21.15.73:0/3875243863 >> v2:172.21.15.156:3300/0 conn(0x7fbc6006f420 0x7fbc600b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc65b9e700 1 -- 172.21.15.73:0/3875243863 >> v1:172.21.15.156:6789/0 conn(0x7fbc60146790 legacy=0x7fbc601405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc65b9e700 1 -- 172.21.15.73:0/3875243863 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6006afc0 con 0x7fbc60140cf0 2023-11-30T23:12:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc65b9e700 1 --2- 172.21.15.73:0/3875243863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc60140cf0 0x7fbc60146bb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009d90 tx=0x7fbc5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d54c18a0189c6987 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc57fff700 1 -- 172.21.15.73:0/3875243863 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5800e070 con 0x7fbc60140cf0 2023-11-30T23:12:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc57fff700 1 -- 172.21.15.73:0/3875243863 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5800bb20 con 0x7fbc60140cf0 2023-11-30T23:12:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc57fff700 1 -- 172.21.15.73:0/3875243863 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58012430 con 0x7fbc60140cf0 2023-11-30T23:12:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc6639f700 1 -- 172.21.15.73:0/3875243863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc60140cf0 msgr2=0x7fbc60146bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc6639f700 1 --2- 172.21.15.73:0/3875243863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc60140cf0 0x7fbc60146bb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009d90 tx=0x7fbc5800b330 comp rx=0 tx=0).stop 2023-11-30T23:12:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc6639f700 1 -- 172.21.15.73:0/3875243863 shutdown_connections 2023-11-30T23:12:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc6639f700 1 --2- 172.21.15.73:0/3875243863 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc60140cf0 0x7fbc60146bb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc6639f700 1 --2- 172.21.15.73:0/3875243863 >> v2:172.21.15.156:3300/0 conn(0x7fbc6006f420 0x7fbc600b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc6639f700 1 -- 172.21.15.73:0/3875243863 >> 172.21.15.73:0/3875243863 conn(0x7fbc6006b290 msgr2=0x7fbc6006b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:41.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc6639f700 1 -- 172.21.15.73:0/3875243863 shutdown_connections 2023-11-30T23:12:41.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.515+0000 7fbc6639f700 1 -- 172.21.15.73:0/3875243863 wait complete. 2023-11-30T23:12:41.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc6639f700 1 Processor -- start 2023-11-30T23:12:41.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc6639f700 1 -- start start 2023-11-30T23:12:41.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc6639f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc6006f420 0x7fbc600ad800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:41.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc6639f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc60140cf0 0x7fbc60143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc6639f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc60146790 0x7fbc60143b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc6639f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6013f970 con 0x7fbc60146790 2023-11-30T23:12:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc6639f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600af6e0 con 0x7fbc60140cf0 2023-11-30T23:12:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc6639f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600acdf0 con 0x7fbc6006f420 2023-11-30T23:12:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc65b9e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc60146790 0x7fbc60143b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc65b9e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc60146790 0x7fbc60143b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43460/0 (socket says 172.21.15.73:43460) 2023-11-30T23:12:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc65b9e700 1 -- 172.21.15.73:0/2952321134 learned_addr learned my addr 172.21.15.73:0/2952321134 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc6539d700 1 --2- 172.21.15.73:0/2952321134 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc6006f420 0x7fbc600ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc64b9c700 1 --2- 172.21.15.73:0/2952321134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc60140cf0 0x7fbc60143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc65b9e700 1 -- 172.21.15.73:0/2952321134 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc6006f420 msgr2=0x7fbc600ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc65b9e700 1 --2- 172.21.15.73:0/2952321134 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc6006f420 0x7fbc600ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc65b9e700 1 -- 172.21.15.73:0/2952321134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc60140cf0 msgr2=0x7fbc60143630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc65b9e700 1 --2- 172.21.15.73:0/2952321134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc60140cf0 0x7fbc60143630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc65b9e700 1 -- 172.21.15.73:0/2952321134 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc58009a70 con 0x7fbc60146790 2023-11-30T23:12:41.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc65b9e700 1 --2- 172.21.15.73:0/2952321134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc60146790 0x7fbc60143b70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbc58014040 tx=0x7fbc58004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:41.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc55ffb700 1 -- 172.21.15.73:0/2952321134 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58012430 con 0x7fbc60146790 2023-11-30T23:12:41.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc55ffb700 1 -- 172.21.15.73:0/2952321134 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc58020070 con 0x7fbc60146790 2023-11-30T23:12:41.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc6639f700 1 -- 172.21.15.73:0/2952321134 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc600ad0d0 con 0x7fbc60146790 2023-11-30T23:12:41.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc55ffb700 1 -- 172.21.15.73:0/2952321134 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58004040 con 0x7fbc60146790 2023-11-30T23:12:41.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.519+0000 7fbc6639f700 1 -- 172.21.15.73:0/2952321134 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc600add40 con 0x7fbc60146790 2023-11-30T23:12:41.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.523+0000 7fbc6639f700 1 -- 172.21.15.73:0/2952321134 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6004ed80 con 0x7fbc60146790 2023-11-30T23:12:41.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.523+0000 7fbc55ffb700 1 -- 172.21.15.73:0/2952321134 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbc580041a0 con 0x7fbc60146790 2023-11-30T23:12:41.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.523+0000 7fbc55ffb700 1 --2- 172.21.15.73:0/2952321134 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbc44065ad0 0x7fbc44067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:41.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.523+0000 7fbc55ffb700 1 -- 172.21.15.73:0/2952321134 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbc58022070 con 0x7fbc60146790 2023-11-30T23:12:41.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.523+0000 7fbc6539d700 1 --2- 172.21.15.73:0/2952321134 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbc44065ad0 0x7fbc44067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:41.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.523+0000 7fbc6539d700 1 --2- 172.21.15.73:0/2952321134 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbc44065ad0 0x7fbc44067f90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbc600708f0 tx=0x7fbc5c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:41.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.527+0000 7fbc55ffb700 1 -- 172.21.15.73:0/2952321134 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fbc58052d70 con 0x7fbc60146790 2023-11-30T23:12:41.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.731+0000 7fbc6639f700 1 -- 172.21.15.73:0/2952321134 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc6006c8f0 con 0x7fbc60146790 2023-11-30T23:12:41.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.731+0000 7fbc55ffb700 1 -- 172.21.15.73:0/2952321134 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7fbc5802c070 con 0x7fbc60146790 2023-11-30T23:12:41.736 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:41.736 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/1140380051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":1140380051},{"type":"v1","addr":"172.21.15.156:6833","nonce":1140380051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-11-30T23:12:41.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.735+0000 7fbc6639f700 1 -- 172.21.15.73:0/2952321134 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbc44065ad0 msgr2=0x7fbc44067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:41.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.735+0000 7fbc6639f700 1 --2- 172.21.15.73:0/2952321134 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbc44065ad0 0x7fbc44067f90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbc600708f0 tx=0x7fbc5c009240 comp rx=0 tx=0).stop 2023-11-30T23:12:41.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.735+0000 7fbc6639f700 1 -- 172.21.15.73:0/2952321134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc60146790 msgr2=0x7fbc60143b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:41.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.735+0000 7fbc6639f700 1 --2- 172.21.15.73:0/2952321134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc60146790 0x7fbc60143b70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbc58014040 tx=0x7fbc58004af0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.735+0000 7fbc6639f700 1 -- 172.21.15.73:0/2952321134 shutdown_connections 2023-11-30T23:12:41.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.735+0000 7fbc6639f700 1 --2- 172.21.15.73:0/2952321134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc60146790 0x7fbc60143b70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.735+0000 7fbc6639f700 1 --2- 172.21.15.73:0/2952321134 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbc44065ad0 0x7fbc44067f90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.735+0000 7fbc6639f700 1 --2- 172.21.15.73:0/2952321134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc60140cf0 0x7fbc60143630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.735+0000 7fbc6639f700 1 --2- 172.21.15.73:0/2952321134 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbc6006f420 0x7fbc600ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:41.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.735+0000 7fbc6639f700 1 -- 172.21.15.73:0/2952321134 >> 172.21.15.73:0/2952321134 conn(0x7fbc6006b290 msgr2=0x7fbc60066490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:41.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.735+0000 7fbc6639f700 1 -- 172.21.15.73:0/2952321134 shutdown_connections 2023-11-30T23:12:41.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:41.735+0000 7fbc6639f700 1 -- 172.21.15.73:0/2952321134 wait complete. 2023-11-30T23:12:41.740 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 2 2023-11-30T23:12:43.751 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T23:12:43.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.867+0000 7f08662c0700 1 Processor -- start 2023-11-30T23:12:43.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.867+0000 7f08662c0700 1 -- start start 2023-11-30T23:12:43.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08662c0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f086006af10 0x7f08600b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:43.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08662c0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f08600711a0 0x7f0860071650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:43.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08662c0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08600b2800 con 0x7f0860142980 2023-11-30T23:12:43.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08662c0700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08600b19e0 con 0x7f086006af10 2023-11-30T23:12:43.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08662c0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08600b17c0 con 0x7f08600711a0 2023-11-30T23:12:43.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08652be700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f086006af10 0x7f08600b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:43.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08652be700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f086006af10 0x7f08600b1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33780/0 (socket says 172.21.15.73:33780) 2023-11-30T23:12:43.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08652be700 1 -- 172.21.15.73:0/2669820893 learned_addr learned my addr 172.21.15.73:0/2669820893 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:43.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08652be700 1 -- 172.21.15.73:0/2669820893 >> v2:172.21.15.156:3300/0 conn(0x7f08600711a0 msgr2=0x7f0860071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:43.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08652be700 1 --2- 172.21.15.73:0/2669820893 >> v2:172.21.15.156:3300/0 conn(0x7f08600711a0 0x7f0860071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:43.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08652be700 1 -- 172.21.15.73:0/2669820893 >> v1:172.21.15.73:6789/0 conn(0x7f0860142980 legacy=0x7f08600b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:43.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08652be700 1 -- 172.21.15.73:0/2669820893 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086006b2f0 con 0x7f086006af10 2023-11-30T23:12:43.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08652be700 1 --2- 172.21.15.73:0/2669820893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f086006af10 0x7f08600b1280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f086006e5d0 tx=0x7f085c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b6b1856fa9669f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:43.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f0857fff700 1 -- 172.21.15.73:0/2669820893 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c00bb80 con 0x7f086006af10 2023-11-30T23:12:43.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f0857fff700 1 -- 172.21.15.73:0/2669820893 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c00bce0 con 0x7f086006af10 2023-11-30T23:12:43.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f0857fff700 1 -- 172.21.15.73:0/2669820893 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c0106c0 con 0x7f086006af10 2023-11-30T23:12:43.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08662c0700 1 -- 172.21.15.73:0/2669820893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f086006af10 msgr2=0x7f08600b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:43.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08662c0700 1 --2- 172.21.15.73:0/2669820893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f086006af10 0x7f08600b1280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f086006e5d0 tx=0x7f085c00b330 comp rx=0 tx=0).stop 2023-11-30T23:12:43.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08662c0700 1 -- 172.21.15.73:0/2669820893 shutdown_connections 2023-11-30T23:12:43.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08662c0700 1 --2- 172.21.15.73:0/2669820893 >> v2:172.21.15.156:3300/0 conn(0x7f08600711a0 0x7f0860071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:43.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08662c0700 1 --2- 172.21.15.73:0/2669820893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f086006af10 0x7f08600b1280 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:43.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08662c0700 1 -- 172.21.15.73:0/2669820893 >> 172.21.15.73:0/2669820893 conn(0x7f086006a180 msgr2=0x7f086006a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:43.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08662c0700 1 -- 172.21.15.73:0/2669820893 shutdown_connections 2023-11-30T23:12:43.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.871+0000 7f08662c0700 1 -- 172.21.15.73:0/2669820893 wait complete. 2023-11-30T23:12:43.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08662c0700 1 Processor -- start 2023-11-30T23:12:43.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08662c0700 1 -- start start 2023-11-30T23:12:43.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08662c0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f086006af10 0x7f08600b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:43.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08662c0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08600711a0 0x7f0860133330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:43.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08662c0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0860142980 0x7f08601d5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:43.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08662c0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08601ccd80 con 0x7f086006af10 2023-11-30T23:12:43.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08662c0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0860133c20 con 0x7f08600711a0 2023-11-30T23:12:43.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08662c0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0860133ec0 con 0x7f0860142980 2023-11-30T23:12:43.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08652be700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f086006af10 0x7f08600b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:43.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08652be700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f086006af10 0x7f08600b7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33790/0 (socket says 172.21.15.73:33790) 2023-11-30T23:12:43.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08652be700 1 -- 172.21.15.73:0/1196990372 learned_addr learned my addr 172.21.15.73:0/1196990372 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:43.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f0864abd700 1 --2- 172.21.15.73:0/1196990372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08600711a0 0x7f0860133330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:43.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f0865abf700 1 --2- 172.21.15.73:0/1196990372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0860142980 0x7f08601d5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:43.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08652be700 1 -- 172.21.15.73:0/1196990372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0860142980 msgr2=0x7f08601d5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:43.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08652be700 1 --2- 172.21.15.73:0/1196990372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0860142980 0x7f08601d5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:43.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08652be700 1 -- 172.21.15.73:0/1196990372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08600711a0 msgr2=0x7f0860133330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:43.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08652be700 1 --2- 172.21.15.73:0/1196990372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08600711a0 0x7f0860133330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:43.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08652be700 1 -- 172.21.15.73:0/1196990372 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c009b30 con 0x7f086006af10 2023-11-30T23:12:43.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f0865abf700 1 --2- 172.21.15.73:0/1196990372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0860142980 0x7f08601d5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-30T23:12:43.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08652be700 1 --2- 172.21.15.73:0/1196990372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f086006af10 0x7f08600b7e10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0860065fe0 tx=0x7f085c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:43.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f0855ffb700 1 -- 172.21.15.73:0/1196990372 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c010c80 con 0x7f086006af10 2023-11-30T23:12:43.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f0855ffb700 1 -- 172.21.15.73:0/1196990372 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c010e00 con 0x7f086006af10 2023-11-30T23:12:43.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08662c0700 1 -- 172.21.15.73:0/1196990372 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08601cc860 con 0x7f086006af10 2023-11-30T23:12:43.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f0855ffb700 1 -- 172.21.15.73:0/1196990372 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c004280 con 0x7f086006af10 2023-11-30T23:12:43.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.875+0000 7f08662c0700 1 -- 172.21.15.73:0/1196990372 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0860133870 con 0x7f086006af10 2023-11-30T23:12:43.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.879+0000 7f08662c0700 1 -- 172.21.15.73:0/1196990372 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08601cc6d0 con 0x7f086006af10 2023-11-30T23:12:43.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.879+0000 7f0855ffb700 1 -- 172.21.15.73:0/1196990372 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f085c0043e0 con 0x7f086006af10 2023-11-30T23:12:43.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.879+0000 7f0855ffb700 1 --2- 172.21.15.73:0/1196990372 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0844065b00 0x7f0844067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:43.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.879+0000 7f0864abd700 1 --2- 172.21.15.73:0/1196990372 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0844065b00 0x7f0844067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:43.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.879+0000 7f0855ffb700 1 -- 172.21.15.73:0/1196990372 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f085c00e040 con 0x7f086006af10 2023-11-30T23:12:43.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.879+0000 7f0864abd700 1 --2- 172.21.15.73:0/1196990372 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0844065b00 0x7f0844067fc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0860142df0 tx=0x7f0850009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:43.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:43.887+0000 7f0855ffb700 1 -- 172.21.15.73:0/1196990372 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f085c052870 con 0x7f086006af10 2023-11-30T23:12:44.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.087+0000 7f08662c0700 1 -- 172.21.15.73:0/1196990372 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08601cca50 con 0x7f086006af10 2023-11-30T23:12:44.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.087+0000 7f0855ffb700 1 -- 172.21.15.73:0/1196990372 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2015 (secure 0 0 0) 0x7f085c055e90 con 0x7f086006af10 2023-11-30T23:12:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:44.092 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3213239947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3213239947},{"type":"v1","addr":"172.21.15.73:6835","nonce":3213239947}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/1140380051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":1140380051},{"type":"v1","addr":"172.21.15.156:6833","nonce":1140380051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-11-30T23:12:44.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.091+0000 7f08662c0700 1 -- 172.21.15.73:0/1196990372 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0844065b00 msgr2=0x7f0844067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:44.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.091+0000 7f08662c0700 1 --2- 172.21.15.73:0/1196990372 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0844065b00 0x7f0844067fc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0860142df0 tx=0x7f0850009040 comp rx=0 tx=0).stop 2023-11-30T23:12:44.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.091+0000 7f08662c0700 1 -- 172.21.15.73:0/1196990372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f086006af10 msgr2=0x7f08600b7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:44.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.091+0000 7f08662c0700 1 --2- 172.21.15.73:0/1196990372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f086006af10 0x7f08600b7e10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0860065fe0 tx=0x7f085c004af0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.091+0000 7f08662c0700 1 -- 172.21.15.73:0/1196990372 shutdown_connections 2023-11-30T23:12:44.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.091+0000 7f08662c0700 1 --2- 172.21.15.73:0/1196990372 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0860142980 0x7f08601d5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.091+0000 7f08662c0700 1 --2- 172.21.15.73:0/1196990372 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0844065b00 0x7f0844067fc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.091+0000 7f08662c0700 1 --2- 172.21.15.73:0/1196990372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08600711a0 0x7f0860133330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.091+0000 7f08662c0700 1 --2- 172.21.15.73:0/1196990372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f086006af10 0x7f08600b7e10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.091+0000 7f08662c0700 1 -- 172.21.15.73:0/1196990372 >> 172.21.15.73:0/1196990372 conn(0x7f086006a180 msgr2=0x7f08601ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:44.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.091+0000 7f08662c0700 1 -- 172.21.15.73:0/1196990372 shutdown_connections 2023-11-30T23:12:44.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.091+0000 7f08662c0700 1 -- 172.21.15.73:0/1196990372 wait complete. 2023-11-30T23:12:44.096 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 3 2023-11-30T23:12:44.107 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T23:12:44.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff74759e700 1 Processor -- start 2023-11-30T23:12:44.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff74759e700 1 -- start start 2023-11-30T23:12:44.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff74759e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff7480b4b10 0x7ff748146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff74759e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7480b6910 0x7ff7480b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff74759e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff748140cf0 con 0x7ff7481401e0 2023-11-30T23:12:44.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff74759e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7480b5f50 con 0x7ff7480b4b10 2023-11-30T23:12:44.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff74759e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7480b43c0 con 0x7ff7480b6910 2023-11-30T23:12:44.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff746d9d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff7481401e0 0x7ff7481405e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36978/0 (socket says 172.21.15.73:36978) 2023-11-30T23:12:44.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff746d9d700 1 -- 172.21.15.73:0/607721645 learned_addr learned my addr 172.21.15.73:0/607721645 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:44.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff745d9b700 1 --2- 172.21.15.73:0/607721645 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7480b6910 0x7ff7480b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff74659c700 1 --2- 172.21.15.73:0/607721645 >> v2:172.21.15.156:3300/0 conn(0x7ff7480b4b10 0x7ff748146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff74559a700 1 -- 172.21.15.73:0/607721645 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995672834 0 0) 0x7ff748140cf0 con 0x7ff7481401e0 2023-11-30T23:12:44.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff74559a700 1 -- 172.21.15.73:0/607721645 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7280035d0 con 0x7ff7481401e0 2023-11-30T23:12:44.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff74659c700 1 -- 172.21.15.73:0/607721645 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7480b6910 msgr2=0x7ff7480b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:44.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff74659c700 1 --2- 172.21.15.73:0/607721645 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7480b6910 0x7ff7480b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff74659c700 1 -- 172.21.15.73:0/607721645 >> v1:172.21.15.73:6789/0 conn(0x7ff7481401e0 legacy=0x7ff7481405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:44.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff74659c700 1 -- 172.21.15.73:0/607721645 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7480b6130 con 0x7ff7480b4b10 2023-11-30T23:12:44.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff74659c700 1 --2- 172.21.15.73:0/607721645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7480b4b10 0x7ff748146fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff740009d90 tx=0x7ff74000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dc510b3f2855d68 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:44.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff74559a700 1 -- 172.21.15.73:0/607721645 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74000e070 con 0x7ff7480b4b10 2023-11-30T23:12:44.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff74559a700 1 -- 172.21.15.73:0/607721645 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74000bb20 con 0x7ff7480b4b10 2023-11-30T23:12:44.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.211+0000 7ff74559a700 1 -- 172.21.15.73:0/607721645 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74000be90 con 0x7ff7480b4b10 2023-11-30T23:12:44.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.215+0000 7ff74759e700 1 -- 172.21.15.73:0/607721645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7480b4b10 msgr2=0x7ff748146fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:44.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.215+0000 7ff74759e700 1 --2- 172.21.15.73:0/607721645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7480b4b10 0x7ff748146fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff740009d90 tx=0x7ff74000b330 comp rx=0 tx=0).stop 2023-11-30T23:12:44.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.215+0000 7ff74759e700 1 -- 172.21.15.73:0/607721645 shutdown_connections 2023-11-30T23:12:44.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.215+0000 7ff74759e700 1 --2- 172.21.15.73:0/607721645 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7480b6910 0x7ff7480b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.215+0000 7ff74759e700 1 --2- 172.21.15.73:0/607721645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7480b4b10 0x7ff748146fa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.215+0000 7ff74759e700 1 -- 172.21.15.73:0/607721645 >> 172.21.15.73:0/607721645 conn(0x7ff7480b8a10 msgr2=0x7ff7480b8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:44.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.215+0000 7ff74759e700 1 -- 172.21.15.73:0/607721645 shutdown_connections 2023-11-30T23:12:44.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.215+0000 7ff74759e700 1 -- 172.21.15.73:0/607721645 wait complete. 2023-11-30T23:12:44.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.215+0000 7ff74759e700 1 Processor -- start 2023-11-30T23:12:44.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.215+0000 7ff74759e700 1 -- start start 2023-11-30T23:12:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.215+0000 7ff74759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7480b4b10 0x7ff7481deed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.215+0000 7ff74759e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7480b6910 0x7ff7480b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.215+0000 7ff74759e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7481401e0 0x7ff7480b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff74759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74813e130 con 0x7ff7480b4b10 2023-11-30T23:12:44.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff74759e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff748142f40 con 0x7ff7481401e0 2023-11-30T23:12:44.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff74759e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7481df7a0 con 0x7ff7480b6910 2023-11-30T23:12:44.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff74659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7480b4b10 0x7ff7481deed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff74659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7480b4b10 0x7ff7481deed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33794/0 (socket says 172.21.15.73:33794) 2023-11-30T23:12:44.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff74659c700 1 -- 172.21.15.73:0/3381583883 learned_addr learned my addr 172.21.15.73:0/3381583883 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:44.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff746d9d700 1 --2- 172.21.15.73:0/3381583883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7481401e0 0x7ff7480b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff745d9b700 1 --2- 172.21.15.73:0/3381583883 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7480b6910 0x7ff7480b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff74659c700 1 -- 172.21.15.73:0/3381583883 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7480b6910 msgr2=0x7ff7480b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:44.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff74659c700 1 --2- 172.21.15.73:0/3381583883 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7480b6910 0x7ff7480b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff74659c700 1 -- 172.21.15.73:0/3381583883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7481401e0 msgr2=0x7ff7480b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:44.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff74659c700 1 --2- 172.21.15.73:0/3381583883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7481401e0 0x7ff7480b2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff74659c700 1 -- 172.21.15.73:0/3381583883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff740009a70 con 0x7ff7480b4b10 2023-11-30T23:12:44.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff74659c700 1 --2- 172.21.15.73:0/3381583883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7480b4b10 0x7ff7481deed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff74000b370 tx=0x7ff740004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:44.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff73effd700 1 -- 172.21.15.73:0/3381583883 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff740012630 con 0x7ff7480b4b10 2023-11-30T23:12:44.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff74759e700 1 -- 172.21.15.73:0/3381583883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7480a85d0 con 0x7ff7480b4b10 2023-11-30T23:12:44.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff73effd700 1 -- 172.21.15.73:0/3381583883 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff740012790 con 0x7ff7480b4b10 2023-11-30T23:12:44.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff74759e700 1 -- 172.21.15.73:0/3381583883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7481df410 con 0x7ff7480b4b10 2023-11-30T23:12:44.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff73effd700 1 -- 172.21.15.73:0/3381583883 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff740012b40 con 0x7ff7480b4b10 2023-11-30T23:12:44.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff73effd700 1 -- 172.21.15.73:0/3381583883 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff740012ca0 con 0x7ff7480b4b10 2023-11-30T23:12:44.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff74759e700 1 -- 172.21.15.73:0/3381583883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff74804ed80 con 0x7ff7480b4b10 2023-11-30T23:12:44.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.219+0000 7ff73effd700 1 --2- 172.21.15.73:0/3381583883 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff72c065ad0 0x7ff72c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.223+0000 7ff73effd700 1 -- 172.21.15.73:0/3381583883 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff740084e80 con 0x7ff7480b4b10 2023-11-30T23:12:44.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.223+0000 7ff745d9b700 1 --2- 172.21.15.73:0/3381583883 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff72c065ad0 0x7ff72c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.223+0000 7ff745d9b700 1 --2- 172.21.15.73:0/3381583883 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff72c065ad0 0x7ff72c067f90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff7481cfec0 tx=0x7ff730009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:44.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.227+0000 7ff73effd700 1 -- 172.21.15.73:0/3381583883 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7ff740052c50 con 0x7ff7480b4b10 2023-11-30T23:12:44.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.395+0000 7ff74759e700 1 -- 172.21.15.73:0/3381583883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7480b3e20 con 0x7ff7480b4b10 2023-11-30T23:12:44.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.399+0000 7ff73effd700 1 -- 172.21.15.73:0/3381583883 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7ff740056270 con 0x7ff7480b4b10 2023-11-30T23:12:44.402 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:44.402 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":16,"fsid":"a677cb6a-4a54-4567-a30d-f0fa4bc22b17","created":"2023-11-30T23:12:23.260968+0000","modified":"2023-11-30T23:12:36.660230+0000","last_up_change":"2023-11-30T23:12:33.649318+0000","last_in_change":"2023-11-30T23:12:25.326689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-30T23:12:34.413317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbf1c93f-0775-4780-8524-cf25792d9aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36686},{"type":"v1","addr":"172.21.15.73:6817","nonce":36686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36686},{"type":"v1","addr":"172.21.15.73:6819","nonce":36686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36686},{"type":"v1","addr":"172.21.15.73:6823","nonce":36686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36686},{"type":"v1","addr":"172.21.15.73:6821","nonce":36686}]},"public_addr":"172.21.15.73:6817/36686","cluster_addr":"172.21.15.73:6819/36686","heartbeat_back_addr":"172.21.15.73:6823/36686","heartbeat_front_addr":"172.21.15.73:6821/36686","state":["exists","up"]},{"osd":1,"uuid":"9d9dd122-9a42-4588-a0d2-50d13b13eba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36687},{"type":"v1","addr":"172.21.15.73:6809","nonce":36687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":36687},{"type":"v1","addr":"172.21.15.73:6811","nonce":36687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36687},{"type":"v1","addr":"172.21.15.73:6815","nonce":36687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36687},{"type":"v1","addr":"172.21.15.73:6813","nonce":36687}]},"public_addr":"172.21.15.73:6809/36687","cluster_addr":"172.21.15.73:6811/36687","heartbeat_back_addr":"172.21.15.73:6815/36687","heartbeat_front_addr":"172.21.15.73:6813/36687","state":["exists","up"]},{"osd":2,"uuid":"68ff4f1e-ec45-42e0-bb83-fe03598e4940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36688},{"type":"v1","addr":"172.21.15.73:6825","nonce":36688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36688},{"type":"v1","addr":"172.21.15.73:6827","nonce":36688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36688},{"type":"v1","addr":"172.21.15.73:6831","nonce":36688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36688},{"type":"v1","addr":"172.21.15.73:6829","nonce":36688}]},"public_addr":"172.21.15.73:6825/36688","cluster_addr":"172.21.15.73:6827/36688","heartbeat_back_addr":"172.21.15.73:6831/36688","heartbeat_front_addr":"172.21.15.73:6829/36688","state":["exists","up"]},{"osd":3,"uuid":"e4b08c98-6a4d-4ec8-a245-59a35f70a16f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36685},{"type":"v1","addr":"172.21.15.73:6801","nonce":36685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36685},{"type":"v1","addr":"172.21.15.73:6803","nonce":36685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":36685},{"type":"v1","addr":"172.21.15.73:6807","nonce":36685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36685},{"type":"v1","addr":"172.21.15.73:6805","nonce":36685}]},"public_addr":"172.21.15.73:6801/36685","cluster_addr":"172.21.15.73:6803/36685","heartbeat_back_addr":"172.21.15.73:6807/36685","heartbeat_front_addr":"172.21.15.73:6805/36685","state":["exists","up"]},{"osd":4,"uuid":"d0922b0e-5170-474d-b270-ddb5adc858cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":36908},{"type":"v1","addr":"172.21.15.156:6801","nonce":36908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":36908},{"type":"v1","addr":"172.21.15.156:6803","nonce":36908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":36908},{"type":"v1","addr":"172.21.15.156:6807","nonce":36908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":36908},{"type":"v1","addr":"172.21.15.156:6805","nonce":36908}]},"public_addr":"172.21.15.156:6801/36908","cluster_addr":"172.21.15.156:6803/36908","heartbeat_back_addr":"172.21.15.156:6807/36908","heartbeat_front_addr":"172.21.15.156:6805/36908","state":["exists","up"]},{"osd":5,"uuid":"f2791a77-db25-479c-95d5-ea7f77458685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":36909},{"type":"v1","addr":"172.21.15.156:6809","nonce":36909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":36909},{"type":"v1","addr":"172.21.15.156:6811","nonce":36909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":36909},{"type":"v1","addr":"172.21.15.156:6815","nonce":36909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":36909},{"type":"v1","addr":"172.21.15.156:6813","nonce":36909}]},"public_addr":"172.21.15.156:6809/36909","cluster_addr":"172.21.15.156:6811/36909","heartbeat_back_addr":"172.21.15.156:6815/36909","heartbeat_front_addr":"172.21.15.156:6813/36909","state":["exists","up"]},{"osd":6,"uuid":"f86c2fe9-ec8b-406e-af26-5dc65c926382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":36910},{"type":"v1","addr":"172.21.15.156:6817","nonce":36910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":36910},{"type":"v1","addr":"172.21.15.156:6819","nonce":36910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":36910},{"type":"v1","addr":"172.21.15.156:6823","nonce":36910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":36910},{"type":"v1","addr":"172.21.15.156:6821","nonce":36910}]},"public_addr":"172.21.15.156:6817/36910","cluster_addr":"172.21.15.156:6819/36910","heartbeat_back_addr":"172.21.15.156:6823/36910","heartbeat_front_addr":"172.21.15.156:6821/36910","state":["exists","up"]},{"osd":7,"uuid":"56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":36911},{"type":"v1","addr":"172.21.15.156:6825","nonce":36911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":36911},{"type":"v1","addr":"172.21.15.156:6827","nonce":36911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":36911},{"type":"v1","addr":"172.21.15.156:6831","nonce":36911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":36911},{"type":"v1","addr":"172.21.15.156:6829","nonce":36911}]},"public_addr":"172.21.15.156:6825/36911","cluster_addr":"172.21.15.156:6827/36911","heartbeat_back_addr":"172.21.15.156:6831/36911","heartbeat_front_addr":"172.21.15.156:6829/36911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.597534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.505493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.811871+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.586741+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.366817+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.101605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.627496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.829046+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T23:12:44.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.399+0000 7ff74759e700 1 -- 172.21.15.73:0/3381583883 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff72c065ad0 msgr2=0x7ff72c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:44.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.399+0000 7ff74759e700 1 --2- 172.21.15.73:0/3381583883 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff72c065ad0 0x7ff72c067f90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff7481cfec0 tx=0x7ff730009240 comp rx=0 tx=0).stop 2023-11-30T23:12:44.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.399+0000 7ff74759e700 1 -- 172.21.15.73:0/3381583883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7480b4b10 msgr2=0x7ff7481deed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:44.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.399+0000 7ff74759e700 1 --2- 172.21.15.73:0/3381583883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7480b4b10 0x7ff7481deed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff74000b370 tx=0x7ff740004af0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.399+0000 7ff74759e700 1 -- 172.21.15.73:0/3381583883 shutdown_connections 2023-11-30T23:12:44.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.399+0000 7ff74759e700 1 --2- 172.21.15.73:0/3381583883 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff72c065ad0 0x7ff72c067f90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.399+0000 7ff74759e700 1 --2- 172.21.15.73:0/3381583883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7481401e0 0x7ff7480b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.399+0000 7ff74759e700 1 --2- 172.21.15.73:0/3381583883 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff7480b6910 0x7ff7480b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.399+0000 7ff74759e700 1 --2- 172.21.15.73:0/3381583883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7480b4b10 0x7ff7481deed0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.399+0000 7ff74759e700 1 -- 172.21.15.73:0/3381583883 >> 172.21.15.73:0/3381583883 conn(0x7ff7480b8a10 msgr2=0x7ff748144a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:44.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.399+0000 7ff74759e700 1 -- 172.21.15.73:0/3381583883 shutdown_connections 2023-11-30T23:12:44.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.399+0000 7ff74759e700 1 -- 172.21.15.73:0/3381583883 wait complete. 2023-11-30T23:12:44.417 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-30T23:12:34.413317+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-30T23:12:44.417 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-30T23:12:44.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.531+0000 7f987c92d700 1 Processor -- start 2023-11-30T23:12:44.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.531+0000 7f987c92d700 1 -- start start 2023-11-30T23:12:44.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.531+0000 7f987c92d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f987814a600 0x7f9878140430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.531+0000 7f987c92d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98780b4470 0x7f9878140970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.531+0000 7f987c92d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9878140eb0 con 0x7f98780bca60 2023-11-30T23:12:44.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.531+0000 7f987c92d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98780b6120 con 0x7f987814a600 2023-11-30T23:12:44.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.531+0000 7f987c92d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98780b5eb0 con 0x7f98780b4470 2023-11-30T23:12:44.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.531+0000 7f987659c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f98780bca60 0x7f9878149ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36994/0 (socket says 172.21.15.73:36994) 2023-11-30T23:12:44.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.531+0000 7f987659c700 1 -- 172.21.15.73:0/87749849 learned_addr learned my addr 172.21.15.73:0/87749849 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:44.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.531+0000 7f9876d9d700 1 --2- 172.21.15.73:0/87749849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98780b4470 0x7f9878140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.531+0000 7f986dd9b700 1 --2- 172.21.15.73:0/87749849 >> v2:172.21.15.156:3300/0 conn(0x7f987814a600 0x7f9878140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.535+0000 7f9875d9b700 1 -- 172.21.15.73:0/87749849 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837300258 0 0) 0x7f9878140eb0 con 0x7f98780bca60 2023-11-30T23:12:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.535+0000 7f9875d9b700 1 -- 172.21.15.73:0/87749849 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98640035d0 con 0x7f98780bca60 2023-11-30T23:12:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.535+0000 7f9876d9d700 1 -- 172.21.15.73:0/87749849 >> v2:172.21.15.156:3300/0 conn(0x7f987814a600 msgr2=0x7f9878140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.535+0000 7f9876d9d700 1 --2- 172.21.15.73:0/87749849 >> v2:172.21.15.156:3300/0 conn(0x7f987814a600 0x7f9878140430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.535+0000 7f9876d9d700 1 -- 172.21.15.73:0/87749849 >> v1:172.21.15.73:6789/0 conn(0x7f98780bca60 legacy=0x7f9878149ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.535+0000 7f9876d9d700 1 -- 172.21.15.73:0/87749849 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98780bce40 con 0x7f98780b4470 2023-11-30T23:12:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.535+0000 7f9876d9d700 1 --2- 172.21.15.73:0/87749849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98780b4470 0x7f9878140970 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9870009d90 tx=0x7f987000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22c976ada5f7bda2 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.535+0000 7f9875d9b700 1 -- 172.21.15.73:0/87749849 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987000e070 con 0x7f98780b4470 2023-11-30T23:12:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.535+0000 7f9875d9b700 1 -- 172.21.15.73:0/87749849 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987000bb20 con 0x7f98780b4470 2023-11-30T23:12:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.535+0000 7f9875d9b700 1 -- 172.21.15.73:0/87749849 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987000be90 con 0x7f98780b4470 2023-11-30T23:12:44.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.535+0000 7f987c92d700 1 -- 172.21.15.73:0/87749849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98780b4470 msgr2=0x7f9878140970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:44.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.535+0000 7f987c92d700 1 --2- 172.21.15.73:0/87749849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98780b4470 0x7f9878140970 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9870009d90 tx=0x7f987000b330 comp rx=0 tx=0).stop 2023-11-30T23:12:44.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.535+0000 7f987c92d700 1 -- 172.21.15.73:0/87749849 shutdown_connections 2023-11-30T23:12:44.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.535+0000 7f987c92d700 1 --2- 172.21.15.73:0/87749849 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98780b4470 0x7f9878140970 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.535+0000 7f987c92d700 1 --2- 172.21.15.73:0/87749849 >> v2:172.21.15.156:3300/0 conn(0x7f987814a600 0x7f9878140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.535+0000 7f987c92d700 1 -- 172.21.15.73:0/87749849 >> 172.21.15.73:0/87749849 conn(0x7f9878071fd0 msgr2=0x7f98780bc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:44.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.535+0000 7f987c92d700 1 -- 172.21.15.73:0/87749849 shutdown_connections 2023-11-30T23:12:44.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.535+0000 7f987c92d700 1 -- 172.21.15.73:0/87749849 wait complete. 2023-11-30T23:12:44.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.539+0000 7f987c92d700 1 Processor -- start 2023-11-30T23:12:44.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.539+0000 7f987c92d700 1 -- start start 2023-11-30T23:12:44.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.539+0000 7f987c92d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98780b4470 0x7f9878146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.539+0000 7f987c92d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98780bca60 0x7f9878141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.539+0000 7f987c92d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f987814a600 0x7f98781dc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.539+0000 7f987c92d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9878143240 con 0x7f98780b4470 2023-11-30T23:12:44.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.539+0000 7f987c92d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98781439b0 con 0x7f987814a600 2023-11-30T23:12:44.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.539+0000 7f987c92d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9878143c90 con 0x7f98780bca60 2023-11-30T23:12:44.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.539+0000 7f987659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98780b4470 0x7f9878146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.539+0000 7f987659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98780b4470 0x7f9878146fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33810/0 (socket says 172.21.15.73:33810) 2023-11-30T23:12:44.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.539+0000 7f987659c700 1 -- 172.21.15.73:0/2990539733 learned_addr learned my addr 172.21.15.73:0/2990539733 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:44.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.539+0000 7f9876d9d700 1 --2- 172.21.15.73:0/2990539733 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f987814a600 0x7f98781dc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.539+0000 7f986dd9b700 1 --2- 172.21.15.73:0/2990539733 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98780bca60 0x7f9878141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.539+0000 7f987659c700 1 -- 172.21.15.73:0/2990539733 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98780bca60 msgr2=0x7f9878141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:44.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.539+0000 7f987659c700 1 --2- 172.21.15.73:0/2990539733 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98780bca60 0x7f9878141cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.539+0000 7f987659c700 1 -- 172.21.15.73:0/2990539733 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f987814a600 msgr2=0x7f98781dc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:44.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.539+0000 7f987659c700 1 --2- 172.21.15.73:0/2990539733 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f987814a600 0x7f98781dc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.539+0000 7f987659c700 1 -- 172.21.15.73:0/2990539733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9870009a70 con 0x7f98780b4470 2023-11-30T23:12:44.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.543+0000 7f987659c700 1 --2- 172.21.15.73:0/2990539733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98780b4470 0x7f9878146fa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f986800c4d0 tx=0x7f986800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:44.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.543+0000 7f986f7fe700 1 -- 172.21.15.73:0/2990539733 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98680011d0 con 0x7f98780b4470 2023-11-30T23:12:44.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.543+0000 7f986f7fe700 1 -- 172.21.15.73:0/2990539733 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9868005d90 con 0x7f98780b4470 2023-11-30T23:12:44.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.543+0000 7f986f7fe700 1 -- 172.21.15.73:0/2990539733 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98680072d0 con 0x7f98780b4470 2023-11-30T23:12:44.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.543+0000 7f987c92d700 1 -- 172.21.15.73:0/2990539733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98781dc110 con 0x7f98780b4470 2023-11-30T23:12:44.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.543+0000 7f987c92d700 1 -- 172.21.15.73:0/2990539733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9878146090 con 0x7f98780b4470 2023-11-30T23:12:44.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.543+0000 7f987c92d700 1 -- 172.21.15.73:0/2990539733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9878146220 con 0x7f98780b4470 2023-11-30T23:12:44.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.543+0000 7f986f7fe700 1 -- 172.21.15.73:0/2990539733 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9868007430 con 0x7f98780b4470 2023-11-30T23:12:44.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.543+0000 7f986f7fe700 1 --2- 172.21.15.73:0/2990539733 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9858065ad0 0x7f9858067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.543+0000 7f986f7fe700 1 -- 172.21.15.73:0/2990539733 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9868082130 con 0x7f98780b4470 2023-11-30T23:12:44.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.543+0000 7f986dd9b700 1 --2- 172.21.15.73:0/2990539733 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9858065ad0 0x7f9858067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.547+0000 7f986dd9b700 1 --2- 172.21.15.73:0/2990539733 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9858065ad0 0x7f9858067f90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f98781440d0 tx=0x7f9860008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:44.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.555+0000 7f986f7fe700 1 -- 172.21.15.73:0/2990539733 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f986804ff80 con 0x7f98780b4470 2023-11-30T23:12:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.715+0000 7f987c92d700 1 -- 172.21.15.73:0/2990539733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9878141460 con 0x7f98780b4470 2023-11-30T23:12:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.715+0000 7f986f7fe700 1 -- 172.21.15.73:0/2990539733 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9868017020 con 0x7f98780b4470 2023-11-30T23:12:44.721 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-11-30T23:12:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.723+0000 7f987c92d700 1 -- 172.21.15.73:0/2990539733 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9858065ad0 msgr2=0x7f9858067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.723+0000 7f987c92d700 1 --2- 172.21.15.73:0/2990539733 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9858065ad0 0x7f9858067f90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f98781440d0 tx=0x7f9860008040 comp rx=0 tx=0).stop 2023-11-30T23:12:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.723+0000 7f987c92d700 1 -- 172.21.15.73:0/2990539733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98780b4470 msgr2=0x7f9878146fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.723+0000 7f987c92d700 1 --2- 172.21.15.73:0/2990539733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98780b4470 0x7f9878146fa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f986800c4d0 tx=0x7f986800c890 comp rx=0 tx=0).stop 2023-11-30T23:12:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.723+0000 7f987c92d700 1 -- 172.21.15.73:0/2990539733 shutdown_connections 2023-11-30T23:12:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.723+0000 7f987c92d700 1 --2- 172.21.15.73:0/2990539733 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9858065ad0 0x7f9858067f90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.723+0000 7f987c92d700 1 --2- 172.21.15.73:0/2990539733 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f987814a600 0x7f98781dc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.723+0000 7f987c92d700 1 --2- 172.21.15.73:0/2990539733 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f98780bca60 0x7f9878141cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.723+0000 7f987c92d700 1 --2- 172.21.15.73:0/2990539733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98780b4470 0x7f9878146fa0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.723+0000 7f987c92d700 1 -- 172.21.15.73:0/2990539733 >> 172.21.15.73:0/2990539733 conn(0x7f9878071fd0 msgr2=0x7f987813f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:44.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.723+0000 7f987c92d700 1 -- 172.21.15.73:0/2990539733 shutdown_connections 2023-11-30T23:12:44.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.723+0000 7f987c92d700 1 -- 172.21.15.73:0/2990539733 wait complete. 2023-11-30T23:12:44.741 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-30T23:12:44.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.843+0000 7f2b06498700 1 Processor -- start 2023-11-30T23:12:44.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b06498700 1 -- start start 2023-11-30T23:12:44.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b06498700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2b000b0bd0 0x7f2b000b1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b06498700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2b00142fd0 0x7f2b00143480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b06498700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b000b8450 0x7f2b0013fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b06498700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b001439c0 con 0x7f2b00142fd0 2023-11-30T23:12:44.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b06498700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b000b1fe0 con 0x7f2b000b0bd0 2023-11-30T23:12:44.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b06498700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b000af5a0 con 0x7f2b000b8450 2023-11-30T23:12:44.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2aff7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2b00142fd0 0x7f2b00143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b04a35700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b000b8450 0x7f2b0013fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2afffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2b000b0bd0 0x7f2b000b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b04a35700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b000b8450 0x7f2b0013fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:46352/0 (socket says 172.21.15.73:46352) 2023-11-30T23:12:44.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b04a35700 1 -- 172.21.15.73:0/1661916273 learned_addr learned my addr 172.21.15.73:0/1661916273 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:44.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2aff7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2b00142fd0 0x7f2b00143480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33816/0 (socket says 172.21.15.73:33816) 2023-11-30T23:12:44.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b04a35700 1 -- 172.21.15.73:0/1661916273 >> v2:172.21.15.156:3300/0 conn(0x7f2b000b0bd0 msgr2=0x7f2b000b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:44.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b04a35700 1 --2- 172.21.15.73:0/1661916273 >> v2:172.21.15.156:3300/0 conn(0x7f2b000b0bd0 0x7f2b000b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b04a35700 1 -- 172.21.15.73:0/1661916273 >> v2:172.21.15.73:3300/0 conn(0x7f2b00142fd0 msgr2=0x7f2b00143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:44.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b04a35700 1 --2- 172.21.15.73:0/1661916273 >> v2:172.21.15.73:3300/0 conn(0x7f2b00142fd0 0x7f2b00143480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b04a35700 1 -- 172.21.15.73:0/1661916273 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b000b0330 con 0x7f2b000b8450 2023-11-30T23:12:44.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2aff7fe700 1 --2- 172.21.15.73:0/1661916273 >> v2:172.21.15.73:3300/0 conn(0x7f2b00142fd0 0x7f2b00143480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:44.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b04a35700 1 --2- 172.21.15.73:0/1661916273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b000b8450 0x7f2b0013fed0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2b000b41e0 tx=0x7f2af0009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ac6523bd96a2f1d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:44.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2afeffd700 1 -- 172.21.15.73:0/1661916273 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0005ea0 con 0x7f2b000b8450 2023-11-30T23:12:44.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2afeffd700 1 -- 172.21.15.73:0/1661916273 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af0006030 con 0x7f2b000b8450 2023-11-30T23:12:44.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2afeffd700 1 -- 172.21.15.73:0/1661916273 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af00063c0 con 0x7f2b000b8450 2023-11-30T23:12:44.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b06498700 1 -- 172.21.15.73:0/1661916273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b000b8450 msgr2=0x7f2b0013fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:44.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b06498700 1 --2- 172.21.15.73:0/1661916273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b000b8450 0x7f2b0013fed0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2b000b41e0 tx=0x7f2af0009bf0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b06498700 1 -- 172.21.15.73:0/1661916273 shutdown_connections 2023-11-30T23:12:44.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b06498700 1 --2- 172.21.15.73:0/1661916273 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b000b8450 0x7f2b0013fed0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b06498700 1 --2- 172.21.15.73:0/1661916273 >> v2:172.21.15.73:3300/0 conn(0x7f2b00142fd0 0x7f2b00143480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b06498700 1 --2- 172.21.15.73:0/1661916273 >> v2:172.21.15.156:3300/0 conn(0x7f2b000b0bd0 0x7f2b000b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b06498700 1 -- 172.21.15.73:0/1661916273 >> 172.21.15.73:0/1661916273 conn(0x7f2b0006a7b0 msgr2=0x7f2b000b7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:44.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b06498700 1 -- 172.21.15.73:0/1661916273 shutdown_connections 2023-11-30T23:12:44.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.847+0000 7f2b06498700 1 -- 172.21.15.73:0/1661916273 wait complete. 2023-11-30T23:12:44.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.851+0000 7f2b06498700 1 Processor -- start 2023-11-30T23:12:44.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.851+0000 7f2b06498700 1 -- start start 2023-11-30T23:12:44.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.851+0000 7f2b06498700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b000b0bd0 0x7f2b001dcda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.851+0000 7f2b06498700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b000b8450 0x7f2b00132600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.851+0000 7f2b06498700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b00142fd0 0x7f2b00132b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.851+0000 7f2b06498700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00132170 con 0x7f2b000b0bd0 2023-11-30T23:12:44.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.851+0000 7f2b06498700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b001dd380 con 0x7f2b00142fd0 2023-11-30T23:12:44.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.851+0000 7f2b06498700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b001dd660 con 0x7f2b000b8450 2023-11-30T23:12:44.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.851+0000 7f2afffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b000b0bd0 0x7f2b001dcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.851+0000 7f2afffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b000b0bd0 0x7f2b001dcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33832/0 (socket says 172.21.15.73:33832) 2023-11-30T23:12:44.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.851+0000 7f2afffff700 1 -- 172.21.15.73:0/3408601949 learned_addr learned my addr 172.21.15.73:0/3408601949 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:44.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.851+0000 7f2aff7fe700 1 --2- 172.21.15.73:0/3408601949 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b000b8450 0x7f2b00132600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.851+0000 7f2b04a35700 1 --2- 172.21.15.73:0/3408601949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b00142fd0 0x7f2b00132b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.851+0000 7f2afffff700 1 -- 172.21.15.73:0/3408601949 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b000b8450 msgr2=0x7f2b00132600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:44.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.851+0000 7f2afffff700 1 --2- 172.21.15.73:0/3408601949 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b000b8450 0x7f2b00132600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.851+0000 7f2afffff700 1 -- 172.21.15.73:0/3408601949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b00142fd0 msgr2=0x7f2b00132b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:44.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.851+0000 7f2afffff700 1 --2- 172.21.15.73:0/3408601949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b00142fd0 0x7f2b00132b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:44.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.851+0000 7f2afffff700 1 -- 172.21.15.73:0/3408601949 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af40094b0 con 0x7f2b000b0bd0 2023-11-30T23:12:44.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.855+0000 7f2afffff700 1 --2- 172.21.15.73:0/3408601949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b000b0bd0 0x7f2b001dcda0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2af800efc0 tx=0x7f2af800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:44.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.855+0000 7f2afcff9700 1 -- 172.21.15.73:0/3408601949 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8009ea0 con 0x7f2b000b0bd0 2023-11-30T23:12:44.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.855+0000 7f2afcff9700 1 -- 172.21.15.73:0/3408601949 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af800f040 con 0x7f2b000b0bd0 2023-11-30T23:12:44.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.855+0000 7f2b06498700 1 -- 172.21.15.73:0/3408601949 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af0009570 con 0x7f2b000b0bd0 2023-11-30T23:12:44.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.855+0000 7f2afcff9700 1 -- 172.21.15.73:0/3408601949 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8014480 con 0x7f2b000b0bd0 2023-11-30T23:12:44.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.855+0000 7f2b06498700 1 -- 172.21.15.73:0/3408601949 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b00138640 con 0x7f2b000b0bd0 2023-11-30T23:12:44.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.855+0000 7f2b06498700 1 -- 172.21.15.73:0/3408601949 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b001322e0 con 0x7f2b000b0bd0 2023-11-30T23:12:44.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.855+0000 7f2afcff9700 1 -- 172.21.15.73:0/3408601949 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2af80145e0 con 0x7f2b000b0bd0 2023-11-30T23:12:44.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.855+0000 7f2afcff9700 1 --2- 172.21.15.73:0/3408601949 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f2aec065ad0 0x7f2aec067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:44.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.855+0000 7f2afcff9700 1 -- 172.21.15.73:0/3408601949 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2af8083600 con 0x7f2b000b0bd0 2023-11-30T23:12:44.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.855+0000 7f2aff7fe700 1 --2- 172.21.15.73:0/3408601949 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f2aec065ad0 0x7f2aec067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:44.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.859+0000 7f2aff7fe700 1 --2- 172.21.15.73:0/3408601949 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f2aec065ad0 0x7f2aec067f90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2b00139f60 tx=0x7f2af4009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:44.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:44.863+0000 7f2afcff9700 1 -- 172.21.15.73:0/3408601949 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f2af80513a0 con 0x7f2b000b0bd0 2023-11-30T23:12:45.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.031+0000 7f2b06498700 1 -- 172.21.15.73:0/3408601949 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2b0004ed80 con 0x7f2b000b0bd0 2023-11-30T23:12:45.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.031+0000 7f2afcff9700 1 -- 172.21.15.73:0/3408601949 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2af80549c0 con 0x7f2b000b0bd0 2023-11-30T23:12:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:45.036 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2023-11-30T23:12:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:12:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2023-11-30T23:12:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2023-11-30T23:12:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:12:45.036 INFO:teuthology.orchestra.run.smithi073.stdout:] 2023-11-30T23:12:45.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.035+0000 7f2b06498700 1 -- 172.21.15.73:0/3408601949 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f2aec065ad0 msgr2=0x7f2aec067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.035+0000 7f2b06498700 1 --2- 172.21.15.73:0/3408601949 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f2aec065ad0 0x7f2aec067f90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2b00139f60 tx=0x7f2af4009240 comp rx=0 tx=0).stop 2023-11-30T23:12:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.035+0000 7f2b06498700 1 -- 172.21.15.73:0/3408601949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b000b0bd0 msgr2=0x7f2b001dcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.035+0000 7f2b06498700 1 --2- 172.21.15.73:0/3408601949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b000b0bd0 0x7f2b001dcda0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2af800efc0 tx=0x7f2af800c3a0 comp rx=0 tx=0).stop 2023-11-30T23:12:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.035+0000 7f2b06498700 1 -- 172.21.15.73:0/3408601949 shutdown_connections 2023-11-30T23:12:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.035+0000 7f2b06498700 1 --2- 172.21.15.73:0/3408601949 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f2aec065ad0 0x7f2aec067f90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.035+0000 7f2b06498700 1 --2- 172.21.15.73:0/3408601949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2b00142fd0 0x7f2b00132b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.035+0000 7f2b06498700 1 --2- 172.21.15.73:0/3408601949 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2b000b8450 0x7f2b00132600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.035+0000 7f2b06498700 1 --2- 172.21.15.73:0/3408601949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b000b0bd0 0x7f2b001dcda0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.035+0000 7f2b06498700 1 -- 172.21.15.73:0/3408601949 >> 172.21.15.73:0/3408601949 conn(0x7f2b0006a7b0 msgr2=0x7f2b000b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.035+0000 7f2b06498700 1 -- 172.21.15.73:0/3408601949 shutdown_connections 2023-11-30T23:12:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.035+0000 7f2b06498700 1 -- 172.21.15.73:0/3408601949 wait complete. 2023-11-30T23:12:45.050 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-30T23:12:45.051 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-30T23:12:45.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.167+0000 7f3e2ffff700 1 Processor -- start 2023-11-30T23:12:45.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.167+0000 7f3e2ffff700 1 -- start start 2023-11-30T23:12:45.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.167+0000 7f3e2ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3e300b2780 0x7f3e3013d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:45.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.167+0000 7f3e2ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e30143480 0x7f3e3013d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:45.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.167+0000 7f3e2ffff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e300ae7d0 con 0x7f3e300b0a20 2023-11-30T23:12:45.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.167+0000 7f3e2ffff700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3006e900 con 0x7f3e300b2780 2023-11-30T23:12:45.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.167+0000 7f3e2ffff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300aed50 con 0x7f3e30143480 2023-11-30T23:12:45.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2effd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3e300b2780 0x7f3e3013d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:45.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2e7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e30143480 0x7f3e3013d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:45.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2f7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f3e300b0a20 0x7f3e300b0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.73:50038/0 (socket says 172.21.15.73:50038) 2023-11-30T23:12:45.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2f7fe700 1 -- 172.21.15.73:0/3029009561 learned_addr learned my addr 172.21.15.73:0/3029009561 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:45.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2effd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3e300b2780 0x7f3e3013d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:49766/0 (socket says 172.21.15.73:49766) 2023-11-30T23:12:45.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2effd700 1 -- 172.21.15.73:0/3029009561 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e30143480 msgr2=0x7f3e3013d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:45.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2effd700 1 --2- 172.21.15.73:0/3029009561 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e30143480 0x7f3e3013d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2effd700 1 -- 172.21.15.73:0/3029009561 >> v1:172.21.15.156:6789/0 conn(0x7f3e300b0a20 legacy=0x7f3e300b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2effd700 1 -- 172.21.15.73:0/3029009561 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e300b2b60 con 0x7f3e300b2780 2023-11-30T23:12:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2effd700 1 --2- 172.21.15.73:0/3029009561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e300b2780 0x7f3e3013d290 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009e10 tx=0x7f3e2000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=195eed92e905901 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2dffb700 1 -- 172.21.15.73:0/3029009561 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2000e070 con 0x7f3e300b2780 2023-11-30T23:12:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2dffb700 1 -- 172.21.15.73:0/3029009561 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2000b8d0 con 0x7f3e300b2780 2023-11-30T23:12:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2dffb700 1 -- 172.21.15.73:0/3029009561 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2000bc80 con 0x7f3e300b2780 2023-11-30T23:12:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2ffff700 1 -- 172.21.15.73:0/3029009561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e300b2780 msgr2=0x7f3e3013d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2ffff700 1 --2- 172.21.15.73:0/3029009561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e300b2780 0x7f3e3013d290 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009e10 tx=0x7f3e2000b330 comp rx=0 tx=0).stop 2023-11-30T23:12:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2ffff700 1 -- 172.21.15.73:0/3029009561 shutdown_connections 2023-11-30T23:12:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2ffff700 1 --2- 172.21.15.73:0/3029009561 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e30143480 0x7f3e3013d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2ffff700 1 --2- 172.21.15.73:0/3029009561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e300b2780 0x7f3e3013d290 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2ffff700 1 -- 172.21.15.73:0/3029009561 >> 172.21.15.73:0/3029009561 conn(0x7f3e300b7b70 msgr2=0x7f3e300b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2ffff700 1 -- 172.21.15.73:0/3029009561 shutdown_connections 2023-11-30T23:12:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.171+0000 7f3e2ffff700 1 -- 172.21.15.73:0/3029009561 wait complete. 2023-11-30T23:12:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2ffff700 1 Processor -- start 2023-11-30T23:12:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2ffff700 1 -- start start 2023-11-30T23:12:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e300b0a20 0x7f3e301dc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e300b2780 0x7f3e301330a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e30143480 0x7f3e30071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2ffff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e301dc580 con 0x7f3e300b0a20 2023-11-30T23:12:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2ffff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e30134610 con 0x7f3e30143480 2023-11-30T23:12:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2ffff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e30134b20 con 0x7f3e300b2780 2023-11-30T23:12:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e300b0a20 0x7f3e301dc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e300b0a20 0x7f3e301dc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33838/0 (socket says 172.21.15.73:33838) 2023-11-30T23:12:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2effd700 1 -- 172.21.15.73:0/4208171612 learned_addr learned my addr 172.21.15.73:0/4208171612 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2f7fe700 1 --2- 172.21.15.73:0/4208171612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e30143480 0x7f3e30071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2e7fc700 1 --2- 172.21.15.73:0/4208171612 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e300b2780 0x7f3e301330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2effd700 1 -- 172.21.15.73:0/4208171612 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e300b2780 msgr2=0x7f3e301330a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2effd700 1 --2- 172.21.15.73:0/4208171612 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e300b2780 0x7f3e301330a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2effd700 1 -- 172.21.15.73:0/4208171612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e30143480 msgr2=0x7f3e30071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2effd700 1 --2- 172.21.15.73:0/4208171612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e30143480 0x7f3e30071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2effd700 1 -- 172.21.15.73:0/4208171612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e20009a70 con 0x7f3e300b0a20 2023-11-30T23:12:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2effd700 1 --2- 172.21.15.73:0/4208171612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e300b0a20 0x7f3e301dc9a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e20014040 tx=0x7f3e20004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e277fe700 1 -- 172.21.15.73:0/4208171612 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20004670 con 0x7f3e300b0a20 2023-11-30T23:12:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e277fe700 1 -- 172.21.15.73:0/4208171612 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e20020070 con 0x7f3e300b0a20 2023-11-30T23:12:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e277fe700 1 -- 172.21.15.73:0/4208171612 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20025430 con 0x7f3e300b0a20 2023-11-30T23:12:45.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2ffff700 1 -- 172.21.15.73:0/4208171612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e301dbec0 con 0x7f3e300b0a20 2023-11-30T23:12:45.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.175+0000 7f3e2ffff700 1 -- 172.21.15.73:0/4208171612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e30134840 con 0x7f3e300b0a20 2023-11-30T23:12:45.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.179+0000 7f3e2ffff700 1 -- 172.21.15.73:0/4208171612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3013cd20 con 0x7f3e300b0a20 2023-11-30T23:12:45.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.179+0000 7f3e277fe700 1 -- 172.21.15.73:0/4208171612 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3e20022030 con 0x7f3e300b0a20 2023-11-30T23:12:45.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.179+0000 7f3e277fe700 1 --2- 172.21.15.73:0/4208171612 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3e10065ad0 0x7f3e10067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:45.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.179+0000 7f3e2e7fc700 1 --2- 172.21.15.73:0/4208171612 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3e10065ad0 0x7f3e10067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:45.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.179+0000 7f3e277fe700 1 -- 172.21.15.73:0/4208171612 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3e20084910 con 0x7f3e300b0a20 2023-11-30T23:12:45.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.179+0000 7f3e2e7fc700 1 --2- 172.21.15.73:0/4208171612 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3e10065ad0 0x7f3e10067f90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3e301318e0 tx=0x7f3e18009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:45.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.187+0000 7f3e277fe700 1 -- 172.21.15.73:0/4208171612 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f3e200527d0 con 0x7f3e300b0a20 2023-11-30T23:12:45.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:45.355+0000 7f3e2ffff700 1 -- 172.21.15.73:0/4208171612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3e300aea40 con 0x7f3e300b0a20 2023-11-30T23:12:46.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.099+0000 7f3e277fe700 1 -- 172.21.15.73:0/4208171612 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3e20055df0 con 0x7f3e300b0a20 2023-11-30T23:12:46.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.103+0000 7f3e2ffff700 1 -- 172.21.15.73:0/4208171612 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3e10065ad0 msgr2=0x7f3e10067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:46.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.107+0000 7f3e2ffff700 1 --2- 172.21.15.73:0/4208171612 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3e10065ad0 0x7f3e10067f90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3e301318e0 tx=0x7f3e18009240 comp rx=0 tx=0).stop 2023-11-30T23:12:46.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.107+0000 7f3e2ffff700 1 -- 172.21.15.73:0/4208171612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e300b0a20 msgr2=0x7f3e301dc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:46.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.107+0000 7f3e2ffff700 1 --2- 172.21.15.73:0/4208171612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e300b0a20 0x7f3e301dc9a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e20014040 tx=0x7f3e20004af0 comp rx=0 tx=0).stop 2023-11-30T23:12:46.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.107+0000 7f3e2ffff700 1 -- 172.21.15.73:0/4208171612 shutdown_connections 2023-11-30T23:12:46.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.107+0000 7f3e2ffff700 1 --2- 172.21.15.73:0/4208171612 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3e10065ad0 0x7f3e10067f90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:46.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.107+0000 7f3e2ffff700 1 --2- 172.21.15.73:0/4208171612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e30143480 0x7f3e30071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:46.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.107+0000 7f3e2ffff700 1 --2- 172.21.15.73:0/4208171612 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e300b2780 0x7f3e301330a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:46.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.107+0000 7f3e2ffff700 1 --2- 172.21.15.73:0/4208171612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e300b0a20 0x7f3e301dc9a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:46.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.107+0000 7f3e2ffff700 1 -- 172.21.15.73:0/4208171612 >> 172.21.15.73:0/4208171612 conn(0x7f3e300b7b70 msgr2=0x7f3e301358e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:46.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.107+0000 7f3e2ffff700 1 -- 172.21.15.73:0/4208171612 shutdown_connections 2023-11-30T23:12:46.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.107+0000 7f3e2ffff700 1 -- 172.21.15.73:0/4208171612 wait complete. 2023-11-30T23:12:46.115 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2023-11-30T23:12:46.128 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-30T23:12:46.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e7fff700 1 Processor -- start 2023-11-30T23:12:46.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e7fff700 1 -- start start 2023-11-30T23:12:46.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4e814ffb0 0x7fc4e81523a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:46.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e7fff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e80b3370 con 0x7fc4e80b9120 2023-11-30T23:12:46.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e7fff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e80b5f70 con 0x7fc4e80b8510 2023-11-30T23:12:46.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e7fff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e8140c00 con 0x7fc4e814ffb0 2023-11-30T23:12:46.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e6ffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc4e80b9120 0x7fc4e81404f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37002/0 (socket says 172.21.15.73:37002) 2023-11-30T23:12:46.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e6ffd700 1 -- 172.21.15.73:0/1287833432 learned_addr learned my addr 172.21.15.73:0/1287833432 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:46.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e77fe700 1 --2- 172.21.15.73:0/1287833432 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4e814ffb0 0x7fc4e81523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:46.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e5ffb700 1 -- 172.21.15.73:0/1287833432 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123279411 0 0) 0x7fc4e80b3370 con 0x7fc4e80b9120 2023-11-30T23:12:46.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e5ffb700 1 -- 172.21.15.73:0/1287833432 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4d40035d0 con 0x7fc4e80b9120 2023-11-30T23:12:46.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e5ffb700 1 -- 172.21.15.73:0/1287833432 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2541532593 0 0) 0x7fc4d40035d0 con 0x7fc4e80b9120 2023-11-30T23:12:46.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e5ffb700 1 -- 172.21.15.73:0/1287833432 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4e814ffb0 msgr2=0x7fc4e81523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:46.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e5ffb700 1 --2- 172.21.15.73:0/1287833432 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4e814ffb0 0x7fc4e81523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:46.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e5ffb700 1 -- 172.21.15.73:0/1287833432 >> v1:172.21.15.156:6789/0 conn(0x7fc4e80b8510 legacy=0x7fc4e8146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:46.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e5ffb700 1 -- 172.21.15.73:0/1287833432 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e80b9500 con 0x7fc4e80b9120 2023-11-30T23:12:46.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e5ffb700 1 -- 172.21.15.73:0/1287833432 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3856460137 0 0) 0x7fc4d0001670 con 0x7fc4e80b9120 2023-11-30T23:12:46.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e5ffb700 1 -- 172.21.15.73:0/1287833432 >> v1:172.21.15.73:6789/0 conn(0x7fc4e80b9120 legacy=0x7fc4e81404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:46.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e5ffb700 1 --2- 172.21.15.73:0/1287833432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4d4003a50 0x7fc4d4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:46.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e5ffb700 1 --2- 172.21.15.73:0/1287833432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4d4004400 0x7fc4d40048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:46.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e5ffb700 1 --2- 172.21.15.73:0/1287833432 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4e814ffb0 0x7fc4d40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:46.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e5ffb700 1 -- 172.21.15.73:0/1287833432 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e8140c00 con 0x7fc4d4004400 2023-11-30T23:12:46.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e5ffb700 1 -- 172.21.15.73:0/1287833432 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d400bae0 con 0x7fc4d4003a50 2023-11-30T23:12:46.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e5ffb700 1 -- 172.21.15.73:0/1287833432 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d400bca0 con 0x7fc4e814ffb0 2023-11-30T23:12:46.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e6ffd700 1 --2- 172.21.15.73:0/1287833432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4d4003a50 0x7fc4d4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:46.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e67fc700 1 --2- 172.21.15.73:0/1287833432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4d4004400 0x7fc4d40048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:46.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e77fe700 1 --2- 172.21.15.73:0/1287833432 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4e814ffb0 0x7fc4d40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:46.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e67fc700 1 -- 172.21.15.73:0/1287833432 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4e814ffb0 msgr2=0x7fc4d40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:46.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e67fc700 1 --2- 172.21.15.73:0/1287833432 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4e814ffb0 0x7fc4d40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:46.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e67fc700 1 -- 172.21.15.73:0/1287833432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4d4003a50 msgr2=0x7fc4d4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:46.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e67fc700 1 --2- 172.21.15.73:0/1287833432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4d4003a50 0x7fc4d4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:46.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e67fc700 1 -- 172.21.15.73:0/1287833432 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d40035d0 con 0x7fc4d4004400 2023-11-30T23:12:46.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e6ffd700 1 --2- 172.21.15.73:0/1287833432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4d4003a50 0x7fc4d4003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:46.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.243+0000 7fc4e67fc700 1 --2- 172.21.15.73:0/1287833432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4d4004400 0x7fc4d40048d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc4e806a610 tx=0x7fc4d40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2424cf814c345e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:46.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.247+0000 7fc4e5ffb700 1 -- 172.21.15.73:0/1287833432 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8001390 con 0x7fc4d4004400 2023-11-30T23:12:46.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.247+0000 7fc4e5ffb700 1 -- 172.21.15.73:0/1287833432 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d800c660 con 0x7fc4d4004400 2023-11-30T23:12:46.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.247+0000 7fc4e5ffb700 1 -- 172.21.15.73:0/1287833432 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d800ca10 con 0x7fc4d4004400 2023-11-30T23:12:46.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.247+0000 7fc4e7fff700 1 -- 172.21.15.73:0/1287833432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4d4004400 msgr2=0x7fc4d40048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:46.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.247+0000 7fc4e7fff700 1 --2- 172.21.15.73:0/1287833432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4d4004400 0x7fc4d40048d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc4e806a610 tx=0x7fc4d40058a0 comp rx=0 tx=0).stop 2023-11-30T23:12:46.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.247+0000 7fc4e77fe700 1 -- 172.21.15.73:0/1287833432 reap_dead start 2023-11-30T23:12:46.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.247+0000 7fc4e7fff700 1 -- 172.21.15.73:0/1287833432 shutdown_connections 2023-11-30T23:12:46.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.247+0000 7fc4e7fff700 1 -- 172.21.15.73:0/1287833432 >> 172.21.15.73:0/1287833432 conn(0x7fc4e8071ca0 msgr2=0x7fc4e80720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:46.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.247+0000 7fc4e7fff700 1 -- 172.21.15.73:0/1287833432 shutdown_connections 2023-11-30T23:12:46.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.247+0000 7fc4e7fff700 1 -- 172.21.15.73:0/1287833432 wait complete. 2023-11-30T23:12:46.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.247+0000 7fc4e7fff700 1 Processor -- start 2023-11-30T23:12:46.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.247+0000 7fc4e7fff700 1 -- start start 2023-11-30T23:12:46.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4e81dfcc0 0x7fc4e81e00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:46.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4e80b1ef0 0x7fc4e8136cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:46.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4e80b2370 0x7fc4e8137200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:46.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e7fff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e80b0390 con 0x7fc4e80b1ef0 2023-11-30T23:12:46.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e7fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e8136390 con 0x7fc4e81dfcc0 2023-11-30T23:12:46.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e7fff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e81e09b0 con 0x7fc4e80b2370 2023-11-30T23:12:46.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e67fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4e80b1ef0 0x7fc4e8136cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:46.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e67fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4e80b1ef0 0x7fc4e8136cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33848/0 (socket says 172.21.15.73:33848) 2023-11-30T23:12:46.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e67fc700 1 -- 172.21.15.73:0/2328520880 learned_addr learned my addr 172.21.15.73:0/2328520880 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:46.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e6ffd700 1 --2- 172.21.15.73:0/2328520880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4e81dfcc0 0x7fc4e81e00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:46.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e77fe700 1 --2- 172.21.15.73:0/2328520880 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4e80b2370 0x7fc4e8137200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:46.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e67fc700 1 -- 172.21.15.73:0/2328520880 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4e80b2370 msgr2=0x7fc4e8137200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:46.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e67fc700 1 --2- 172.21.15.73:0/2328520880 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4e80b2370 0x7fc4e8137200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:46.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e67fc700 1 -- 172.21.15.73:0/2328520880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4e81dfcc0 msgr2=0x7fc4e81e00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:46.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e67fc700 1 --2- 172.21.15.73:0/2328520880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4e81dfcc0 0x7fc4e81e00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:46.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e67fc700 1 -- 172.21.15.73:0/2328520880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e81367a0 con 0x7fc4e80b1ef0 2023-11-30T23:12:46.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e67fc700 1 --2- 172.21.15.73:0/2328520880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4e80b1ef0 0x7fc4e8136cc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4005830 tx=0x7fc4d8001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:46.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4df7fe700 1 -- 172.21.15.73:0/2328520880 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8001330 con 0x7fc4e80b1ef0 2023-11-30T23:12:46.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4df7fe700 1 -- 172.21.15.73:0/2328520880 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d80052e0 con 0x7fc4e80b1ef0 2023-11-30T23:12:46.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e7fff700 1 -- 172.21.15.73:0/2328520880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e814f920 con 0x7fc4e80b1ef0 2023-11-30T23:12:46.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4df7fe700 1 -- 172.21.15.73:0/2328520880 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d800c7d0 con 0x7fc4e80b1ef0 2023-11-30T23:12:46.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e7fff700 1 -- 172.21.15.73:0/2328520880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e8141280 con 0x7fc4e80b1ef0 2023-11-30T23:12:46.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.251+0000 7fc4e7fff700 1 -- 172.21.15.73:0/2328520880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e81365e0 con 0x7fc4e80b1ef0 2023-11-30T23:12:46.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.255+0000 7fc4df7fe700 1 -- 172.21.15.73:0/2328520880 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc4d8022070 con 0x7fc4e80b1ef0 2023-11-30T23:12:46.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.255+0000 7fc4df7fe700 1 --2- 172.21.15.73:0/2328520880 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc4c8065ad0 0x7fc4c8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:46.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.255+0000 7fc4df7fe700 1 -- 172.21.15.73:0/2328520880 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fc4d8083fe0 con 0x7fc4e80b1ef0 2023-11-30T23:12:46.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.255+0000 7fc4e6ffd700 1 --2- 172.21.15.73:0/2328520880 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc4c8065ad0 0x7fc4c8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:46.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.255+0000 7fc4e6ffd700 1 --2- 172.21.15.73:0/2328520880 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc4c8065ad0 0x7fc4c8067f90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0000fd0 tx=0x7fc4d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:46.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.259+0000 7fc4df7fe700 1 -- 172.21.15.73:0/2328520880 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fc4d8051c90 con 0x7fc4e80b1ef0 2023-11-30T23:12:46.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:46.427+0000 7fc4e7fff700 1 -- 172.21.15.73:0/2328520880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc4e80bc5d0 con 0x7fc4e80b1ef0 2023-11-30T23:12:47.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.115+0000 7fc4df7fe700 1 -- 172.21.15.73:0/2328520880 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc4d80552b0 con 0x7fc4e80b1ef0 2023-11-30T23:12:47.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.131+0000 7fc4e7fff700 1 -- 172.21.15.73:0/2328520880 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc4c8065ad0 msgr2=0x7fc4c8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.131+0000 7fc4e7fff700 1 --2- 172.21.15.73:0/2328520880 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc4c8065ad0 0x7fc4c8067f90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0000fd0 tx=0x7fc4d0009040 comp rx=0 tx=0).stop 2023-11-30T23:12:47.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.131+0000 7fc4e7fff700 1 -- 172.21.15.73:0/2328520880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4e80b1ef0 msgr2=0x7fc4e8136cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.131+0000 7fc4e7fff700 1 --2- 172.21.15.73:0/2328520880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4e80b1ef0 0x7fc4e8136cc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4005830 tx=0x7fc4d8001230 comp rx=0 tx=0).stop 2023-11-30T23:12:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.131+0000 7fc4e7fff700 1 -- 172.21.15.73:0/2328520880 shutdown_connections 2023-11-30T23:12:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.131+0000 7fc4e7fff700 1 --2- 172.21.15.73:0/2328520880 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc4e80b2370 0x7fc4e8137200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.131+0000 7fc4e7fff700 1 --2- 172.21.15.73:0/2328520880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4e80b1ef0 0x7fc4e8136cc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.131+0000 7fc4e7fff700 1 --2- 172.21.15.73:0/2328520880 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc4c8065ad0 0x7fc4c8067f90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.131+0000 7fc4e7fff700 1 --2- 172.21.15.73:0/2328520880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4e81dfcc0 0x7fc4e81e00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.131+0000 7fc4e7fff700 1 -- 172.21.15.73:0/2328520880 >> 172.21.15.73:0/2328520880 conn(0x7fc4e8071ca0 msgr2=0x7fc4e80bbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:47.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.135+0000 7fc4e7fff700 1 -- 172.21.15.73:0/2328520880 shutdown_connections 2023-11-30T23:12:47.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.135+0000 7fc4e7fff700 1 -- 172.21.15.73:0/2328520880 wait complete. 2023-11-30T23:12:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2023-11-30T23:12:47.153 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-30T23:12:47.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.259+0000 7fefd124b700 1 Processor -- start 2023-11-30T23:12:47.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.259+0000 7fefd124b700 1 -- start start 2023-11-30T23:12:47.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.259+0000 7fefd124b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefcc0b3010 0x7fefcc142d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.259+0000 7fefd124b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefcc06e7b0 con 0x7fefcc0b4170 2023-11-30T23:12:47.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.259+0000 7fefd124b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefcc06e540 con 0x7fefcc1432a0 2023-11-30T23:12:47.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.259+0000 7fefd124b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc06e380 con 0x7fefcc0b3010 2023-11-30T23:12:47.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.259+0000 7fefd0a4a700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fefcc0b4170 0x7fefcc14d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37016/0 (socket says 172.21.15.73:37016) 2023-11-30T23:12:47.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.259+0000 7fefd0a4a700 1 -- 172.21.15.73:0/3143539303 learned_addr learned my addr 172.21.15.73:0/3143539303 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:47.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.259+0000 7fefcbfff700 1 --2- 172.21.15.73:0/3143539303 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefcc0b3010 0x7fefcc142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.259+0000 7fefcaffd700 1 -- 172.21.15.73:0/3143539303 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293591759 0 0) 0x7fefcc06e7b0 con 0x7fefcc0b4170 2023-11-30T23:12:47.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.259+0000 7fefcaffd700 1 -- 172.21.15.73:0/3143539303 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefb80035d0 con 0x7fefcc0b4170 2023-11-30T23:12:47.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.259+0000 7fefcaffd700 1 -- 172.21.15.73:0/3143539303 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691297385 0 0) 0x7fefcc06e540 con 0x7fefcc1432a0 2023-11-30T23:12:47.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.259+0000 7fefcaffd700 1 -- 172.21.15.73:0/3143539303 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefcc06e7b0 con 0x7fefcc1432a0 2023-11-30T23:12:47.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.259+0000 7fefcaffd700 1 -- 172.21.15.73:0/3143539303 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1098638419 0 0) 0x7fefb80035d0 con 0x7fefcc0b4170 2023-11-30T23:12:47.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.259+0000 7fefcaffd700 1 -- 172.21.15.73:0/3143539303 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefcc0b3010 msgr2=0x7fefcc142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:47.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.259+0000 7fefcaffd700 1 --2- 172.21.15.73:0/3143539303 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefcc0b3010 0x7fefcc142d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.259+0000 7fefcaffd700 1 -- 172.21.15.73:0/3143539303 >> v1:172.21.15.156:6789/0 conn(0x7fefcc1432a0 legacy=0x7fefcc13fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcaffd700 1 -- 172.21.15.73:0/3143539303 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc0aed40 con 0x7fefcc0b4170 2023-11-30T23:12:47.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcaffd700 1 -- 172.21.15.73:0/3143539303 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3856460137 0 0) 0x7fefbc001670 con 0x7fefcc0b4170 2023-11-30T23:12:47.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcaffd700 1 -- 172.21.15.73:0/3143539303 >> v1:172.21.15.73:6789/0 conn(0x7fefcc0b4170 legacy=0x7fefcc14d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcaffd700 1 --2- 172.21.15.73:0/3143539303 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefcc0b3010 0x7fefb8003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcaffd700 1 --2- 172.21.15.73:0/3143539303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefb8004140 0x7fefb8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcaffd700 1 --2- 172.21.15.73:0/3143539303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefb8004db0 0x7fefb8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcaffd700 1 -- 172.21.15.73:0/3143539303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb800bbc0 con 0x7fefb8004140 2023-11-30T23:12:47.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcaffd700 1 -- 172.21.15.73:0/3143539303 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb800bd00 con 0x7fefb8004db0 2023-11-30T23:12:47.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcaffd700 1 -- 172.21.15.73:0/3143539303 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb800be90 con 0x7fefcc0b3010 2023-11-30T23:12:47.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcb7fe700 1 --2- 172.21.15.73:0/3143539303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefb8004140 0x7fefb8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcbfff700 1 --2- 172.21.15.73:0/3143539303 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefcc0b3010 0x7fefb8003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefd0a4a700 1 --2- 172.21.15.73:0/3143539303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefb8004db0 0x7fefb8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcb7fe700 1 -- 172.21.15.73:0/3143539303 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefcc0b3010 msgr2=0x7fefb8003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:47.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcb7fe700 1 --2- 172.21.15.73:0/3143539303 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefcc0b3010 0x7fefb8003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcb7fe700 1 -- 172.21.15.73:0/3143539303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefb8004db0 msgr2=0x7fefb8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:47.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcb7fe700 1 --2- 172.21.15.73:0/3143539303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefb8004db0 0x7fefb8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcb7fe700 1 -- 172.21.15.73:0/3143539303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb80035d0 con 0x7fefb8004140 2023-11-30T23:12:47.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcb7fe700 1 --2- 172.21.15.73:0/3143539303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefb8004140 0x7fefb8004870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fefc400c2f0 tx=0x7fefb80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d852218e93216 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:47.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcaffd700 1 -- 172.21.15.73:0/3143539303 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4001f30 con 0x7fefb8004140 2023-11-30T23:12:47.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcaffd700 1 -- 172.21.15.73:0/3143539303 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc400ce90 con 0x7fefb8004140 2023-11-30T23:12:47.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefcaffd700 1 -- 172.21.15.73:0/3143539303 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4003c60 con 0x7fefb8004140 2023-11-30T23:12:47.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefd124b700 1 -- 172.21.15.73:0/3143539303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefb8004140 msgr2=0x7fefb8004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefd124b700 1 --2- 172.21.15.73:0/3143539303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefb8004140 0x7fefb8004870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fefc400c2f0 tx=0x7fefb80058a0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefd0a4a700 1 -- 172.21.15.73:0/3143539303 reap_dead start 2023-11-30T23:12:47.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefd124b700 1 -- 172.21.15.73:0/3143539303 shutdown_connections 2023-11-30T23:12:47.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefd124b700 1 -- 172.21.15.73:0/3143539303 >> 172.21.15.73:0/3143539303 conn(0x7fefcc0b7b70 msgr2=0x7fefcc0b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:47.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefd124b700 1 -- 172.21.15.73:0/3143539303 shutdown_connections 2023-11-30T23:12:47.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefd124b700 1 -- 172.21.15.73:0/3143539303 wait complete. 2023-11-30T23:12:47.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefd124b700 1 Processor -- start 2023-11-30T23:12:47.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.263+0000 7fefd124b700 1 -- start start 2023-11-30T23:12:47.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefd124b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefcc13e3e0 0x7fefcc1d9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefd124b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefcc1da2f0 0x7fefcc1dd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefd124b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefcc1dd6f0 0x7fefcc1ddb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefd124b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc1445c0 con 0x7fefcc1da2f0 2023-11-30T23:12:47.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefd124b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc13d590 con 0x7fefcc13e3e0 2023-11-30T23:12:47.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefd124b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc1da770 con 0x7fefcc1dd6f0 2023-11-30T23:12:47.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefcb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefcc1da2f0 0x7fefcc1dd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefcb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefcc1da2f0 0x7fefcc1dd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33868/0 (socket says 172.21.15.73:33868) 2023-11-30T23:12:47.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefcb7fe700 1 -- 172.21.15.73:0/3359537673 learned_addr learned my addr 172.21.15.73:0/3359537673 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:47.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefd0a4a700 1 --2- 172.21.15.73:0/3359537673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefcc1dd6f0 0x7fefcc1ddb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefcbfff700 1 --2- 172.21.15.73:0/3359537673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefcc13e3e0 0x7fefcc1d9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefcb7fe700 1 -- 172.21.15.73:0/3359537673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefcc1dd6f0 msgr2=0x7fefcc1ddb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefcb7fe700 1 --2- 172.21.15.73:0/3359537673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefcc1dd6f0 0x7fefcc1ddb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefcb7fe700 1 -- 172.21.15.73:0/3359537673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefcc13e3e0 msgr2=0x7fefcc1d9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefcb7fe700 1 --2- 172.21.15.73:0/3359537673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefcc13e3e0 0x7fefcc1d9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefcb7fe700 1 -- 172.21.15.73:0/3359537673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc13cc60 con 0x7fefcc1da2f0 2023-11-30T23:12:47.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefcbfff700 1 --2- 172.21.15.73:0/3359537673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefcc13e3e0 0x7fefcc1d9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:12:47.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefcb7fe700 1 --2- 172.21.15.73:0/3359537673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefcc1da2f0 0x7fefcc1dd1b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fefc4004000 tx=0x7fefc4001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:47.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefc8ff9700 1 -- 172.21.15.73:0/3359537673 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc40052e0 con 0x7fefcc1da2f0 2023-11-30T23:12:47.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefc8ff9700 1 -- 172.21.15.73:0/3359537673 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc4005440 con 0x7fefcc1da2f0 2023-11-30T23:12:47.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefc8ff9700 1 -- 172.21.15.73:0/3359537673 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc40057d0 con 0x7fefcc1da2f0 2023-11-30T23:12:47.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefd124b700 1 -- 172.21.15.73:0/3359537673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefcc13cf40 con 0x7fefcc1da2f0 2023-11-30T23:12:47.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefd124b700 1 -- 172.21.15.73:0/3359537673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefcc13e7c0 con 0x7fefcc1da2f0 2023-11-30T23:12:47.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.267+0000 7fefd124b700 1 -- 172.21.15.73:0/3359537673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefcc13d6d0 con 0x7fefcc1da2f0 2023-11-30T23:12:47.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.271+0000 7fefc8ff9700 1 -- 172.21.15.73:0/3359537673 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fefc4019040 con 0x7fefcc1da2f0 2023-11-30T23:12:47.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.271+0000 7fefc8ff9700 1 --2- 172.21.15.73:0/3359537673 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fefac065ad0 0x7fefac067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.271+0000 7fefc8ff9700 1 -- 172.21.15.73:0/3359537673 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fefc4084970 con 0x7fefcc1da2f0 2023-11-30T23:12:47.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.271+0000 7fefcbfff700 1 --2- 172.21.15.73:0/3359537673 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fefac065ad0 0x7fefac067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.271+0000 7fefcbfff700 1 --2- 172.21.15.73:0/3359537673 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fefac065ad0 0x7fefac067f90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fefb400ac80 tx=0x7fefb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:47.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.275+0000 7fefc8ff9700 1 -- 172.21.15.73:0/3359537673 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fefc4052380 con 0x7fefcc1da2f0 2023-11-30T23:12:47.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.475+0000 7fefd124b700 1 -- 172.21.15.73:0/3359537673 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fefcc0b8440 con 0x7fefcc1da2f0 2023-11-30T23:12:47.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.483+0000 7fefc8ff9700 1 -- 172.21.15.73:0/3359537673 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fefc402d0c0 con 0x7fefcc1da2f0 2023-11-30T23:12:47.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.491+0000 7fefd124b700 1 -- 172.21.15.73:0/3359537673 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fefac065ad0 msgr2=0x7fefac067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.491+0000 7fefd124b700 1 --2- 172.21.15.73:0/3359537673 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fefac065ad0 0x7fefac067f90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fefb400ac80 tx=0x7fefb4008040 comp rx=0 tx=0).stop 2023-11-30T23:12:47.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.491+0000 7fefd124b700 1 -- 172.21.15.73:0/3359537673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefcc1da2f0 msgr2=0x7fefcc1dd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.491+0000 7fefd124b700 1 --2- 172.21.15.73:0/3359537673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefcc1da2f0 0x7fefcc1dd1b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fefc4004000 tx=0x7fefc4001650 comp rx=0 tx=0).stop 2023-11-30T23:12:47.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.491+0000 7fefd124b700 1 -- 172.21.15.73:0/3359537673 shutdown_connections 2023-11-30T23:12:47.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.491+0000 7fefd124b700 1 --2- 172.21.15.73:0/3359537673 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fefcc1dd6f0 0x7fefcc1ddb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.491+0000 7fefd124b700 1 --2- 172.21.15.73:0/3359537673 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefcc1da2f0 0x7fefcc1dd1b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.491+0000 7fefd124b700 1 --2- 172.21.15.73:0/3359537673 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fefac065ad0 0x7fefac067f90 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fefb400ac80 tx=0x7fefb4008040 comp rx=0 tx=0).stop 2023-11-30T23:12:47.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.491+0000 7fefd124b700 1 --2- 172.21.15.73:0/3359537673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fefcc13e3e0 0x7fefcc1d9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.491+0000 7fefd124b700 1 -- 172.21.15.73:0/3359537673 >> 172.21.15.73:0/3359537673 conn(0x7fefcc0b7b70 msgr2=0x7fefcc066490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:47.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.495+0000 7fefd124b700 1 -- 172.21.15.73:0/3359537673 shutdown_connections 2023-11-30T23:12:47.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.495+0000 7fefd124b700 1 -- 172.21.15.73:0/3359537673 wait complete. 2023-11-30T23:12:47.510 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 2 and data pool 3 2023-11-30T23:12:47.526 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T23:12:47.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.623+0000 7fb7affff700 1 Processor -- start 2023-11-30T23:12:47.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.623+0000 7fb7affff700 1 -- start start 2023-11-30T23:12:47.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.623+0000 7fb7affff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7b0140cf0 0x7fb7b0152060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.623+0000 7fb7affff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b006a590 con 0x7fb7b006f420 2023-11-30T23:12:47.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.623+0000 7fb7affff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b006f800 con 0x7fb7b00b4dc0 2023-11-30T23:12:47.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.623+0000 7fb7affff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b006a220 con 0x7fb7b0140cf0 2023-11-30T23:12:47.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.623+0000 7fb7aeffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb7b006f420 0x7fb7b0146790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37022/0 (socket says 172.21.15.73:37022) 2023-11-30T23:12:47.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.623+0000 7fb7aeffd700 1 -- 172.21.15.73:0/2900907034 learned_addr learned my addr 172.21.15.73:0/2900907034 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:47.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.623+0000 7fb7af7fe700 1 --2- 172.21.15.73:0/2900907034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7b0140cf0 0x7fb7b0152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7ae7fc700 1 -- 172.21.15.73:0/2900907034 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648040058 0 0) 0x7fb7b006a590 con 0x7fb7b006f420 2023-11-30T23:12:47.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7ae7fc700 1 -- 172.21.15.73:0/2900907034 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb79c0035d0 con 0x7fb7b006f420 2023-11-30T23:12:47.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7ae7fc700 1 -- 172.21.15.73:0/2900907034 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773757260 0 0) 0x7fb7b006f800 con 0x7fb7b00b4dc0 2023-11-30T23:12:47.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7ae7fc700 1 -- 172.21.15.73:0/2900907034 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7b006a590 con 0x7fb7b00b4dc0 2023-11-30T23:12:47.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7af7fe700 1 -- 172.21.15.73:0/2900907034 >> v1:172.21.15.156:6789/0 conn(0x7fb7b00b4dc0 legacy=0x7fb7b01405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7ae7fc700 1 -- 172.21.15.73:0/2900907034 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1744627642 0 0) 0x7fb79c0035d0 con 0x7fb7b006f420 2023-11-30T23:12:47.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7af7fe700 1 -- 172.21.15.73:0/2900907034 >> v1:172.21.15.73:6789/0 conn(0x7fb7b006f420 legacy=0x7fb7b0146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7af7fe700 1 -- 172.21.15.73:0/2900907034 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b006afc0 con 0x7fb7b0140cf0 2023-11-30T23:12:47.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7af7fe700 1 --2- 172.21.15.73:0/2900907034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7b0140cf0 0x7fb7b0152060 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8009dc0 tx=0x7fb7a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb4b6f48bdc35369 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:47.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7ae7fc700 1 -- 172.21.15.73:0/2900907034 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a800e070 con 0x7fb7b0140cf0 2023-11-30T23:12:47.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7ae7fc700 1 -- 172.21.15.73:0/2900907034 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a8003a40 con 0x7fb7b0140cf0 2023-11-30T23:12:47.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7ae7fc700 1 -- 172.21.15.73:0/2900907034 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0001670 con 0x7fb7b0140cf0 2023-11-30T23:12:47.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7affff700 1 -- 172.21.15.73:0/2900907034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7b0140cf0 msgr2=0x7fb7b0152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7affff700 1 --2- 172.21.15.73:0/2900907034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7b0140cf0 0x7fb7b0152060 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8009dc0 tx=0x7fb7a800b330 comp rx=0 tx=0).stop 2023-11-30T23:12:47.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7affff700 1 -- 172.21.15.73:0/2900907034 shutdown_connections 2023-11-30T23:12:47.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7affff700 1 --2- 172.21.15.73:0/2900907034 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7b0140cf0 0x7fb7b0152060 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7affff700 1 -- 172.21.15.73:0/2900907034 >> 172.21.15.73:0/2900907034 conn(0x7fb7b006b290 msgr2=0x7fb7b006b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:47.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7affff700 1 -- 172.21.15.73:0/2900907034 shutdown_connections 2023-11-30T23:12:47.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.627+0000 7fb7affff700 1 -- 172.21.15.73:0/2900907034 wait complete. 2023-11-30T23:12:47.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7affff700 1 Processor -- start 2023-11-30T23:12:47.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7affff700 1 -- start start 2023-11-30T23:12:47.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7affff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7b006f420 0x7fb7b01497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7affff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7b00b4dc0 0x7fb7b00af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7affff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7b0140cf0 0x7fb7b01db860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7affff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00ae4a0 con 0x7fb7b00b4dc0 2023-11-30T23:12:47.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7affff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b01dc860 con 0x7fb7b006f420 2023-11-30T23:12:47.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7affff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00af980 con 0x7fb7b0140cf0 2023-11-30T23:12:47.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7a7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7b00b4dc0 0x7fb7b00af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7a7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7b00b4dc0 0x7fb7b00af440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33882/0 (socket says 172.21.15.73:33882) 2023-11-30T23:12:47.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7a7fff700 1 -- 172.21.15.73:0/1084336873 learned_addr learned my addr 172.21.15.73:0/1084336873 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:47.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7aeffd700 1 --2- 172.21.15.73:0/1084336873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7b006f420 0x7fb7b01497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7af7fe700 1 --2- 172.21.15.73:0/1084336873 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7b0140cf0 0x7fb7b01db860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7a7fff700 1 -- 172.21.15.73:0/1084336873 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7b0140cf0 msgr2=0x7fb7b01db860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7a7fff700 1 --2- 172.21.15.73:0/1084336873 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7b0140cf0 0x7fb7b01db860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7a7fff700 1 -- 172.21.15.73:0/1084336873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7b006f420 msgr2=0x7fb7b01497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7a7fff700 1 --2- 172.21.15.73:0/1084336873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7b006f420 0x7fb7b01497e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7a7fff700 1 -- 172.21.15.73:0/1084336873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a8009a70 con 0x7fb7b00b4dc0 2023-11-30T23:12:47.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7a7fff700 1 --2- 172.21.15.73:0/1084336873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7b00b4dc0 0x7fb7b00af440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb79800c520 tx=0x7fb79800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:47.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7a77fe700 1 -- 172.21.15.73:0/1084336873 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7980052d0 con 0x7fb7b00b4dc0 2023-11-30T23:12:47.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7a77fe700 1 -- 172.21.15.73:0/1084336873 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb798005430 con 0x7fb7b00b4dc0 2023-11-30T23:12:47.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7a77fe700 1 -- 172.21.15.73:0/1084336873 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7980055a0 con 0x7fb7b00b4dc0 2023-11-30T23:12:47.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7affff700 1 -- 172.21.15.73:0/1084336873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b00adb90 con 0x7fb7b00b4dc0 2023-11-30T23:12:47.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.631+0000 7fb7affff700 1 -- 172.21.15.73:0/1084336873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b00ae0c0 con 0x7fb7b00b4dc0 2023-11-30T23:12:47.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.635+0000 7fb7affff700 1 -- 172.21.15.73:0/1084336873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b004ed80 con 0x7fb7b00b4dc0 2023-11-30T23:12:47.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.635+0000 7fb7a77fe700 1 -- 172.21.15.73:0/1084336873 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb7980038e0 con 0x7fb7b00b4dc0 2023-11-30T23:12:47.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.639+0000 7fb7a77fe700 1 --2- 172.21.15.73:0/1084336873 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb790065ad0 0x7fb790067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.639+0000 7fb7a77fe700 1 -- 172.21.15.73:0/1084336873 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb798082960 con 0x7fb7b00b4dc0 2023-11-30T23:12:47.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.639+0000 7fb7aeffd700 1 --2- 172.21.15.73:0/1084336873 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb790065ad0 0x7fb790067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.639+0000 7fb7aeffd700 1 --2- 172.21.15.73:0/1084336873 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb790065ad0 0x7fb790067f90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0000f60 tx=0x7fb7a0001490 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:47.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.643+0000 7fb7a77fe700 1 -- 172.21.15.73:0/1084336873 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fb798050280 con 0x7fb7b00b4dc0 2023-11-30T23:12:47.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.807+0000 7fb7affff700 1 -- 172.21.15.73:0/1084336873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7b006bbc0 con 0x7fb7b00b4dc0 2023-11-30T23:12:47.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.811+0000 7fb7a77fe700 1 -- 172.21.15.73:0/1084336873 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16050 (secure 0 0 0) 0x7fb798017020 con 0x7fb7b00b4dc0 2023-11-30T23:12:47.817 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:47.817 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"fsid":"a677cb6a-4a54-4567-a30d-f0fa4bc22b17","created":"2023-11-30T23:12:23.260968+0000","modified":"2023-11-30T23:12:47.480449+0000","last_up_change":"2023-11-30T23:12:33.649318+0000","last_in_change":"2023-11-30T23:12:25.326689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-30T23:12:34.413317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-30T23:12:45.403156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-30T23:12:46.475384+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbf1c93f-0775-4780-8524-cf25792d9aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36686},{"type":"v1","addr":"172.21.15.73:6817","nonce":36686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36686},{"type":"v1","addr":"172.21.15.73:6819","nonce":36686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36686},{"type":"v1","addr":"172.21.15.73:6823","nonce":36686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36686},{"type":"v1","addr":"172.21.15.73:6821","nonce":36686}]},"public_addr":"172.21.15.73:6817/36686","cluster_addr":"172.21.15.73:6819/36686","heartbeat_back_addr":"172.21.15.73:6823/36686","heartbeat_front_addr":"172.21.15.73:6821/36686","state":["exists","up"]},{"osd":1,"uuid":"9d9dd122-9a42-4588-a0d2-50d13b13eba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36687},{"type":"v1","addr":"172.21.15.73:6809","nonce":36687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":36687},{"type":"v1","addr":"172.21.15.73:6811","nonce":36687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36687},{"type":"v1","addr":"172.21.15.73:6815","nonce":36687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36687},{"type":"v1","addr":"172.21.15.73:6813","nonce":36687}]},"public_addr":"172.21.15.73:6809/36687","cluster_addr":"172.21.15.73:6811/36687","heartbeat_back_addr":"172.21.15.73:6815/36687","heartbeat_front_addr":"172.21.15.73:6813/36687","state":["exists","up"]},{"osd":2,"uuid":"68ff4f1e-ec45-42e0-bb83-fe03598e4940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36688},{"type":"v1","addr":"172.21.15.73:6825","nonce":36688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36688},{"type":"v1","addr":"172.21.15.73:6827","nonce":36688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36688},{"type":"v1","addr":"172.21.15.73:6831","nonce":36688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36688},{"type":"v1","addr":"172.21.15.73:6829","nonce":36688}]},"public_addr":"172.21.15.73:6825/36688","cluster_addr":"172.21.15.73:6827/36688","heartbeat_back_addr":"172.21.15.73:6831/36688","heartbeat_front_addr":"172.21.15.73:6829/36688","state":["exists","up"]},{"osd":3,"uuid":"e4b08c98-6a4d-4ec8-a245-59a35f70a16f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36685},{"type":"v1","addr":"172.21.15.73:6801","nonce":36685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36685},{"type":"v1","addr":"172.21.15.73:6803","nonce":36685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":36685},{"type":"v1","addr":"172.21.15.73:6807","nonce":36685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36685},{"type":"v1","addr":"172.21.15.73:6805","nonce":36685}]},"public_addr":"172.21.15.73:6801/36685","cluster_addr":"172.21.15.73:6803/36685","heartbeat_back_addr":"172.21.15.73:6807/36685","heartbeat_front_addr":"172.21.15.73:6805/36685","state":["exists","up"]},{"osd":4,"uuid":"d0922b0e-5170-474d-b270-ddb5adc858cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":36908},{"type":"v1","addr":"172.21.15.156:6801","nonce":36908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":36908},{"type":"v1","addr":"172.21.15.156:6803","nonce":36908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":36908},{"type":"v1","addr":"172.21.15.156:6807","nonce":36908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":36908},{"type":"v1","addr":"172.21.15.156:6805","nonce":36908}]},"public_addr":"172.21.15.156:6801/36908","cluster_addr":"172.21.15.156:6803/36908","heartbeat_back_addr":"172.21.15.156:6807/36908","heartbeat_front_addr":"172.21.15.156:6805/36908","state":["exists","up"]},{"osd":5,"uuid":"f2791a77-db25-479c-95d5-ea7f77458685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":36909},{"type":"v1","addr":"172.21.15.156:6809","nonce":36909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":36909},{"type":"v1","addr":"172.21.15.156:6811","nonce":36909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":36909},{"type":"v1","addr":"172.21.15.156:6815","nonce":36909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":36909},{"type":"v1","addr":"172.21.15.156:6813","nonce":36909}]},"public_addr":"172.21.15.156:6809/36909","cluster_addr":"172.21.15.156:6811/36909","heartbeat_back_addr":"172.21.15.156:6815/36909","heartbeat_front_addr":"172.21.15.156:6813/36909","state":["exists","up"]},{"osd":6,"uuid":"f86c2fe9-ec8b-406e-af26-5dc65c926382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":36910},{"type":"v1","addr":"172.21.15.156:6817","nonce":36910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":36910},{"type":"v1","addr":"172.21.15.156:6819","nonce":36910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":36910},{"type":"v1","addr":"172.21.15.156:6823","nonce":36910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":36910},{"type":"v1","addr":"172.21.15.156:6821","nonce":36910}]},"public_addr":"172.21.15.156:6817/36910","cluster_addr":"172.21.15.156:6819/36910","heartbeat_back_addr":"172.21.15.156:6823/36910","heartbeat_front_addr":"172.21.15.156:6821/36910","state":["exists","up"]},{"osd":7,"uuid":"56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":36911},{"type":"v1","addr":"172.21.15.156:6825","nonce":36911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":36911},{"type":"v1","addr":"172.21.15.156:6827","nonce":36911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":36911},{"type":"v1","addr":"172.21.15.156:6831","nonce":36911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":36911},{"type":"v1","addr":"172.21.15.156:6829","nonce":36911}]},"public_addr":"172.21.15.156:6825/36911","cluster_addr":"172.21.15.156:6827/36911","heartbeat_back_addr":"172.21.15.156:6831/36911","heartbeat_front_addr":"172.21.15.156:6829/36911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.597534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.505493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.811871+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.586741+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.366817+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.101605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.627496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.829046+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T23:12:47.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.815+0000 7fb7affff700 1 -- 172.21.15.73:0/1084336873 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb790065ad0 msgr2=0x7fb790067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.815+0000 7fb7affff700 1 --2- 172.21.15.73:0/1084336873 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb790065ad0 0x7fb790067f90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0000f60 tx=0x7fb7a0001490 comp rx=0 tx=0).stop 2023-11-30T23:12:47.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.815+0000 7fb7affff700 1 -- 172.21.15.73:0/1084336873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7b00b4dc0 msgr2=0x7fb7b00af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.815+0000 7fb7affff700 1 --2- 172.21.15.73:0/1084336873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7b00b4dc0 0x7fb7b00af440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb79800c520 tx=0x7fb79800c8e0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.815+0000 7fb7affff700 1 -- 172.21.15.73:0/1084336873 shutdown_connections 2023-11-30T23:12:47.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.815+0000 7fb7affff700 1 --2- 172.21.15.73:0/1084336873 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7b0140cf0 0x7fb7b01db860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.815+0000 7fb7affff700 1 --2- 172.21.15.73:0/1084336873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7b00b4dc0 0x7fb7b00af440 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.815+0000 7fb7affff700 1 --2- 172.21.15.73:0/1084336873 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb790065ad0 0x7fb790067f90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.815+0000 7fb7affff700 1 --2- 172.21.15.73:0/1084336873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7b006f420 0x7fb7b01497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.815+0000 7fb7affff700 1 -- 172.21.15.73:0/1084336873 >> 172.21.15.73:0/1084336873 conn(0x7fb7b006b290 msgr2=0x7fb7b013ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:47.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.815+0000 7fb7affff700 1 -- 172.21.15.73:0/1084336873 shutdown_connections 2023-11-30T23:12:47.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.815+0000 7fb7affff700 1 -- 172.21.15.73:0/1084336873 wait complete. 2023-11-30T23:12:47.831 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T23:12:47.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.939+0000 7fd109f69700 1 Processor -- start 2023-11-30T23:12:47.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.939+0000 7fd109f69700 1 -- start start 2023-11-30T23:12:47.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.939+0000 7fd109f69700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1040b2fa0 0x7fd104142b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.939+0000 7fd109f69700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd1040b15d0 0x7fd10413fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.939+0000 7fd109f69700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd10406e990 con 0x7fd1041403b0 2023-11-30T23:12:47.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.939+0000 7fd109f69700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1040b1120 con 0x7fd1040b15d0 2023-11-30T23:12:47.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.939+0000 7fd109f69700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040ae730 con 0x7fd1040b2fa0 2023-11-30T23:12:47.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.939+0000 7fd103fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd1040b15d0 0x7fd10413fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.939+0000 7fd103fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd1040b15d0 0x7fd10413fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33884/0 (socket says 172.21.15.73:33884) 2023-11-30T23:12:47.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.939+0000 7fd103fff700 1 -- 172.21.15.73:0/1913758933 learned_addr learned my addr 172.21.15.73:0/1913758933 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:47.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.939+0000 7fd108f67700 1 --2- 172.21.15.73:0/1913758933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1040b2fa0 0x7fd104142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.939+0000 7fd103fff700 1 -- 172.21.15.73:0/1913758933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1040b2fa0 msgr2=0x7fd104142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:47.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.939+0000 7fd103fff700 1 --2- 172.21.15.73:0/1913758933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1040b2fa0 0x7fd104142b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.939+0000 7fd103fff700 1 -- 172.21.15.73:0/1913758933 >> v1:172.21.15.156:6789/0 conn(0x7fd1041403b0 legacy=0x7fd1041460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.939+0000 7fd103fff700 1 -- 172.21.15.73:0/1913758933 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1040b3380 con 0x7fd1040b15d0 2023-11-30T23:12:47.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.939+0000 7fd103fff700 1 --2- 172.21.15.73:0/1913758933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1040b15d0 0x7fd10413fe70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009e50 tx=0x7fd0fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ba7a3036703383 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:47.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.939+0000 7fd1037fe700 1 -- 172.21.15.73:0/1913758933 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc00e070 con 0x7fd1040b15d0 2023-11-30T23:12:47.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd1037fe700 1 -- 172.21.15.73:0/1913758933 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0fc00b9c0 con 0x7fd1040b15d0 2023-11-30T23:12:47.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd1037fe700 1 -- 172.21.15.73:0/1913758933 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc00bd70 con 0x7fd1040b15d0 2023-11-30T23:12:47.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd109f69700 1 -- 172.21.15.73:0/1913758933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1040b15d0 msgr2=0x7fd10413fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd109f69700 1 --2- 172.21.15.73:0/1913758933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1040b15d0 0x7fd10413fe70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009e50 tx=0x7fd0fc00b330 comp rx=0 tx=0).stop 2023-11-30T23:12:47.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd109f69700 1 -- 172.21.15.73:0/1913758933 shutdown_connections 2023-11-30T23:12:47.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd109f69700 1 --2- 172.21.15.73:0/1913758933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1040b15d0 0x7fd10413fe70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd109f69700 1 --2- 172.21.15.73:0/1913758933 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1040b2fa0 0x7fd104142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd109f69700 1 -- 172.21.15.73:0/1913758933 >> 172.21.15.73:0/1913758933 conn(0x7fd1040b45a0 msgr2=0x7fd1040b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:47.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd109f69700 1 -- 172.21.15.73:0/1913758933 shutdown_connections 2023-11-30T23:12:47.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd109f69700 1 -- 172.21.15.73:0/1913758933 wait complete. 2023-11-30T23:12:47.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd109f69700 1 Processor -- start 2023-11-30T23:12:47.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd109f69700 1 -- start start 2023-11-30T23:12:47.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd109f69700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1040b2fa0 0x7fd10413d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd109f69700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1041403b0 0x7fd10406ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd109f69700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1041dfb20 0x7fd104134970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd109f69700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1041df690 con 0x7fd1040b2fa0 2023-11-30T23:12:47.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd109f69700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1041dede0 con 0x7fd1041dfb20 2023-11-30T23:12:47.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd109f69700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040a9ab0 con 0x7fd1041403b0 2023-11-30T23:12:47.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd108f67700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1040b2fa0 0x7fd10413d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd108f67700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1040b2fa0 0x7fd10413d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33896/0 (socket says 172.21.15.73:33896) 2023-11-30T23:12:47.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd108f67700 1 -- 172.21.15.73:0/1849905687 learned_addr learned my addr 172.21.15.73:0/1849905687 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:47.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd109768700 1 --2- 172.21.15.73:0/1849905687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1041dfb20 0x7fd104134970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd103fff700 1 --2- 172.21.15.73:0/1849905687 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1041403b0 0x7fd10406ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd108f67700 1 -- 172.21.15.73:0/1849905687 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1041403b0 msgr2=0x7fd10406ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd108f67700 1 --2- 172.21.15.73:0/1849905687 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1041403b0 0x7fd10406ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd108f67700 1 -- 172.21.15.73:0/1849905687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1041dfb20 msgr2=0x7fd104134970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:47.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd108f67700 1 --2- 172.21.15.73:0/1849905687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1041dfb20 0x7fd104134970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:47.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.943+0000 7fd108f67700 1 -- 172.21.15.73:0/1849905687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc009b30 con 0x7fd1040b2fa0 2023-11-30T23:12:47.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.947+0000 7fd108f67700 1 --2- 172.21.15.73:0/1849905687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1040b2fa0 0x7fd10413d7b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800e790 tx=0x7fd0f800eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:47.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.947+0000 7fd1017fa700 1 -- 172.21.15.73:0/1849905687 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f800c070 con 0x7fd1040b2fa0 2023-11-30T23:12:47.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.947+0000 7fd1017fa700 1 -- 172.21.15.73:0/1849905687 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f8013610 con 0x7fd1040b2fa0 2023-11-30T23:12:47.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.947+0000 7fd109f69700 1 -- 172.21.15.73:0/1849905687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd104070440 con 0x7fd1040b2fa0 2023-11-30T23:12:47.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.947+0000 7fd1017fa700 1 -- 172.21.15.73:0/1849905687 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8013980 con 0x7fd1040b2fa0 2023-11-30T23:12:47.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.947+0000 7fd109f69700 1 -- 172.21.15.73:0/1849905687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1041df320 con 0x7fd1040b2fa0 2023-11-30T23:12:47.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.947+0000 7fd109f69700 1 -- 172.21.15.73:0/1849905687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10404ed80 con 0x7fd1040b2fa0 2023-11-30T23:12:47.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.947+0000 7fd1017fa700 1 -- 172.21.15.73:0/1849905687 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd0f8013ae0 con 0x7fd1040b2fa0 2023-11-30T23:12:47.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.951+0000 7fd1017fa700 1 --2- 172.21.15.73:0/1849905687 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd0f0065b00 0x7fd0f0067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:47.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.951+0000 7fd1017fa700 1 -- 172.21.15.73:0/1849905687 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0f8083460 con 0x7fd1040b2fa0 2023-11-30T23:12:47.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.951+0000 7fd103fff700 1 --2- 172.21.15.73:0/1849905687 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd0f0065b00 0x7fd0f0067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:47.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.951+0000 7fd103fff700 1 --2- 172.21.15.73:0/1849905687 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd0f0065b00 0x7fd0f0067fc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd10406e560 tx=0x7fd0fc009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:47.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:47.955+0000 7fd1017fa700 1 -- 172.21.15.73:0/1849905687 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fd0f8050ec0 con 0x7fd1040b2fa0 2023-11-30T23:12:48.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.119+0000 7fd109f69700 1 -- 172.21.15.73:0/1849905687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1040aec80 con 0x7fd1040b2fa0 2023-11-30T23:12:48.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.123+0000 7fd1017fa700 1 -- 172.21.15.73:0/1849905687 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16050 (secure 0 0 0) 0x7fd0f80544e0 con 0x7fd1040b2fa0 2023-11-30T23:12:48.127 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:48.128 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"fsid":"a677cb6a-4a54-4567-a30d-f0fa4bc22b17","created":"2023-11-30T23:12:23.260968+0000","modified":"2023-11-30T23:12:47.480449+0000","last_up_change":"2023-11-30T23:12:33.649318+0000","last_in_change":"2023-11-30T23:12:25.326689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-30T23:12:34.413317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-30T23:12:45.403156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-30T23:12:46.475384+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbf1c93f-0775-4780-8524-cf25792d9aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36686},{"type":"v1","addr":"172.21.15.73:6817","nonce":36686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36686},{"type":"v1","addr":"172.21.15.73:6819","nonce":36686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36686},{"type":"v1","addr":"172.21.15.73:6823","nonce":36686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36686},{"type":"v1","addr":"172.21.15.73:6821","nonce":36686}]},"public_addr":"172.21.15.73:6817/36686","cluster_addr":"172.21.15.73:6819/36686","heartbeat_back_addr":"172.21.15.73:6823/36686","heartbeat_front_addr":"172.21.15.73:6821/36686","state":["exists","up"]},{"osd":1,"uuid":"9d9dd122-9a42-4588-a0d2-50d13b13eba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36687},{"type":"v1","addr":"172.21.15.73:6809","nonce":36687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":36687},{"type":"v1","addr":"172.21.15.73:6811","nonce":36687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36687},{"type":"v1","addr":"172.21.15.73:6815","nonce":36687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36687},{"type":"v1","addr":"172.21.15.73:6813","nonce":36687}]},"public_addr":"172.21.15.73:6809/36687","cluster_addr":"172.21.15.73:6811/36687","heartbeat_back_addr":"172.21.15.73:6815/36687","heartbeat_front_addr":"172.21.15.73:6813/36687","state":["exists","up"]},{"osd":2,"uuid":"68ff4f1e-ec45-42e0-bb83-fe03598e4940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36688},{"type":"v1","addr":"172.21.15.73:6825","nonce":36688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36688},{"type":"v1","addr":"172.21.15.73:6827","nonce":36688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36688},{"type":"v1","addr":"172.21.15.73:6831","nonce":36688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36688},{"type":"v1","addr":"172.21.15.73:6829","nonce":36688}]},"public_addr":"172.21.15.73:6825/36688","cluster_addr":"172.21.15.73:6827/36688","heartbeat_back_addr":"172.21.15.73:6831/36688","heartbeat_front_addr":"172.21.15.73:6829/36688","state":["exists","up"]},{"osd":3,"uuid":"e4b08c98-6a4d-4ec8-a245-59a35f70a16f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36685},{"type":"v1","addr":"172.21.15.73:6801","nonce":36685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36685},{"type":"v1","addr":"172.21.15.73:6803","nonce":36685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":36685},{"type":"v1","addr":"172.21.15.73:6807","nonce":36685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36685},{"type":"v1","addr":"172.21.15.73:6805","nonce":36685}]},"public_addr":"172.21.15.73:6801/36685","cluster_addr":"172.21.15.73:6803/36685","heartbeat_back_addr":"172.21.15.73:6807/36685","heartbeat_front_addr":"172.21.15.73:6805/36685","state":["exists","up"]},{"osd":4,"uuid":"d0922b0e-5170-474d-b270-ddb5adc858cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":36908},{"type":"v1","addr":"172.21.15.156:6801","nonce":36908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":36908},{"type":"v1","addr":"172.21.15.156:6803","nonce":36908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":36908},{"type":"v1","addr":"172.21.15.156:6807","nonce":36908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":36908},{"type":"v1","addr":"172.21.15.156:6805","nonce":36908}]},"public_addr":"172.21.15.156:6801/36908","cluster_addr":"172.21.15.156:6803/36908","heartbeat_back_addr":"172.21.15.156:6807/36908","heartbeat_front_addr":"172.21.15.156:6805/36908","state":["exists","up"]},{"osd":5,"uuid":"f2791a77-db25-479c-95d5-ea7f77458685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":36909},{"type":"v1","addr":"172.21.15.156:6809","nonce":36909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":36909},{"type":"v1","addr":"172.21.15.156:6811","nonce":36909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":36909},{"type":"v1","addr":"172.21.15.156:6815","nonce":36909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":36909},{"type":"v1","addr":"172.21.15.156:6813","nonce":36909}]},"public_addr":"172.21.15.156:6809/36909","cluster_addr":"172.21.15.156:6811/36909","heartbeat_back_addr":"172.21.15.156:6815/36909","heartbeat_front_addr":"172.21.15.156:6813/36909","state":["exists","up"]},{"osd":6,"uuid":"f86c2fe9-ec8b-406e-af26-5dc65c926382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":36910},{"type":"v1","addr":"172.21.15.156:6817","nonce":36910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":36910},{"type":"v1","addr":"172.21.15.156:6819","nonce":36910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":36910},{"type":"v1","addr":"172.21.15.156:6823","nonce":36910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":36910},{"type":"v1","addr":"172.21.15.156:6821","nonce":36910}]},"public_addr":"172.21.15.156:6817/36910","cluster_addr":"172.21.15.156:6819/36910","heartbeat_back_addr":"172.21.15.156:6823/36910","heartbeat_front_addr":"172.21.15.156:6821/36910","state":["exists","up"]},{"osd":7,"uuid":"56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":36911},{"type":"v1","addr":"172.21.15.156:6825","nonce":36911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":36911},{"type":"v1","addr":"172.21.15.156:6827","nonce":36911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":36911},{"type":"v1","addr":"172.21.15.156:6831","nonce":36911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":36911},{"type":"v1","addr":"172.21.15.156:6829","nonce":36911}]},"public_addr":"172.21.15.156:6825/36911","cluster_addr":"172.21.15.156:6827/36911","heartbeat_back_addr":"172.21.15.156:6831/36911","heartbeat_front_addr":"172.21.15.156:6829/36911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.597534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.505493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.811871+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.586741+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.366817+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.101605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.627496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.829046+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T23:12:48.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.123+0000 7fd109f69700 1 -- 172.21.15.73:0/1849905687 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd0f0065b00 msgr2=0x7fd0f0067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:48.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.123+0000 7fd109f69700 1 --2- 172.21.15.73:0/1849905687 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd0f0065b00 0x7fd0f0067fc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd10406e560 tx=0x7fd0fc009000 comp rx=0 tx=0).stop 2023-11-30T23:12:48.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.123+0000 7fd109f69700 1 -- 172.21.15.73:0/1849905687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1040b2fa0 msgr2=0x7fd10413d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:48.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.123+0000 7fd109f69700 1 --2- 172.21.15.73:0/1849905687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1040b2fa0 0x7fd10413d7b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800e790 tx=0x7fd0f800eaa0 comp rx=0 tx=0).stop 2023-11-30T23:12:48.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.127+0000 7fd109f69700 1 -- 172.21.15.73:0/1849905687 shutdown_connections 2023-11-30T23:12:48.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.127+0000 7fd109f69700 1 --2- 172.21.15.73:0/1849905687 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd0f0065b00 0x7fd0f0067fc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:48.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.127+0000 7fd109f69700 1 --2- 172.21.15.73:0/1849905687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1041dfb20 0x7fd104134970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:48.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.127+0000 7fd109f69700 1 --2- 172.21.15.73:0/1849905687 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd1041403b0 0x7fd10406ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:48.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.127+0000 7fd109f69700 1 --2- 172.21.15.73:0/1849905687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1040b2fa0 0x7fd10413d7b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:48.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.127+0000 7fd109f69700 1 -- 172.21.15.73:0/1849905687 >> 172.21.15.73:0/1849905687 conn(0x7fd1040b45a0 msgr2=0x7fd104066490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:48.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.127+0000 7fd109f69700 1 -- 172.21.15.73:0/1849905687 shutdown_connections 2023-11-30T23:12:48.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.127+0000 7fd109f69700 1 -- 172.21.15.73:0/1849905687 wait complete. 2023-11-30T23:12:48.143 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-30T23:12:48.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.255+0000 7f636f59e700 1 Processor -- start 2023-11-30T23:12:48.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.255+0000 7f636f59e700 1 -- start start 2023-11-30T23:12:48.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636f59e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f637006aee0 0x7f637013cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:48.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636f59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63700aef60 0x7f637014d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636f59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63700b2750 con 0x7f63700b1470 2023-11-30T23:12:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636f59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63700af7c0 con 0x7f63700aef60 2023-11-30T23:12:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636f59e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63700b1a90 con 0x7f637006aee0 2023-11-30T23:12:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636dd9b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f63700b1470 0x7f63700ae850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37032/0 (socket says 172.21.15.73:37032) 2023-11-30T23:12:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636dd9b700 1 -- 172.21.15.73:0/1299284603 learned_addr learned my addr 172.21.15.73:0/1299284603 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636ed9d700 1 --2- 172.21.15.73:0/1299284603 >> v2:172.21.15.73:3300/0 conn(0x7f63700aef60 0x7f637014d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636e59c700 1 --2- 172.21.15.73:0/1299284603 >> v2:172.21.15.156:3300/0 conn(0x7f637006aee0 0x7f637013cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636d59a700 1 -- 172.21.15.73:0/1299284603 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192836389 0 0) 0x7f63700b2750 con 0x7f63700b1470 2023-11-30T23:12:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636d59a700 1 -- 172.21.15.73:0/1299284603 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63580035d0 con 0x7f63700b1470 2023-11-30T23:12:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636ed9d700 1 -- 172.21.15.73:0/1299284603 >> v2:172.21.15.156:3300/0 conn(0x7f637006aee0 msgr2=0x7f637013cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636ed9d700 1 --2- 172.21.15.73:0/1299284603 >> v2:172.21.15.156:3300/0 conn(0x7f637006aee0 0x7f637013cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636ed9d700 1 -- 172.21.15.73:0/1299284603 >> v1:172.21.15.73:6789/0 conn(0x7f63700b1470 legacy=0x7f63700ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636ed9d700 1 -- 172.21.15.73:0/1299284603 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63700afd40 con 0x7f63700aef60 2023-11-30T23:12:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636ed9d700 1 --2- 172.21.15.73:0/1299284603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63700aef60 0x7f637014d3f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6370065f70 tx=0x7f636800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa68bd9efb52fff4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636d59a700 1 -- 172.21.15.73:0/1299284603 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636800e070 con 0x7f63700aef60 2023-11-30T23:12:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636d59a700 1 -- 172.21.15.73:0/1299284603 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636800bb20 con 0x7f63700aef60 2023-11-30T23:12:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636d59a700 1 -- 172.21.15.73:0/1299284603 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6368012430 con 0x7f63700aef60 2023-11-30T23:12:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636f59e700 1 -- 172.21.15.73:0/1299284603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63700aef60 msgr2=0x7f637014d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636f59e700 1 --2- 172.21.15.73:0/1299284603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63700aef60 0x7f637014d3f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6370065f70 tx=0x7f636800b330 comp rx=0 tx=0).stop 2023-11-30T23:12:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636f59e700 1 -- 172.21.15.73:0/1299284603 shutdown_connections 2023-11-30T23:12:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636f59e700 1 --2- 172.21.15.73:0/1299284603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63700aef60 0x7f637014d3f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636f59e700 1 --2- 172.21.15.73:0/1299284603 >> v2:172.21.15.156:3300/0 conn(0x7f637006aee0 0x7f637013cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636f59e700 1 -- 172.21.15.73:0/1299284603 >> 172.21.15.73:0/1299284603 conn(0x7f637006a180 msgr2=0x7f637006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636f59e700 1 -- 172.21.15.73:0/1299284603 shutdown_connections 2023-11-30T23:12:48.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.259+0000 7f636f59e700 1 -- 172.21.15.73:0/1299284603 wait complete. 2023-11-30T23:12:48.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636f59e700 1 Processor -- start 2023-11-30T23:12:48.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636f59e700 1 -- start start 2023-11-30T23:12:48.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636f59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637006aee0 0x7f63701cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:48.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636f59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63700aef60 0x7f637013a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:48.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636f59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63700b1470 0x7f6370140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:48.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636f59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6370145680 con 0x7f637006aee0 2023-11-30T23:12:48.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636f59e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6370142c30 con 0x7f63700aef60 2023-11-30T23:12:48.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636f59e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6370143330 con 0x7f63700b1470 2023-11-30T23:12:48.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637006aee0 0x7f63701cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:48.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637006aee0 0x7f63701cd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33902/0 (socket says 172.21.15.73:33902) 2023-11-30T23:12:48.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636e59c700 1 -- 172.21.15.73:0/3209170206 learned_addr learned my addr 172.21.15.73:0/3209170206 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:48.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636dd9b700 1 --2- 172.21.15.73:0/3209170206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63700aef60 0x7f637013a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:48.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636ed9d700 1 --2- 172.21.15.73:0/3209170206 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63700b1470 0x7f6370140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:48.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636e59c700 1 -- 172.21.15.73:0/3209170206 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63700b1470 msgr2=0x7f6370140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:48.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636e59c700 1 --2- 172.21.15.73:0/3209170206 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63700b1470 0x7f6370140ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:48.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636e59c700 1 -- 172.21.15.73:0/3209170206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63700aef60 msgr2=0x7f637013a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:48.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636e59c700 1 --2- 172.21.15.73:0/3209170206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63700aef60 0x7f637013a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:48.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636e59c700 1 -- 172.21.15.73:0/3209170206 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6368009a70 con 0x7f637006aee0 2023-11-30T23:12:48.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636e59c700 1 --2- 172.21.15.73:0/3209170206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637006aee0 0x7f63701cd250 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f636000d930 tx=0x7f636000dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:48.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f635effd700 1 -- 172.21.15.73:0/3209170206 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6360011870 con 0x7f637006aee0 2023-11-30T23:12:48.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f635effd700 1 -- 172.21.15.73:0/3209170206 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63600119d0 con 0x7f637006aee0 2023-11-30T23:12:48.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636f59e700 1 -- 172.21.15.73:0/3209170206 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6370143610 con 0x7f637006aee0 2023-11-30T23:12:48.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f635effd700 1 -- 172.21.15.73:0/3209170206 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6360011d60 con 0x7f637006aee0 2023-11-30T23:12:48.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.263+0000 7f636f59e700 1 -- 172.21.15.73:0/3209170206 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63701cda30 con 0x7f637006aee0 2023-11-30T23:12:48.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.267+0000 7f636f59e700 1 -- 172.21.15.73:0/3209170206 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63701457c0 con 0x7f637006aee0 2023-11-30T23:12:48.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.267+0000 7f635effd700 1 -- 172.21.15.73:0/3209170206 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f636000f400 con 0x7f637006aee0 2023-11-30T23:12:48.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.267+0000 7f635effd700 1 --2- 172.21.15.73:0/3209170206 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6350065ad0 0x7f6350067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:48.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.267+0000 7f635effd700 1 -- 172.21.15.73:0/3209170206 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6360083000 con 0x7f637006aee0 2023-11-30T23:12:48.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.267+0000 7f636dd9b700 1 --2- 172.21.15.73:0/3209170206 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6350065ad0 0x7f6350067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:48.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.267+0000 7f636dd9b700 1 --2- 172.21.15.73:0/3209170206 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6350065ad0 0x7f6350067f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f637013c690 tx=0x7f6364009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:48.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.275+0000 7f635effd700 1 -- 172.21.15.73:0/3209170206 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f63701457c0 con 0x7f637006aee0 2023-11-30T23:12:48.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:48.475+0000 7f636f59e700 1 -- 172.21.15.73:0/3209170206 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f63701457c0 con 0x7f637006aee0 2023-11-30T23:12:49.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.123+0000 7f635effd700 1 -- 172.21.15.73:0/3209170206 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f63701457c0 con 0x7f637006aee0 2023-11-30T23:12:49.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.131+0000 7f636f59e700 1 -- 172.21.15.73:0/3209170206 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6350065ad0 msgr2=0x7f6350067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:49.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.131+0000 7f636f59e700 1 --2- 172.21.15.73:0/3209170206 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6350065ad0 0x7f6350067f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f637013c690 tx=0x7f6364009040 comp rx=0 tx=0).stop 2023-11-30T23:12:49.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.131+0000 7f636f59e700 1 -- 172.21.15.73:0/3209170206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637006aee0 msgr2=0x7f63701cd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:49.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.131+0000 7f636f59e700 1 --2- 172.21.15.73:0/3209170206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637006aee0 0x7f63701cd250 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f636000d930 tx=0x7f636000dc40 comp rx=0 tx=0).stop 2023-11-30T23:12:49.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.131+0000 7f636f59e700 1 -- 172.21.15.73:0/3209170206 shutdown_connections 2023-11-30T23:12:49.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.131+0000 7f636f59e700 1 --2- 172.21.15.73:0/3209170206 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f63700b1470 0x7f6370140ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:49.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.131+0000 7f636f59e700 1 --2- 172.21.15.73:0/3209170206 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6350065ad0 0x7f6350067f90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:49.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.131+0000 7f636f59e700 1 --2- 172.21.15.73:0/3209170206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63700aef60 0x7f637013a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:49.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.131+0000 7f636f59e700 1 --2- 172.21.15.73:0/3209170206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637006aee0 0x7f63701cd250 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:49.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.131+0000 7f636f59e700 1 -- 172.21.15.73:0/3209170206 >> 172.21.15.73:0/3209170206 conn(0x7f637006a180 msgr2=0x7f6370066490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:49.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.131+0000 7f636f59e700 1 -- 172.21.15.73:0/3209170206 shutdown_connections 2023-11-30T23:12:49.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.131+0000 7f636f59e700 1 -- 172.21.15.73:0/3209170206 wait complete. 2023-11-30T23:12:49.151 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-30T23:12:49.151 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-30T23:12:49.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.271+0000 7ff856e09700 1 Processor -- start 2023-11-30T23:12:49.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.271+0000 7ff856e09700 1 -- start start 2023-11-30T23:12:49.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.271+0000 7ff856e09700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff8500b7de0 0x7ff850146960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:49.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.271+0000 7ff856e09700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff85014bc80 0x7ff85014e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:49.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.271+0000 7ff856e09700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85006f390 con 0x7ff8500afba0 2023-11-30T23:12:49.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.271+0000 7ff856e09700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff850070e40 con 0x7ff8500b7de0 2023-11-30T23:12:49.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.271+0000 7ff856e09700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8500b81c0 con 0x7ff85014bc80 2023-11-30T23:12:49.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.271+0000 7ff855e07700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff8500b7de0 0x7ff850146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:49.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.271+0000 7ff855e07700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff8500b7de0 0x7ff850146960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33912/0 (socket says 172.21.15.73:33912) 2023-11-30T23:12:49.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.271+0000 7ff855e07700 1 -- 172.21.15.73:0/2006165747 learned_addr learned my addr 172.21.15.73:0/2006165747 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:49.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.271+0000 7ff856608700 1 --2- 172.21.15.73:0/2006165747 >> v2:172.21.15.156:3300/0 conn(0x7ff85014bc80 0x7ff85014e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:49.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.275+0000 7ff855e07700 1 -- 172.21.15.73:0/2006165747 >> v2:172.21.15.156:3300/0 conn(0x7ff85014bc80 msgr2=0x7ff85014e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:49.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.275+0000 7ff855e07700 1 --2- 172.21.15.73:0/2006165747 >> v2:172.21.15.156:3300/0 conn(0x7ff85014bc80 0x7ff85014e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:49.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.275+0000 7ff855e07700 1 -- 172.21.15.73:0/2006165747 >> v1:172.21.15.156:6789/0 conn(0x7ff8500afba0 legacy=0x7ff85013d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:49.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.275+0000 7ff855e07700 1 -- 172.21.15.73:0/2006165747 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff850071aa0 con 0x7ff8500b7de0 2023-11-30T23:12:49.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.275+0000 7ff855e07700 1 --2- 172.21.15.73:0/2006165747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8500b7de0 0x7ff850146960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff850144500 tx=0x7ff840009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ceb6e5695a11fa server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:49.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.275+0000 7ff854e05700 1 -- 172.21.15.73:0/2006165747 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff840011830 con 0x7ff8500b7de0 2023-11-30T23:12:49.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.275+0000 7ff854e05700 1 -- 172.21.15.73:0/2006165747 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff840011990 con 0x7ff8500b7de0 2023-11-30T23:12:49.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.275+0000 7ff854e05700 1 -- 172.21.15.73:0/2006165747 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff840011d20 con 0x7ff8500b7de0 2023-11-30T23:12:49.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.275+0000 7ff856e09700 1 -- 172.21.15.73:0/2006165747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8500b7de0 msgr2=0x7ff850146960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:49.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.275+0000 7ff856e09700 1 --2- 172.21.15.73:0/2006165747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8500b7de0 0x7ff850146960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff850144500 tx=0x7ff840009bf0 comp rx=0 tx=0).stop 2023-11-30T23:12:49.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.275+0000 7ff856e09700 1 -- 172.21.15.73:0/2006165747 shutdown_connections 2023-11-30T23:12:49.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.275+0000 7ff856e09700 1 --2- 172.21.15.73:0/2006165747 >> v2:172.21.15.156:3300/0 conn(0x7ff85014bc80 0x7ff85014e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:49.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.275+0000 7ff856e09700 1 --2- 172.21.15.73:0/2006165747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8500b7de0 0x7ff850146960 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:49.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.275+0000 7ff856e09700 1 -- 172.21.15.73:0/2006165747 >> 172.21.15.73:0/2006165747 conn(0x7ff8500b8c60 msgr2=0x7ff8500b9070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:49.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.275+0000 7ff856e09700 1 -- 172.21.15.73:0/2006165747 shutdown_connections 2023-11-30T23:12:49.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.275+0000 7ff856e09700 1 -- 172.21.15.73:0/2006165747 wait complete. 2023-11-30T23:12:49.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.275+0000 7ff856e09700 1 Processor -- start 2023-11-30T23:12:49.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff856e09700 1 -- start start 2023-11-30T23:12:49.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff856e09700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8500afba0 0x7ff8501330a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:49.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff856e09700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8500b7de0 0x7ff850142640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:49.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff856e09700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff85014bc80 0x7ff850134da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:49.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff856e09700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff850143020 con 0x7ff8500b7de0 2023-11-30T23:12:49.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff856e09700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff850142b80 con 0x7ff8500afba0 2023-11-30T23:12:49.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff856e09700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8501410f0 con 0x7ff85014bc80 2023-11-30T23:12:49.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff855606700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8500b7de0 0x7ff850142640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:49.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff855e07700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8500afba0 0x7ff8501330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:49.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff855606700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8500b7de0 0x7ff850142640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33924/0 (socket says 172.21.15.73:33924) 2023-11-30T23:12:49.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff855606700 1 -- 172.21.15.73:0/2897679699 learned_addr learned my addr 172.21.15.73:0/2897679699 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:49.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff856608700 1 --2- 172.21.15.73:0/2897679699 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff85014bc80 0x7ff850134da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:49.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff855606700 1 -- 172.21.15.73:0/2897679699 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff85014bc80 msgr2=0x7ff850134da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:49.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff855606700 1 --2- 172.21.15.73:0/2897679699 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff85014bc80 0x7ff850134da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:49.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff855606700 1 -- 172.21.15.73:0/2897679699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8500afba0 msgr2=0x7ff8501330a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:49.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff855606700 1 --2- 172.21.15.73:0/2897679699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8500afba0 0x7ff8501330a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:49.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff855606700 1 -- 172.21.15.73:0/2897679699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff840009570 con 0x7ff8500b7de0 2023-11-30T23:12:49.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff855606700 1 --2- 172.21.15.73:0/2897679699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8500b7de0 0x7ff850142640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00c4d0 tx=0x7ff84c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:49.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff8467fc700 1 -- 172.21.15.73:0/2897679699 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c0052d0 con 0x7ff8500b7de0 2023-11-30T23:12:49.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff8467fc700 1 -- 172.21.15.73:0/2897679699 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84c005430 con 0x7ff8500b7de0 2023-11-30T23:12:49.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff856e09700 1 -- 172.21.15.73:0/2897679699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8501413d0 con 0x7ff8500b7de0 2023-11-30T23:12:49.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff8467fc700 1 -- 172.21.15.73:0/2897679699 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c0055a0 con 0x7ff8500b7de0 2023-11-30T23:12:49.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.279+0000 7ff856e09700 1 -- 172.21.15.73:0/2897679699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff850141ae0 con 0x7ff8500b7de0 2023-11-30T23:12:49.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.283+0000 7ff856e09700 1 -- 172.21.15.73:0/2897679699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff850140f40 con 0x7ff8500b7de0 2023-11-30T23:12:49.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.283+0000 7ff8467fc700 1 -- 172.21.15.73:0/2897679699 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff84c0038c0 con 0x7ff8500b7de0 2023-11-30T23:12:49.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.283+0000 7ff8467fc700 1 --2- 172.21.15.73:0/2897679699 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff834065ad0 0x7ff834067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:49.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.283+0000 7ff8467fc700 1 -- 172.21.15.73:0/2897679699 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff84c0824e0 con 0x7ff8500b7de0 2023-11-30T23:12:49.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.283+0000 7ff855e07700 1 --2- 172.21.15.73:0/2897679699 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff834065ad0 0x7ff834067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:49.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.283+0000 7ff855e07700 1 --2- 172.21.15.73:0/2897679699 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff834065ad0 0x7ff834067f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff840000c00 tx=0x7ff840008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:49.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.291+0000 7ff8467fc700 1 -- 172.21.15.73:0/2897679699 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7ff84c04fe10 con 0x7ff8500b7de0 2023-11-30T23:12:49.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:49.495+0000 7ff856e09700 1 -- 172.21.15.73:0/2897679699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff8501415c0 con 0x7ff8500b7de0 2023-11-30T23:12:50.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.127+0000 7ff8467fc700 1 -- 172.21.15.73:0/2897679699 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff84c053430 con 0x7ff8500b7de0 2023-11-30T23:12:50.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.131+0000 7ff856e09700 1 -- 172.21.15.73:0/2897679699 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff834065ad0 msgr2=0x7ff834067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:50.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.131+0000 7ff856e09700 1 --2- 172.21.15.73:0/2897679699 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff834065ad0 0x7ff834067f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff840000c00 tx=0x7ff840008030 comp rx=0 tx=0).stop 2023-11-30T23:12:50.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.131+0000 7ff856e09700 1 -- 172.21.15.73:0/2897679699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8500b7de0 msgr2=0x7ff850142640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:50.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.131+0000 7ff856e09700 1 --2- 172.21.15.73:0/2897679699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8500b7de0 0x7ff850142640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00c4d0 tx=0x7ff84c00c7e0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.131+0000 7ff856e09700 1 -- 172.21.15.73:0/2897679699 shutdown_connections 2023-11-30T23:12:50.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.131+0000 7ff856e09700 1 --2- 172.21.15.73:0/2897679699 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff85014bc80 0x7ff850134da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.131+0000 7ff856e09700 1 --2- 172.21.15.73:0/2897679699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8500b7de0 0x7ff850142640 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.131+0000 7ff856e09700 1 --2- 172.21.15.73:0/2897679699 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff834065ad0 0x7ff834067f90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.131+0000 7ff856e09700 1 --2- 172.21.15.73:0/2897679699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8500afba0 0x7ff8501330a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.131+0000 7ff856e09700 1 -- 172.21.15.73:0/2897679699 >> 172.21.15.73:0/2897679699 conn(0x7ff8500b8c60 msgr2=0x7ff850133b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:50.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.135+0000 7ff856e09700 1 -- 172.21.15.73:0/2897679699 shutdown_connections 2023-11-30T23:12:50.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.135+0000 7ff856e09700 1 -- 172.21.15.73:0/2897679699 wait complete. 2023-11-30T23:12:50.154 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-30T23:12:50.154 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T23:12:50.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.271+0000 7fd5253d0700 1 Processor -- start 2023-11-30T23:12:50.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.271+0000 7fd5253d0700 1 -- start start 2023-11-30T23:12:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd5253d0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd5200b1420 0x7fd520147970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd5253d0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd52013e920 0x7fd52014eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd5253d0700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52006ee70 con 0x7fd520147eb0 2023-11-30T23:12:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd5253d0700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5200b40c0 con 0x7fd52013e920 2023-11-30T23:12:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd5253d0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd520070050 con 0x7fd5200b1420 2023-11-30T23:12:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd51ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd5200b1420 0x7fd520147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd524bcf700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd52013e920 0x7fd52014eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd51ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd5200b1420 0x7fd520147970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:49876/0 (socket says 172.21.15.73:49876) 2023-11-30T23:12:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd51ffff700 1 -- 172.21.15.73:0/3630982262 learned_addr learned my addr 172.21.15.73:0/3630982262 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd51ffff700 1 -- 172.21.15.73:0/3630982262 >> v2:172.21.15.73:3300/0 conn(0x7fd52013e920 msgr2=0x7fd52014eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd51ffff700 1 --2- 172.21.15.73:0/3630982262 >> v2:172.21.15.73:3300/0 conn(0x7fd52013e920 0x7fd52014eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd51ffff700 1 -- 172.21.15.73:0/3630982262 >> v1:172.21.15.156:6789/0 conn(0x7fd520147eb0 legacy=0x7fd52013e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd51ffff700 1 -- 172.21.15.73:0/3630982262 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52006f300 con 0x7fd5200b1420 2023-11-30T23:12:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd524bcf700 1 --2- 172.21.15.73:0/3630982262 >> v2:172.21.15.73:3300/0 conn(0x7fd52013e920 0x7fd52014eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd51ffff700 1 --2- 172.21.15.73:0/3630982262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5200b1420 0x7fd520147970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd5200b5540 tx=0x7fd508009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d141f8d0bf68468d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd51effd700 1 -- 172.21.15.73:0/3630982262 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd508011830 con 0x7fd5200b1420 2023-11-30T23:12:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd51effd700 1 -- 172.21.15.73:0/3630982262 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd508011990 con 0x7fd5200b1420 2023-11-30T23:12:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd51effd700 1 -- 172.21.15.73:0/3630982262 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd508011d20 con 0x7fd5200b1420 2023-11-30T23:12:50.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd5253d0700 1 -- 172.21.15.73:0/3630982262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5200b1420 msgr2=0x7fd520147970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:50.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd5253d0700 1 --2- 172.21.15.73:0/3630982262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5200b1420 0x7fd520147970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd5200b5540 tx=0x7fd508009bf0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd5253d0700 1 -- 172.21.15.73:0/3630982262 shutdown_connections 2023-11-30T23:12:50.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd5253d0700 1 --2- 172.21.15.73:0/3630982262 >> v2:172.21.15.73:3300/0 conn(0x7fd52013e920 0x7fd52014eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd5253d0700 1 --2- 172.21.15.73:0/3630982262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5200b1420 0x7fd520147970 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd5253d0700 1 -- 172.21.15.73:0/3630982262 >> 172.21.15.73:0/3630982262 conn(0x7fd5200b45a0 msgr2=0x7fd5200b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:50.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd5253d0700 1 -- 172.21.15.73:0/3630982262 shutdown_connections 2023-11-30T23:12:50.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd5253d0700 1 -- 172.21.15.73:0/3630982262 wait complete. 2023-11-30T23:12:50.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.275+0000 7fd5253d0700 1 Processor -- start 2023-11-30T23:12:50.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd5253d0700 1 -- start start 2023-11-30T23:12:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd5253d0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5200b1420 0x7fd520142270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd5253d0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd52013e920 0x7fd5200720e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd5253d0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd520147eb0 0x7fd5201dcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd5253d0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5201445b0 con 0x7fd52013e920 2023-11-30T23:12:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd5253d0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5201374f0 con 0x7fd520147eb0 2023-11-30T23:12:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd5253d0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd520144240 con 0x7fd5200b1420 2023-11-30T23:12:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd51f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd52013e920 0x7fd5200720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd524bcf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd520147eb0 0x7fd5201dcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd51f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd52013e920 0x7fd5200720e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33944/0 (socket says 172.21.15.73:33944) 2023-11-30T23:12:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd51ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5200b1420 0x7fd520142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd51f7fe700 1 -- 172.21.15.73:0/1446809769 learned_addr learned my addr 172.21.15.73:0/1446809769 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd51f7fe700 1 -- 172.21.15.73:0/1446809769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5200b1420 msgr2=0x7fd520142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd51f7fe700 1 --2- 172.21.15.73:0/1446809769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5200b1420 0x7fd520142270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd51f7fe700 1 -- 172.21.15.73:0/1446809769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd520147eb0 msgr2=0x7fd5201dcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd51f7fe700 1 --2- 172.21.15.73:0/1446809769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd520147eb0 0x7fd5201dcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd51f7fe700 1 -- 172.21.15.73:0/1446809769 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5180094b0 con 0x7fd52013e920 2023-11-30T23:12:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd51f7fe700 1 --2- 172.21.15.73:0/1446809769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd52013e920 0x7fd5200720e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd51000cbd0 tx=0x7fd51000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:50.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd51cff9700 1 -- 172.21.15.73:0/1446809769 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510003c20 con 0x7fd52013e920 2023-11-30T23:12:50.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd5253d0700 1 -- 172.21.15.73:0/1446809769 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd508009570 con 0x7fd52013e920 2023-11-30T23:12:50.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd51cff9700 1 -- 172.21.15.73:0/1446809769 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd510003d80 con 0x7fd52013e920 2023-11-30T23:12:50.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd51cff9700 1 -- 172.21.15.73:0/1446809769 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51000aae0 con 0x7fd52013e920 2023-11-30T23:12:50.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd5253d0700 1 -- 172.21.15.73:0/1446809769 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd520070850 con 0x7fd52013e920 2023-11-30T23:12:50.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.279+0000 7fd5253d0700 1 -- 172.21.15.73:0/1446809769 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52006f580 con 0x7fd52013e920 2023-11-30T23:12:50.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.283+0000 7fd51cff9700 1 -- 172.21.15.73:0/1446809769 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd51000ac40 con 0x7fd52013e920 2023-11-30T23:12:50.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.283+0000 7fd51cff9700 1 --2- 172.21.15.73:0/1446809769 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd500065ad0 0x7fd500067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.283+0000 7fd51cff9700 1 -- 172.21.15.73:0/1446809769 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd510083110 con 0x7fd52013e920 2023-11-30T23:12:50.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.283+0000 7fd51ffff700 1 --2- 172.21.15.73:0/1446809769 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd500065ad0 0x7fd500067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.283+0000 7fd51ffff700 1 --2- 172.21.15.73:0/1446809769 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd500065ad0 0x7fd500067f90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd508000c00 tx=0x7fd508008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:50.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.287+0000 7fd51cff9700 1 -- 172.21.15.73:0/1446809769 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fd510050ae0 con 0x7fd52013e920 2023-11-30T23:12:50.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.487+0000 7fd5253d0700 1 -- 172.21.15.73:0/1446809769 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd52004ed80 con 0x7fd52013e920 2023-11-30T23:12:50.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.487+0000 7fd51cff9700 1 -- 172.21.15.73:0/1446809769 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3133 (secure 0 0 0) 0x7fd510054100 con 0x7fd52013e920 2023-11-30T23:12:50.491 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:50.491 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3213239947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3213239947},{"type":"v1","addr":"172.21.15.73:6835","nonce":3213239947}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T23:12:47.481180+0000","modified":"2023-11-30T23:12:50.126014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6833/1140380051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":1140380051},{"type":"v1","addr":"172.21.15.156:6833","nonce":1140380051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-30T23:12:50.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.487+0000 7fd5253d0700 1 -- 172.21.15.73:0/1446809769 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd500065ad0 msgr2=0x7fd500067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:50.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.487+0000 7fd5253d0700 1 --2- 172.21.15.73:0/1446809769 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd500065ad0 0x7fd500067f90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd508000c00 tx=0x7fd508008030 comp rx=0 tx=0).stop 2023-11-30T23:12:50.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.487+0000 7fd5253d0700 1 -- 172.21.15.73:0/1446809769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd52013e920 msgr2=0x7fd5200720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:50.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.487+0000 7fd5253d0700 1 --2- 172.21.15.73:0/1446809769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd52013e920 0x7fd5200720e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd51000cbd0 tx=0x7fd51000cee0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.487+0000 7fd5253d0700 1 -- 172.21.15.73:0/1446809769 shutdown_connections 2023-11-30T23:12:50.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.487+0000 7fd5253d0700 1 --2- 172.21.15.73:0/1446809769 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd500065ad0 0x7fd500067f90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.487+0000 7fd5253d0700 1 --2- 172.21.15.73:0/1446809769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd520147eb0 0x7fd5201dcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.487+0000 7fd5253d0700 1 --2- 172.21.15.73:0/1446809769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd52013e920 0x7fd5200720e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.487+0000 7fd5253d0700 1 --2- 172.21.15.73:0/1446809769 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd5200b1420 0x7fd520142270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.487+0000 7fd5253d0700 1 -- 172.21.15.73:0/1446809769 >> 172.21.15.73:0/1446809769 conn(0x7fd5200b45a0 msgr2=0x7fd52013bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:50.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.487+0000 7fd5253d0700 1 -- 172.21.15.73:0/1446809769 shutdown_connections 2023-11-30T23:12:50.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.487+0000 7fd5253d0700 1 -- 172.21.15.73:0/1446809769 wait complete. 2023-11-30T23:12:50.494 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 7 2023-11-30T23:12:50.505 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T23:12:50.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01bd647700 1 Processor -- start 2023-11-30T23:12:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01bd647700 1 -- start start 2023-11-30T23:12:50.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01bd647700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f01b80b3840 0x7f01b80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01bd647700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f01b813e270 0x7f01b813e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01bd647700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01b81444d0 0x7f01b8144920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01bd647700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b80b0d90 con 0x7f01b813e270 2023-11-30T23:12:50.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01bd647700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b8071460 con 0x7f01b80b3840 2023-11-30T23:12:50.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01bd647700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b80b3c20 con 0x7f01b81444d0 2023-11-30T23:12:50.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01b77fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f01b813e270 0x7f01b813e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01b77fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f01b813e270 0x7f01b813e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33960/0 (socket says 172.21.15.73:33960) 2023-11-30T23:12:50.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01b77fe700 1 -- 172.21.15.73:0/3847090622 learned_addr learned my addr 172.21.15.73:0/3847090622 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:50.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01bce46700 1 --2- 172.21.15.73:0/3847090622 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01b81444d0 0x7f01b8144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01b7fff700 1 --2- 172.21.15.73:0/3847090622 >> v2:172.21.15.156:3300/0 conn(0x7f01b80b3840 0x7f01b80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01b77fe700 1 -- 172.21.15.73:0/3847090622 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01b81444d0 msgr2=0x7f01b8144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:50.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01b77fe700 1 --2- 172.21.15.73:0/3847090622 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01b81444d0 0x7f01b8144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01b77fe700 1 -- 172.21.15.73:0/3847090622 >> v2:172.21.15.156:3300/0 conn(0x7f01b80b3840 msgr2=0x7f01b80b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:50.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01b77fe700 1 --2- 172.21.15.73:0/3847090622 >> v2:172.21.15.156:3300/0 conn(0x7f01b80b3840 0x7f01b80b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01b77fe700 1 -- 172.21.15.73:0/3847090622 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b806d030 con 0x7f01b813e270 2023-11-30T23:12:50.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01b77fe700 1 --2- 172.21.15.73:0/3847090622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01b813e270 0x7f01b813e6c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f01b8073c20 tx=0x7f01a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce99d77871d6301 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:50.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01b6ffd700 1 -- 172.21.15.73:0/3847090622 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a800e070 con 0x7f01b813e270 2023-11-30T23:12:50.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01b6ffd700 1 -- 172.21.15.73:0/3847090622 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a800b910 con 0x7f01b813e270 2023-11-30T23:12:50.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.611+0000 7f01b6ffd700 1 -- 172.21.15.73:0/3847090622 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a800bcc0 con 0x7f01b813e270 2023-11-30T23:12:50.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.615+0000 7f01bd647700 1 -- 172.21.15.73:0/3847090622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01b813e270 msgr2=0x7f01b813e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:50.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.615+0000 7f01bd647700 1 --2- 172.21.15.73:0/3847090622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01b813e270 0x7f01b813e6c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f01b8073c20 tx=0x7f01a800b330 comp rx=0 tx=0).stop 2023-11-30T23:12:50.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.615+0000 7f01bd647700 1 -- 172.21.15.73:0/3847090622 shutdown_connections 2023-11-30T23:12:50.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.615+0000 7f01bd647700 1 --2- 172.21.15.73:0/3847090622 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01b81444d0 0x7f01b8144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.615+0000 7f01bd647700 1 --2- 172.21.15.73:0/3847090622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01b813e270 0x7f01b813e6c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.615+0000 7f01bd647700 1 --2- 172.21.15.73:0/3847090622 >> v2:172.21.15.156:3300/0 conn(0x7f01b80b3840 0x7f01b80b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.615+0000 7f01bd647700 1 -- 172.21.15.73:0/3847090622 >> 172.21.15.73:0/3847090622 conn(0x7f01b806b290 msgr2=0x7f01b806b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:50.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.615+0000 7f01bd647700 1 -- 172.21.15.73:0/3847090622 shutdown_connections 2023-11-30T23:12:50.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.615+0000 7f01bd647700 1 -- 172.21.15.73:0/3847090622 wait complete. 2023-11-30T23:12:50.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.615+0000 7f01bd647700 1 Processor -- start 2023-11-30T23:12:50.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.615+0000 7f01bd647700 1 -- start start 2023-11-30T23:12:50.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.615+0000 7f01bd647700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01b80b3840 0x7f01b8139430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.615+0000 7f01bd647700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01b813e270 0x7f01b80b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.615+0000 7f01bd647700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01b81444d0 0x7f01b80b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.615+0000 7f01bd647700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b8139d70 con 0x7f01b80b3840 2023-11-30T23:12:50.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.615+0000 7f01bd647700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b813a830 con 0x7f01b813e270 2023-11-30T23:12:50.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.615+0000 7f01bd647700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b8145a20 con 0x7f01b81444d0 2023-11-30T23:12:50.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.615+0000 7f01b7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01b80b3840 0x7f01b8139430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.619+0000 7f01b7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01b80b3840 0x7f01b8139430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33976/0 (socket says 172.21.15.73:33976) 2023-11-30T23:12:50.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.619+0000 7f01b7fff700 1 -- 172.21.15.73:0/3566033024 learned_addr learned my addr 172.21.15.73:0/3566033024 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:50.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.619+0000 7f01b77fe700 1 --2- 172.21.15.73:0/3566033024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01b813e270 0x7f01b80b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.619+0000 7f01bce46700 1 --2- 172.21.15.73:0/3566033024 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01b81444d0 0x7f01b80b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.619+0000 7f01b77fe700 1 -- 172.21.15.73:0/3566033024 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01b81444d0 msgr2=0x7f01b80b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:50.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.619+0000 7f01b77fe700 1 --2- 172.21.15.73:0/3566033024 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01b81444d0 0x7f01b80b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.619+0000 7f01b77fe700 1 -- 172.21.15.73:0/3566033024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01b80b3840 msgr2=0x7f01b8139430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:50.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.619+0000 7f01b77fe700 1 --2- 172.21.15.73:0/3566033024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01b80b3840 0x7f01b8139430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.619+0000 7f01b77fe700 1 -- 172.21.15.73:0/3566033024 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a8009b30 con 0x7f01b813e270 2023-11-30T23:12:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.619+0000 7f01b7fff700 1 --2- 172.21.15.73:0/3566033024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01b80b3840 0x7f01b8139430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.619+0000 7f01b77fe700 1 --2- 172.21.15.73:0/3566033024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01b813e270 0x7f01b80b1960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f01a8015000 tx=0x7f01a8004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.619+0000 7f01b4ff9700 1 -- 172.21.15.73:0/3566033024 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a80099b0 con 0x7f01b813e270 2023-11-30T23:12:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.619+0000 7f01b4ff9700 1 -- 172.21.15.73:0/3566033024 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a800ce80 con 0x7f01b813e270 2023-11-30T23:12:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.619+0000 7f01b4ff9700 1 -- 172.21.15.73:0/3566033024 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a8004490 con 0x7f01b813e270 2023-11-30T23:12:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.619+0000 7f01bd647700 1 -- 172.21.15.73:0/3566033024 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b8137f60 con 0x7f01b813e270 2023-11-30T23:12:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.619+0000 7f01bd647700 1 -- 172.21.15.73:0/3566033024 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b80b2c20 con 0x7f01b813e270 2023-11-30T23:12:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.619+0000 7f01bd647700 1 -- 172.21.15.73:0/3566033024 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b80b2e10 con 0x7f01b813e270 2023-11-30T23:12:50.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.623+0000 7f01b4ff9700 1 -- 172.21.15.73:0/3566033024 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f01a80045f0 con 0x7f01b813e270 2023-11-30T23:12:50.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.623+0000 7f01b4ff9700 1 --2- 172.21.15.73:0/3566033024 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0198065b00 0x7f0198067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.623+0000 7f01b4ff9700 1 -- 172.21.15.73:0/3566033024 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01a8084730 con 0x7f01b813e270 2023-11-30T23:12:50.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.623+0000 7f01b7fff700 1 --2- 172.21.15.73:0/3566033024 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0198065b00 0x7f0198067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.623+0000 7f01b7fff700 1 --2- 172.21.15.73:0/3566033024 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0198065b00 0x7f0198067fc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f01a00113d0 tx=0x7f01a0009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:50.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.631+0000 7f01b4ff9700 1 -- 172.21.15.73:0/3566033024 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f01a8052370 con 0x7f01b813e270 2023-11-30T23:12:50.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.799+0000 7f01bd647700 1 -- 172.21.15.73:0/3566033024 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01b8139b50 con 0x7f01b813e270 2023-11-30T23:12:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.799+0000 7f01b4ff9700 1 -- 172.21.15.73:0/3566033024 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f01a80048a0 con 0x7f01b813e270 2023-11-30T23:12:50.805 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:50.806 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"a677cb6a-4a54-4567-a30d-f0fa4bc22b17","created":"2023-11-30T23:12:23.260968+0000","modified":"2023-11-30T23:12:48.484283+0000","last_up_change":"2023-11-30T23:12:33.649318+0000","last_in_change":"2023-11-30T23:12:25.326689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-30T23:12:34.413317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-30T23:12:45.403156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-30T23:12:46.475384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbf1c93f-0775-4780-8524-cf25792d9aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36686},{"type":"v1","addr":"172.21.15.73:6817","nonce":36686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36686},{"type":"v1","addr":"172.21.15.73:6819","nonce":36686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36686},{"type":"v1","addr":"172.21.15.73:6823","nonce":36686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36686},{"type":"v1","addr":"172.21.15.73:6821","nonce":36686}]},"public_addr":"172.21.15.73:6817/36686","cluster_addr":"172.21.15.73:6819/36686","heartbeat_back_addr":"172.21.15.73:6823/36686","heartbeat_front_addr":"172.21.15.73:6821/36686","state":["exists","up"]},{"osd":1,"uuid":"9d9dd122-9a42-4588-a0d2-50d13b13eba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36687},{"type":"v1","addr":"172.21.15.73:6809","nonce":36687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":36687},{"type":"v1","addr":"172.21.15.73:6811","nonce":36687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36687},{"type":"v1","addr":"172.21.15.73:6815","nonce":36687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36687},{"type":"v1","addr":"172.21.15.73:6813","nonce":36687}]},"public_addr":"172.21.15.73:6809/36687","cluster_addr":"172.21.15.73:6811/36687","heartbeat_back_addr":"172.21.15.73:6815/36687","heartbeat_front_addr":"172.21.15.73:6813/36687","state":["exists","up"]},{"osd":2,"uuid":"68ff4f1e-ec45-42e0-bb83-fe03598e4940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36688},{"type":"v1","addr":"172.21.15.73:6825","nonce":36688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36688},{"type":"v1","addr":"172.21.15.73:6827","nonce":36688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36688},{"type":"v1","addr":"172.21.15.73:6831","nonce":36688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36688},{"type":"v1","addr":"172.21.15.73:6829","nonce":36688}]},"public_addr":"172.21.15.73:6825/36688","cluster_addr":"172.21.15.73:6827/36688","heartbeat_back_addr":"172.21.15.73:6831/36688","heartbeat_front_addr":"172.21.15.73:6829/36688","state":["exists","up"]},{"osd":3,"uuid":"e4b08c98-6a4d-4ec8-a245-59a35f70a16f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36685},{"type":"v1","addr":"172.21.15.73:6801","nonce":36685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36685},{"type":"v1","addr":"172.21.15.73:6803","nonce":36685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":36685},{"type":"v1","addr":"172.21.15.73:6807","nonce":36685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36685},{"type":"v1","addr":"172.21.15.73:6805","nonce":36685}]},"public_addr":"172.21.15.73:6801/36685","cluster_addr":"172.21.15.73:6803/36685","heartbeat_back_addr":"172.21.15.73:6807/36685","heartbeat_front_addr":"172.21.15.73:6805/36685","state":["exists","up"]},{"osd":4,"uuid":"d0922b0e-5170-474d-b270-ddb5adc858cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":36908},{"type":"v1","addr":"172.21.15.156:6801","nonce":36908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":36908},{"type":"v1","addr":"172.21.15.156:6803","nonce":36908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":36908},{"type":"v1","addr":"172.21.15.156:6807","nonce":36908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":36908},{"type":"v1","addr":"172.21.15.156:6805","nonce":36908}]},"public_addr":"172.21.15.156:6801/36908","cluster_addr":"172.21.15.156:6803/36908","heartbeat_back_addr":"172.21.15.156:6807/36908","heartbeat_front_addr":"172.21.15.156:6805/36908","state":["exists","up"]},{"osd":5,"uuid":"f2791a77-db25-479c-95d5-ea7f77458685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":36909},{"type":"v1","addr":"172.21.15.156:6809","nonce":36909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":36909},{"type":"v1","addr":"172.21.15.156:6811","nonce":36909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":36909},{"type":"v1","addr":"172.21.15.156:6815","nonce":36909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":36909},{"type":"v1","addr":"172.21.15.156:6813","nonce":36909}]},"public_addr":"172.21.15.156:6809/36909","cluster_addr":"172.21.15.156:6811/36909","heartbeat_back_addr":"172.21.15.156:6815/36909","heartbeat_front_addr":"172.21.15.156:6813/36909","state":["exists","up"]},{"osd":6,"uuid":"f86c2fe9-ec8b-406e-af26-5dc65c926382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":36910},{"type":"v1","addr":"172.21.15.156:6817","nonce":36910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":36910},{"type":"v1","addr":"172.21.15.156:6819","nonce":36910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":36910},{"type":"v1","addr":"172.21.15.156:6823","nonce":36910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":36910},{"type":"v1","addr":"172.21.15.156:6821","nonce":36910}]},"public_addr":"172.21.15.156:6817/36910","cluster_addr":"172.21.15.156:6819/36910","heartbeat_back_addr":"172.21.15.156:6823/36910","heartbeat_front_addr":"172.21.15.156:6821/36910","state":["exists","up"]},{"osd":7,"uuid":"56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":36911},{"type":"v1","addr":"172.21.15.156:6825","nonce":36911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":36911},{"type":"v1","addr":"172.21.15.156:6827","nonce":36911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":36911},{"type":"v1","addr":"172.21.15.156:6831","nonce":36911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":36911},{"type":"v1","addr":"172.21.15.156:6829","nonce":36911}]},"public_addr":"172.21.15.156:6825/36911","cluster_addr":"172.21.15.156:6827/36911","heartbeat_back_addr":"172.21.15.156:6831/36911","heartbeat_front_addr":"172.21.15.156:6829/36911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.597534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.505493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.811871+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.586741+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.366817+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.101605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.627496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.829046+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T23:12:50.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.807+0000 7f01bd647700 1 -- 172.21.15.73:0/3566033024 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0198065b00 msgr2=0x7f0198067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:50.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.807+0000 7f01bd647700 1 --2- 172.21.15.73:0/3566033024 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0198065b00 0x7f0198067fc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f01a00113d0 tx=0x7f01a0009240 comp rx=0 tx=0).stop 2023-11-30T23:12:50.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.807+0000 7f01bd647700 1 -- 172.21.15.73:0/3566033024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01b813e270 msgr2=0x7f01b80b1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.807+0000 7f01bd647700 1 --2- 172.21.15.73:0/3566033024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01b813e270 0x7f01b80b1960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f01a8015000 tx=0x7f01a8004af0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.807+0000 7f01bd647700 1 -- 172.21.15.73:0/3566033024 shutdown_connections 2023-11-30T23:12:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.807+0000 7f01bd647700 1 --2- 172.21.15.73:0/3566033024 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01b81444d0 0x7f01b80b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.807+0000 7f01bd647700 1 --2- 172.21.15.73:0/3566033024 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0198065b00 0x7f0198067fc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.807+0000 7f01bd647700 1 --2- 172.21.15.73:0/3566033024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01b813e270 0x7f01b80b1960 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.807+0000 7f01bd647700 1 --2- 172.21.15.73:0/3566033024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01b80b3840 0x7f01b8139430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.807+0000 7f01bd647700 1 -- 172.21.15.73:0/3566033024 >> 172.21.15.73:0/3566033024 conn(0x7f01b806b290 msgr2=0x7f01b8142cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.807+0000 7f01bd647700 1 -- 172.21.15.73:0/3566033024 shutdown_connections 2023-11-30T23:12:50.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.807+0000 7f01bd647700 1 -- 172.21.15.73:0/3566033024 wait complete. 2023-11-30T23:12:50.825 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-30T23:12:50.825 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T23:12:50.888 INFO:tasks.ceph.mds.b.smithi156.stderr:2023-11-30T23:12:50.885+0000 7fa7252d9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-30T23:12:50.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f0563fff700 1 Processor -- start 2023-11-30T23:12:50.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f0563fff700 1 -- start start 2023-11-30T23:12:50.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f0563fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f056413e210 0x7f056413e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f0563fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f056414cc90 0x7f056414f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f0563fff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056406ee70 con 0x7f05640b1420 2023-11-30T23:12:50.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f0563fff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05640b40c0 con 0x7f056414cc90 2023-11-30T23:12:50.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f0563fff700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0564070050 con 0x7f056413e210 2023-11-30T23:12:50.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f05637fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f056414cc90 0x7f056414f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f05637fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f056414cc90 0x7f056414f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33980/0 (socket says 172.21.15.73:33980) 2023-11-30T23:12:50.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f05637fe700 1 -- 172.21.15.73:0/162048478 learned_addr learned my addr 172.21.15.73:0/162048478 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:50.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f0562ffd700 1 --1- 172.21.15.73:0/162048478 >> v1:172.21.15.73:6789/0 conn(0x7f05640b1420 0x7f0564147970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37040/0 (socket says 172.21.15.73:37040) 2023-11-30T23:12:50.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f05627fc700 1 --2- 172.21.15.73:0/162048478 >> v2:172.21.15.156:3300/0 conn(0x7f056413e210 0x7f056413e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f05637fe700 1 -- 172.21.15.73:0/162048478 >> v2:172.21.15.156:3300/0 conn(0x7f056413e210 msgr2=0x7f056413e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:50.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f05637fe700 1 --2- 172.21.15.73:0/162048478 >> v2:172.21.15.156:3300/0 conn(0x7f056413e210 0x7f056413e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f05637fe700 1 -- 172.21.15.73:0/162048478 >> v1:172.21.15.73:6789/0 conn(0x7f05640b1420 legacy=0x7f0564147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:50.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f0561ffb700 1 -- 172.21.15.73:0/162048478 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938635797 0 0) 0x7f056406ee70 con 0x7f05640b1420 2023-11-30T23:12:50.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f05637fe700 1 -- 172.21.15.73:0/162048478 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056406f300 con 0x7f056414cc90 2023-11-30T23:12:50.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f05637fe700 1 --2- 172.21.15.73:0/162048478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f056414cc90 0x7f056414f080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f056406c790 tx=0x7f055c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05a43370a804b2a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:50.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f0561ffb700 1 -- 172.21.15.73:0/162048478 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c011830 con 0x7f056414cc90 2023-11-30T23:12:50.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f0561ffb700 1 -- 172.21.15.73:0/162048478 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c011990 con 0x7f056414cc90 2023-11-30T23:12:50.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.935+0000 7f0561ffb700 1 -- 172.21.15.73:0/162048478 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c011d20 con 0x7f056414cc90 2023-11-30T23:12:50.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f0563fff700 1 -- 172.21.15.73:0/162048478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f056414cc90 msgr2=0x7f056414f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:50.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f0563fff700 1 --2- 172.21.15.73:0/162048478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f056414cc90 0x7f056414f080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f056406c790 tx=0x7f055c009bf0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f0563fff700 1 -- 172.21.15.73:0/162048478 shutdown_connections 2023-11-30T23:12:50.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f0563fff700 1 --2- 172.21.15.73:0/162048478 >> v2:172.21.15.156:3300/0 conn(0x7f056413e210 0x7f056413e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f0563fff700 1 --2- 172.21.15.73:0/162048478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f056414cc90 0x7f056414f080 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f0563fff700 1 -- 172.21.15.73:0/162048478 >> 172.21.15.73:0/162048478 conn(0x7f05640b45a0 msgr2=0x7f05640b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:50.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f0563fff700 1 -- 172.21.15.73:0/162048478 shutdown_connections 2023-11-30T23:12:50.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f0563fff700 1 -- 172.21.15.73:0/162048478 wait complete. 2023-11-30T23:12:50.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f0563fff700 1 Processor -- start 2023-11-30T23:12:50.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f0563fff700 1 -- start start 2023-11-30T23:12:50.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f0563fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05640b1420 0x7f05640b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f0563fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f056413e210 0x7f05641dec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f0563fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f056414cc90 0x7f0564070850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f0563fff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05640b0db0 con 0x7f056413e210 2023-11-30T23:12:50.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f0563fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05640af640 con 0x7f05640b1420 2023-11-30T23:12:50.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f0563fff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05640af940 con 0x7f056414cc90 2023-11-30T23:12:50.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f05627fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f056413e210 0x7f05641dec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f05627fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f056413e210 0x7f05641dec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33990/0 (socket says 172.21.15.73:33990) 2023-11-30T23:12:50.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f05627fc700 1 -- 172.21.15.73:0/1352822044 learned_addr learned my addr 172.21.15.73:0/1352822044 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:50.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f0562ffd700 1 --2- 172.21.15.73:0/1352822044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05640b1420 0x7f05640b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f05637fe700 1 --2- 172.21.15.73:0/1352822044 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f056414cc90 0x7f0564070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f05627fc700 1 -- 172.21.15.73:0/1352822044 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f056414cc90 msgr2=0x7f0564070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:50.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f05627fc700 1 --2- 172.21.15.73:0/1352822044 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f056414cc90 0x7f0564070850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f05627fc700 1 -- 172.21.15.73:0/1352822044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05640b1420 msgr2=0x7f05640b6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:50.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f05627fc700 1 --2- 172.21.15.73:0/1352822044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05640b1420 0x7f05640b6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:50.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f05627fc700 1 -- 172.21.15.73:0/1352822044 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c009570 con 0x7f056413e210 2023-11-30T23:12:50.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.939+0000 7f05627fc700 1 --2- 172.21.15.73:0/1352822044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f056413e210 0x7f05641dec40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f055400efc0 tx=0x7f055400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:50.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.943+0000 7f055b7fe700 1 -- 172.21.15.73:0/1352822044 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055400cd10 con 0x7f056413e210 2023-11-30T23:12:50.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.943+0000 7f055b7fe700 1 -- 172.21.15.73:0/1352822044 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055400f040 con 0x7f056413e210 2023-11-30T23:12:50.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.943+0000 7f0563fff700 1 -- 172.21.15.73:0/1352822044 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05640afc20 con 0x7f056413e210 2023-11-30T23:12:50.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.943+0000 7f055b7fe700 1 -- 172.21.15.73:0/1352822044 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05540146a0 con 0x7f056413e210 2023-11-30T23:12:50.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.943+0000 7f0563fff700 1 -- 172.21.15.73:0/1352822044 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05640b0120 con 0x7f056413e210 2023-11-30T23:12:50.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.943+0000 7f0563fff700 1 -- 172.21.15.73:0/1352822044 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05640af4b0 con 0x7f056413e210 2023-11-30T23:12:50.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.943+0000 7f055b7fe700 1 -- 172.21.15.73:0/1352822044 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0554014800 con 0x7f056413e210 2023-11-30T23:12:50.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.943+0000 7f055b7fe700 1 --2- 172.21.15.73:0/1352822044 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0544065ad0 0x7f0544067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:50.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.943+0000 7f055b7fe700 1 -- 172.21.15.73:0/1352822044 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0554083930 con 0x7f056413e210 2023-11-30T23:12:50.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.943+0000 7f0562ffd700 1 --2- 172.21.15.73:0/1352822044 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0544065ad0 0x7f0544067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:50.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.947+0000 7f0562ffd700 1 --2- 172.21.15.73:0/1352822044 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0544065ad0 0x7f0544067f90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f054c000f60 tx=0x7f054c007e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:50.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:50.951+0000 7f055b7fe700 1 -- 172.21.15.73:0/1352822044 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f05540512e0 con 0x7f056413e210 2023-11-30T23:12:51.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.111+0000 7f0563fff700 1 -- 172.21.15.73:0/1352822044 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f056406eb40 con 0x7f0544065ad0 2023-11-30T23:12:51.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.119+0000 7f055b7fe700 1 -- 172.21.15.73:0/1352822044 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264615 (secure 0 0 0) 0x7f054c001370 con 0x7f0544065ad0 2023-11-30T23:12:51.129 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:51.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.127+0000 7f0563fff700 1 -- 172.21.15.73:0/1352822044 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0544065ad0 msgr2=0x7f0544067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:51.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.127+0000 7f0563fff700 1 --2- 172.21.15.73:0/1352822044 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0544065ad0 0x7f0544067f90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f054c000f60 tx=0x7f054c007e00 comp rx=0 tx=0).stop 2023-11-30T23:12:51.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.127+0000 7f0563fff700 1 -- 172.21.15.73:0/1352822044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f056413e210 msgr2=0x7f05641dec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:51.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.127+0000 7f0563fff700 1 --2- 172.21.15.73:0/1352822044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f056413e210 0x7f05641dec40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f055400efc0 tx=0x7f055400c3a0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.127+0000 7f0563fff700 1 -- 172.21.15.73:0/1352822044 shutdown_connections 2023-11-30T23:12:51.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.127+0000 7f0563fff700 1 --2- 172.21.15.73:0/1352822044 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f056414cc90 0x7f0564070850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.127+0000 7f0563fff700 1 --2- 172.21.15.73:0/1352822044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f056413e210 0x7f05641dec40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.127+0000 7f0563fff700 1 --2- 172.21.15.73:0/1352822044 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0544065ad0 0x7f0544067f90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.127+0000 7f0563fff700 1 --2- 172.21.15.73:0/1352822044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05640b1420 0x7f05640b6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.127+0000 7f0563fff700 1 -- 172.21.15.73:0/1352822044 >> 172.21.15.73:0/1352822044 conn(0x7f05640b45a0 msgr2=0x7f05641391a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:51.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.127+0000 7f0563fff700 1 -- 172.21.15.73:0/1352822044 shutdown_connections 2023-11-30T23:12:51.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.127+0000 7f0563fff700 1 -- 172.21.15.73:0/1352822044 wait complete. 2023-11-30T23:12:51.132 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-11-30T23:12:51.144 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-30T23:12:50.348831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234752,"kb_used_data":2752,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739968,"statfs":{"total":773094113280,"available":772853727232,"internally_reserved":0,"allocated":2818048,"data_stored":1714844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.248072"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951239+0000","last_change":"2023-11-30T23:12:47.514628+0000","last_active":"2023-11-30T23:12:48.951239+0000","last_peered":"2023-11-30T23:12:48.951239+0000","last_clean":"2023-11-30T23:12:48.951239+0000","last_became_active":"2023-11-30T23:12:47.512980+0000","last_became_peered":"2023-11-30T23:12:47.512980+0000","last_unstale":"2023-11-30T23:12:48.951239+0000","last_undegraded":"2023-11-30T23:12:48.951239+0000","last_fullsized":"2023-11-30T23:12:48.951239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:18:44.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493012+0000","last_change":"2023-11-30T23:12:47.511277+0000","last_active":"2023-11-30T23:12:48.493012+0000","last_peered":"2023-11-30T23:12:48.493012+0000","last_clean":"2023-11-30T23:12:48.493012+0000","last_became_active":"2023-11-30T23:12:47.508771+0000","last_became_peered":"2023-11-30T23:12:47.508771+0000","last_unstale":"2023-11-30T23:12:48.493012+0000","last_undegraded":"2023-11-30T23:12:48.493012+0000","last_fullsized":"2023-11-30T23:12:48.493012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492167+0000","last_change":"2023-11-30T23:12:47.508068+0000","last_active":"2023-11-30T23:12:48.492167+0000","last_peered":"2023-11-30T23:12:48.492167+0000","last_clean":"2023-11-30T23:12:48.492167+0000","last_became_active":"2023-11-30T23:12:47.507829+0000","last_became_peered":"2023-11-30T23:12:47.507829+0000","last_unstale":"2023-11-30T23:12:48.492167+0000","last_undegraded":"2023-11-30T23:12:48.492167+0000","last_fullsized":"2023-11-30T23:12:48.492167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:39.696562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950918+0000","last_change":"2023-11-30T23:12:47.522516+0000","last_active":"2023-11-30T23:12:48.950918+0000","last_peered":"2023-11-30T23:12:48.950918+0000","last_clean":"2023-11-30T23:12:48.950918+0000","last_became_active":"2023-11-30T23:12:47.522208+0000","last_became_peered":"2023-11-30T23:12:47.522208+0000","last_unstale":"2023-11-30T23:12:48.950918+0000","last_undegraded":"2023-11-30T23:12:48.950918+0000","last_fullsized":"2023-11-30T23:12:48.950918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950044+0000","last_change":"2023-11-30T23:12:47.507130+0000","last_active":"2023-11-30T23:12:48.950044+0000","last_peered":"2023-11-30T23:12:48.950044+0000","last_clean":"2023-11-30T23:12:48.950044+0000","last_became_active":"2023-11-30T23:12:47.506816+0000","last_became_peered":"2023-11-30T23:12:47.506816+0000","last_unstale":"2023-11-30T23:12:48.950044+0000","last_undegraded":"2023-11-30T23:12:48.950044+0000","last_fullsized":"2023-11-30T23:12:48.950044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:21:32.262322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950103+0000","last_change":"2023-11-30T23:12:47.514855+0000","last_active":"2023-11-30T23:12:48.950103+0000","last_peered":"2023-11-30T23:12:48.950103+0000","last_clean":"2023-11-30T23:12:48.950103+0000","last_became_active":"2023-11-30T23:12:47.513491+0000","last_became_peered":"2023-11-30T23:12:47.513491+0000","last_unstale":"2023-11-30T23:12:48.950103+0000","last_undegraded":"2023-11-30T23:12:48.950103+0000","last_fullsized":"2023-11-30T23:12:48.950103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:18:44.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948350+0000","last_change":"2023-11-30T23:12:47.508060+0000","last_active":"2023-11-30T23:12:48.948350+0000","last_peered":"2023-11-30T23:12:48.948350+0000","last_clean":"2023-11-30T23:12:48.948350+0000","last_became_active":"2023-11-30T23:12:47.507747+0000","last_became_peered":"2023-11-30T23:12:47.507747+0000","last_unstale":"2023-11-30T23:12:48.948350+0000","last_undegraded":"2023-11-30T23:12:48.948350+0000","last_fullsized":"2023-11-30T23:12:48.948350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:27.789422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948363+0000","last_change":"2023-11-30T23:12:47.523687+0000","last_active":"2023-11-30T23:12:48.948363+0000","last_peered":"2023-11-30T23:12:48.948363+0000","last_clean":"2023-11-30T23:12:48.948363+0000","last_became_active":"2023-11-30T23:12:47.523430+0000","last_became_peered":"2023-11-30T23:12:47.523430+0000","last_unstale":"2023-11-30T23:12:48.948363+0000","last_undegraded":"2023-11-30T23:12:48.948363+0000","last_fullsized":"2023-11-30T23:12:48.948363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:26:33.640383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951748+0000","last_change":"2023-11-30T23:12:47.521698+0000","last_active":"2023-11-30T23:12:48.951748+0000","last_peered":"2023-11-30T23:12:48.951748+0000","last_clean":"2023-11-30T23:12:48.951748+0000","last_became_active":"2023-11-30T23:12:47.521393+0000","last_became_peered":"2023-11-30T23:12:47.521393+0000","last_unstale":"2023-11-30T23:12:48.951748+0000","last_undegraded":"2023-11-30T23:12:48.951748+0000","last_fullsized":"2023-11-30T23:12:48.951748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:23:17.254251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949276+0000","last_change":"2023-11-30T23:12:47.522937+0000","last_active":"2023-11-30T23:12:48.949276+0000","last_peered":"2023-11-30T23:12:48.949276+0000","last_clean":"2023-11-30T23:12:48.949276+0000","last_became_active":"2023-11-30T23:12:47.522618+0000","last_became_peered":"2023-11-30T23:12:47.522618+0000","last_unstale":"2023-11-30T23:12:48.949276+0000","last_undegraded":"2023-11-30T23:12:48.949276+0000","last_fullsized":"2023-11-30T23:12:48.949276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950146+0000","last_change":"2023-11-30T23:12:47.522869+0000","last_active":"2023-11-30T23:12:48.950146+0000","last_peered":"2023-11-30T23:12:48.950146+0000","last_clean":"2023-11-30T23:12:48.950146+0000","last_became_active":"2023-11-30T23:12:47.522552+0000","last_became_peered":"2023-11-30T23:12:47.522552+0000","last_unstale":"2023-11-30T23:12:48.950146+0000","last_undegraded":"2023-11-30T23:12:48.950146+0000","last_fullsized":"2023-11-30T23:12:48.950146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952576+0000","last_change":"2023-11-30T23:12:47.513660+0000","last_active":"2023-11-30T23:12:48.952576+0000","last_peered":"2023-11-30T23:12:48.952576+0000","last_clean":"2023-11-30T23:12:48.952576+0000","last_became_active":"2023-11-30T23:12:47.513401+0000","last_became_peered":"2023-11-30T23:12:47.513401+0000","last_unstale":"2023-11-30T23:12:48.952576+0000","last_undegraded":"2023-11-30T23:12:48.952576+0000","last_fullsized":"2023-11-30T23:12:48.952576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:22.086661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948954+0000","last_change":"2023-11-30T23:12:47.513995+0000","last_active":"2023-11-30T23:12:48.948954+0000","last_peered":"2023-11-30T23:12:48.948954+0000","last_clean":"2023-11-30T23:12:48.948954+0000","last_became_active":"2023-11-30T23:12:47.513714+0000","last_became_peered":"2023-11-30T23:12:47.513714+0000","last_unstale":"2023-11-30T23:12:48.948954+0000","last_undegraded":"2023-11-30T23:12:48.948954+0000","last_fullsized":"2023-11-30T23:12:48.948954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:20:31.102899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491646+0000","last_change":"2023-11-30T23:12:47.507240+0000","last_active":"2023-11-30T23:12:48.491646+0000","last_peered":"2023-11-30T23:12:48.491646+0000","last_clean":"2023-11-30T23:12:48.491646+0000","last_became_active":"2023-11-30T23:12:47.506967+0000","last_became_peered":"2023-11-30T23:12:47.506967+0000","last_unstale":"2023-11-30T23:12:48.491646+0000","last_undegraded":"2023-11-30T23:12:48.491646+0000","last_fullsized":"2023-11-30T23:12:48.491646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492735+0000","last_change":"2023-11-30T23:12:47.513430+0000","last_active":"2023-11-30T23:12:48.492735+0000","last_peered":"2023-11-30T23:12:48.492735+0000","last_clean":"2023-11-30T23:12:48.492735+0000","last_became_active":"2023-11-30T23:12:47.513018+0000","last_became_peered":"2023-11-30T23:12:47.513018+0000","last_unstale":"2023-11-30T23:12:48.492735+0000","last_undegraded":"2023-11-30T23:12:48.492735+0000","last_fullsized":"2023-11-30T23:12:48.492735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948206+0000","last_change":"2023-11-30T23:12:47.521933+0000","last_active":"2023-11-30T23:12:48.948206+0000","last_peered":"2023-11-30T23:12:48.948206+0000","last_clean":"2023-11-30T23:12:48.948206+0000","last_became_active":"2023-11-30T23:12:47.520518+0000","last_became_peered":"2023-11-30T23:12:47.520518+0000","last_unstale":"2023-11-30T23:12:48.948206+0000","last_undegraded":"2023-11-30T23:12:48.948206+0000","last_fullsized":"2023-11-30T23:12:48.948206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:27.789422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.953013+0000","last_change":"2023-11-30T23:12:47.516657+0000","last_active":"2023-11-30T23:12:48.953013+0000","last_peered":"2023-11-30T23:12:48.953013+0000","last_clean":"2023-11-30T23:12:48.953013+0000","last_became_active":"2023-11-30T23:12:47.516382+0000","last_became_peered":"2023-11-30T23:12:47.516382+0000","last_unstale":"2023-11-30T23:12:48.953013+0000","last_undegraded":"2023-11-30T23:12:48.953013+0000","last_fullsized":"2023-11-30T23:12:48.953013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:54:46.925262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.494119+0000","last_change":"2023-11-30T23:12:47.509616+0000","last_active":"2023-11-30T23:12:48.494119+0000","last_peered":"2023-11-30T23:12:48.494119+0000","last_clean":"2023-11-30T23:12:48.494119+0000","last_became_active":"2023-11-30T23:12:47.509340+0000","last_became_peered":"2023-11-30T23:12:47.509340+0000","last_unstale":"2023-11-30T23:12:48.494119+0000","last_undegraded":"2023-11-30T23:12:48.494119+0000","last_fullsized":"2023-11-30T23:12:48.494119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:29.167074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950366+0000","last_change":"2023-11-30T23:12:47.507039+0000","last_active":"2023-11-30T23:12:48.950366+0000","last_peered":"2023-11-30T23:12:48.950366+0000","last_clean":"2023-11-30T23:12:48.950366+0000","last_became_active":"2023-11-30T23:12:47.506733+0000","last_became_peered":"2023-11-30T23:12:47.506733+0000","last_unstale":"2023-11-30T23:12:48.950366+0000","last_undegraded":"2023-11-30T23:12:48.950366+0000","last_fullsized":"2023-11-30T23:12:48.950366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949761+0000","last_change":"2023-11-30T23:12:47.522534+0000","last_active":"2023-11-30T23:12:48.949761+0000","last_peered":"2023-11-30T23:12:48.949761+0000","last_clean":"2023-11-30T23:12:48.949761+0000","last_became_active":"2023-11-30T23:12:47.518819+0000","last_became_peered":"2023-11-30T23:12:47.518819+0000","last_unstale":"2023-11-30T23:12:48.949761+0000","last_undegraded":"2023-11-30T23:12:48.949761+0000","last_fullsized":"2023-11-30T23:12:48.949761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491549+0000","last_change":"2023-11-30T23:12:47.514472+0000","last_active":"2023-11-30T23:12:48.491549+0000","last_peered":"2023-11-30T23:12:48.491549+0000","last_clean":"2023-11-30T23:12:48.491549+0000","last_became_active":"2023-11-30T23:12:47.514223+0000","last_became_peered":"2023-11-30T23:12:47.514223+0000","last_unstale":"2023-11-30T23:12:48.491549+0000","last_undegraded":"2023-11-30T23:12:48.491549+0000","last_fullsized":"2023-11-30T23:12:48.491549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:34:32.232378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950329+0000","last_change":"2023-11-30T23:12:47.520514+0000","last_active":"2023-11-30T23:12:48.950329+0000","last_peered":"2023-11-30T23:12:48.950329+0000","last_clean":"2023-11-30T23:12:48.950329+0000","last_became_active":"2023-11-30T23:12:47.520228+0000","last_became_peered":"2023-11-30T23:12:47.520228+0000","last_unstale":"2023-11-30T23:12:48.950329+0000","last_undegraded":"2023-11-30T23:12:48.950329+0000","last_fullsized":"2023-11-30T23:12:48.950329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:26:06.870586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948524+0000","last_change":"2023-11-30T23:12:47.515492+0000","last_active":"2023-11-30T23:12:48.948524+0000","last_peered":"2023-11-30T23:12:48.948524+0000","last_clean":"2023-11-30T23:12:48.948524+0000","last_became_active":"2023-11-30T23:12:47.515247+0000","last_became_peered":"2023-11-30T23:12:47.515247+0000","last_unstale":"2023-11-30T23:12:48.948524+0000","last_undegraded":"2023-11-30T23:12:48.948524+0000","last_fullsized":"2023-11-30T23:12:48.948524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948562+0000","last_change":"2023-11-30T23:12:47.511363+0000","last_active":"2023-11-30T23:12:48.948562+0000","last_peered":"2023-11-30T23:12:48.948562+0000","last_clean":"2023-11-30T23:12:48.948562+0000","last_became_active":"2023-11-30T23:12:47.511097+0000","last_became_peered":"2023-11-30T23:12:47.511097+0000","last_unstale":"2023-11-30T23:12:48.948562+0000","last_undegraded":"2023-11-30T23:12:48.948562+0000","last_fullsized":"2023-11-30T23:12:48.948562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949389+0000","last_change":"2023-11-30T23:12:47.510657+0000","last_active":"2023-11-30T23:12:48.949389+0000","last_peered":"2023-11-30T23:12:48.949389+0000","last_clean":"2023-11-30T23:12:48.949389+0000","last_became_active":"2023-11-30T23:12:47.510404+0000","last_became_peered":"2023-11-30T23:12:47.510404+0000","last_unstale":"2023-11-30T23:12:48.949389+0000","last_undegraded":"2023-11-30T23:12:48.949389+0000","last_fullsized":"2023-11-30T23:12:48.949389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949508+0000","last_change":"2023-11-30T23:12:47.516808+0000","last_active":"2023-11-30T23:12:48.949508+0000","last_peered":"2023-11-30T23:12:48.949508+0000","last_clean":"2023-11-30T23:12:48.949508+0000","last_became_active":"2023-11-30T23:12:47.516539+0000","last_became_peered":"2023-11-30T23:12:47.516539+0000","last_unstale":"2023-11-30T23:12:48.949508+0000","last_undegraded":"2023-11-30T23:12:48.949508+0000","last_fullsized":"2023-11-30T23:12:48.949508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493067+0000","last_change":"2023-11-30T23:12:47.506558+0000","last_active":"2023-11-30T23:12:48.493067+0000","last_peered":"2023-11-30T23:12:48.493067+0000","last_clean":"2023-11-30T23:12:48.493067+0000","last_became_active":"2023-11-30T23:12:47.506284+0000","last_became_peered":"2023-11-30T23:12:47.506284+0000","last_unstale":"2023-11-30T23:12:48.493067+0000","last_undegraded":"2023-11-30T23:12:48.493067+0000","last_fullsized":"2023-11-30T23:12:48.493067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949214+0000","last_change":"2023-11-30T23:12:47.512060+0000","last_active":"2023-11-30T23:12:48.949214+0000","last_peered":"2023-11-30T23:12:48.949214+0000","last_clean":"2023-11-30T23:12:48.949214+0000","last_became_active":"2023-11-30T23:12:47.511800+0000","last_became_peered":"2023-11-30T23:12:47.511800+0000","last_unstale":"2023-11-30T23:12:48.949214+0000","last_undegraded":"2023-11-30T23:12:48.949214+0000","last_fullsized":"2023-11-30T23:12:48.949214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491631+0000","last_change":"2023-11-30T23:12:47.513225+0000","last_active":"2023-11-30T23:12:48.491631+0000","last_peered":"2023-11-30T23:12:48.491631+0000","last_clean":"2023-11-30T23:12:48.491631+0000","last_became_active":"2023-11-30T23:12:47.512978+0000","last_became_peered":"2023-11-30T23:12:47.512978+0000","last_unstale":"2023-11-30T23:12:48.491631+0000","last_undegraded":"2023-11-30T23:12:48.491631+0000","last_fullsized":"2023-11-30T23:12:48.491631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950359+0000","last_change":"2023-11-30T23:12:47.511972+0000","last_active":"2023-11-30T23:12:48.950359+0000","last_peered":"2023-11-30T23:12:48.950359+0000","last_clean":"2023-11-30T23:12:48.950359+0000","last_became_active":"2023-11-30T23:12:47.511699+0000","last_became_peered":"2023-11-30T23:12:47.511699+0000","last_unstale":"2023-11-30T23:12:48.950359+0000","last_undegraded":"2023-11-30T23:12:48.950359+0000","last_fullsized":"2023-11-30T23:12:48.950359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493146+0000","last_change":"2023-11-30T23:12:47.521874+0000","last_active":"2023-11-30T23:12:48.493146+0000","last_peered":"2023-11-30T23:12:48.493146+0000","last_clean":"2023-11-30T23:12:48.493146+0000","last_became_active":"2023-11-30T23:12:47.521604+0000","last_became_peered":"2023-11-30T23:12:47.521604+0000","last_unstale":"2023-11-30T23:12:48.493146+0000","last_undegraded":"2023-11-30T23:12:48.493146+0000","last_fullsized":"2023-11-30T23:12:48.493146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:02.220181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948617+0000","last_change":"2023-11-30T23:12:47.517728+0000","last_active":"2023-11-30T23:12:48.948617+0000","last_peered":"2023-11-30T23:12:48.948617+0000","last_clean":"2023-11-30T23:12:48.948617+0000","last_became_active":"2023-11-30T23:12:47.517283+0000","last_became_peered":"2023-11-30T23:12:47.517283+0000","last_unstale":"2023-11-30T23:12:48.948617+0000","last_undegraded":"2023-11-30T23:12:48.948617+0000","last_fullsized":"2023-11-30T23:12:48.948617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949668+0000","last_change":"2023-11-30T23:12:47.509055+0000","last_active":"2023-11-30T23:12:48.949668+0000","last_peered":"2023-11-30T23:12:48.949668+0000","last_clean":"2023-11-30T23:12:48.949668+0000","last_became_active":"2023-11-30T23:12:47.508725+0000","last_became_peered":"2023-11-30T23:12:47.508725+0000","last_unstale":"2023-11-30T23:12:48.949668+0000","last_undegraded":"2023-11-30T23:12:48.949668+0000","last_fullsized":"2023-11-30T23:12:48.949668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:54.893320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949177+0000","last_change":"2023-11-30T23:12:47.139071+0000","last_active":"2023-11-30T23:12:48.949177+0000","last_peered":"2023-11-30T23:12:48.949177+0000","last_clean":"2023-11-30T23:12:48.949177+0000","last_became_active":"2023-11-30T23:12:47.138768+0000","last_became_peered":"2023-11-30T23:12:47.138768+0000","last_unstale":"2023-11-30T23:12:48.949177+0000","last_undegraded":"2023-11-30T23:12:48.949177+0000","last_fullsized":"2023-11-30T23:12:48.949177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491791+0000","last_change":"2023-11-30T23:12:47.516574+0000","last_active":"2023-11-30T23:12:48.491791+0000","last_peered":"2023-11-30T23:12:48.491791+0000","last_clean":"2023-11-30T23:12:48.491791+0000","last_became_active":"2023-11-30T23:12:47.516214+0000","last_became_peered":"2023-11-30T23:12:47.516214+0000","last_unstale":"2023-11-30T23:12:48.491791+0000","last_undegraded":"2023-11-30T23:12:48.491791+0000","last_fullsized":"2023-11-30T23:12:48.491791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948803+0000","last_change":"2023-11-30T23:12:47.130416+0000","last_active":"2023-11-30T23:12:48.948803+0000","last_peered":"2023-11-30T23:12:48.948803+0000","last_clean":"2023-11-30T23:12:48.948803+0000","last_became_active":"2023-11-30T23:12:47.129771+0000","last_became_peered":"2023-11-30T23:12:47.129771+0000","last_unstale":"2023-11-30T23:12:48.948803+0000","last_undegraded":"2023-11-30T23:12:48.948803+0000","last_fullsized":"2023-11-30T23:12:48.948803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948794+0000","last_change":"2023-11-30T23:12:47.133733+0000","last_active":"2023-11-30T23:12:48.948794+0000","last_peered":"2023-11-30T23:12:48.948794+0000","last_clean":"2023-11-30T23:12:48.948794+0000","last_became_active":"2023-11-30T23:12:47.133440+0000","last_became_peered":"2023-11-30T23:12:47.133440+0000","last_unstale":"2023-11-30T23:12:48.948794+0000","last_undegraded":"2023-11-30T23:12:48.948794+0000","last_fullsized":"2023-11-30T23:12:48.948794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:48.913175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948507+0000","last_change":"2023-11-30T23:12:47.507868+0000","last_active":"2023-11-30T23:12:48.948507+0000","last_peered":"2023-11-30T23:12:48.948507+0000","last_clean":"2023-11-30T23:12:48.948507+0000","last_became_active":"2023-11-30T23:12:47.507617+0000","last_became_peered":"2023-11-30T23:12:47.507617+0000","last_unstale":"2023-11-30T23:12:48.948507+0000","last_undegraded":"2023-11-30T23:12:48.948507+0000","last_fullsized":"2023-11-30T23:12:48.948507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:08:47.117163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948855+0000","last_change":"2023-11-30T23:12:47.132638+0000","last_active":"2023-11-30T23:12:48.948855+0000","last_peered":"2023-11-30T23:12:48.948855+0000","last_clean":"2023-11-30T23:12:48.948855+0000","last_became_active":"2023-11-30T23:12:47.132351+0000","last_became_peered":"2023-11-30T23:12:47.132351+0000","last_unstale":"2023-11-30T23:12:48.948855+0000","last_undegraded":"2023-11-30T23:12:48.948855+0000","last_fullsized":"2023-11-30T23:12:48.948855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492595+0000","last_change":"2023-11-30T23:12:47.506332+0000","last_active":"2023-11-30T23:12:48.492595+0000","last_peered":"2023-11-30T23:12:48.492595+0000","last_clean":"2023-11-30T23:12:48.492595+0000","last_became_active":"2023-11-30T23:12:47.506082+0000","last_became_peered":"2023-11-30T23:12:47.506082+0000","last_unstale":"2023-11-30T23:12:48.492595+0000","last_undegraded":"2023-11-30T23:12:48.492595+0000","last_fullsized":"2023-11-30T23:12:48.492595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951065+0000","last_change":"2023-11-30T23:12:47.139722+0000","last_active":"2023-11-30T23:12:48.951065+0000","last_peered":"2023-11-30T23:12:48.951065+0000","last_clean":"2023-11-30T23:12:48.951065+0000","last_became_active":"2023-11-30T23:12:47.139400+0000","last_became_peered":"2023-11-30T23:12:47.139400+0000","last_unstale":"2023-11-30T23:12:48.951065+0000","last_undegraded":"2023-11-30T23:12:48.951065+0000","last_fullsized":"2023-11-30T23:12:48.951065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952521+0000","last_change":"2023-11-30T23:12:47.520429+0000","last_active":"2023-11-30T23:12:48.952521+0000","last_peered":"2023-11-30T23:12:48.952521+0000","last_clean":"2023-11-30T23:12:48.952521+0000","last_became_active":"2023-11-30T23:12:47.520153+0000","last_became_peered":"2023-11-30T23:12:47.520153+0000","last_unstale":"2023-11-30T23:12:48.952521+0000","last_undegraded":"2023-11-30T23:12:48.952521+0000","last_fullsized":"2023-11-30T23:12:48.952521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:17:01.774183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952510+0000","last_change":"2023-11-30T23:12:47.139328+0000","last_active":"2023-11-30T23:12:48.952510+0000","last_peered":"2023-11-30T23:12:48.952510+0000","last_clean":"2023-11-30T23:12:48.952510+0000","last_became_active":"2023-11-30T23:12:47.139047+0000","last_became_peered":"2023-11-30T23:12:47.139047+0000","last_unstale":"2023-11-30T23:12:48.952510+0000","last_undegraded":"2023-11-30T23:12:48.952510+0000","last_fullsized":"2023-11-30T23:12:48.952510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491614+0000","last_change":"2023-11-30T23:12:47.522974+0000","last_active":"2023-11-30T23:12:48.491614+0000","last_peered":"2023-11-30T23:12:48.491614+0000","last_clean":"2023-11-30T23:12:48.491614+0000","last_became_active":"2023-11-30T23:12:47.522711+0000","last_became_peered":"2023-11-30T23:12:47.522711+0000","last_unstale":"2023-11-30T23:12:48.491614+0000","last_undegraded":"2023-11-30T23:12:48.491614+0000","last_fullsized":"2023-11-30T23:12:48.491614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:19:43.387626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493283+0000","last_change":"2023-11-30T23:12:47.140794+0000","last_active":"2023-11-30T23:12:48.493283+0000","last_peered":"2023-11-30T23:12:48.493283+0000","last_clean":"2023-11-30T23:12:48.493283+0000","last_became_active":"2023-11-30T23:12:47.140531+0000","last_became_peered":"2023-11-30T23:12:47.140531+0000","last_unstale":"2023-11-30T23:12:48.493283+0000","last_undegraded":"2023-11-30T23:12:48.493283+0000","last_fullsized":"2023-11-30T23:12:48.493283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:53.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952707+0000","last_change":"2023-11-30T23:12:47.517475+0000","last_active":"2023-11-30T23:12:48.952707+0000","last_peered":"2023-11-30T23:12:48.952707+0000","last_clean":"2023-11-30T23:12:48.952707+0000","last_became_active":"2023-11-30T23:12:47.513983+0000","last_became_peered":"2023-11-30T23:12:47.513983+0000","last_unstale":"2023-11-30T23:12:48.952707+0000","last_undegraded":"2023-11-30T23:12:48.952707+0000","last_fullsized":"2023-11-30T23:12:48.952707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:39.696562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949883+0000","last_change":"2023-11-30T23:12:47.140168+0000","last_active":"2023-11-30T23:12:48.949883+0000","last_peered":"2023-11-30T23:12:48.949883+0000","last_clean":"2023-11-30T23:12:48.949883+0000","last_became_active":"2023-11-30T23:12:47.139799+0000","last_became_peered":"2023-11-30T23:12:47.139799+0000","last_unstale":"2023-11-30T23:12:48.949883+0000","last_undegraded":"2023-11-30T23:12:48.949883+0000","last_fullsized":"2023-11-30T23:12:48.949883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949684+0000","last_change":"2023-11-30T23:12:47.503606+0000","last_active":"2023-11-30T23:12:48.949684+0000","last_peered":"2023-11-30T23:12:48.949684+0000","last_clean":"2023-11-30T23:12:48.949684+0000","last_became_active":"2023-11-30T23:12:47.503333+0000","last_became_peered":"2023-11-30T23:12:47.503333+0000","last_unstale":"2023-11-30T23:12:48.949684+0000","last_undegraded":"2023-11-30T23:12:48.949684+0000","last_fullsized":"2023-11-30T23:12:48.949684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491844+0000","last_change":"2023-11-30T23:12:47.136931+0000","last_active":"2023-11-30T23:12:48.491844+0000","last_peered":"2023-11-30T23:12:48.491844+0000","last_clean":"2023-11-30T23:12:48.491844+0000","last_became_active":"2023-11-30T23:12:47.136620+0000","last_became_peered":"2023-11-30T23:12:47.136620+0000","last_unstale":"2023-11-30T23:12:48.491844+0000","last_undegraded":"2023-11-30T23:12:48.491844+0000","last_fullsized":"2023-11-30T23:12:48.491844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:22:43.069951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491335+0000","last_change":"2023-11-30T23:12:47.503541+0000","last_active":"2023-11-30T23:12:48.491335+0000","last_peered":"2023-11-30T23:12:48.491335+0000","last_clean":"2023-11-30T23:12:48.491335+0000","last_became_active":"2023-11-30T23:12:47.503294+0000","last_became_peered":"2023-11-30T23:12:47.503294+0000","last_unstale":"2023-11-30T23:12:48.491335+0000","last_undegraded":"2023-11-30T23:12:48.491335+0000","last_fullsized":"2023-11-30T23:12:48.491335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950583+0000","last_change":"2023-11-30T23:12:47.140575+0000","last_active":"2023-11-30T23:12:48.950583+0000","last_peered":"2023-11-30T23:12:48.950583+0000","last_clean":"2023-11-30T23:12:48.950583+0000","last_became_active":"2023-11-30T23:12:47.140125+0000","last_became_peered":"2023-11-30T23:12:47.140125+0000","last_unstale":"2023-11-30T23:12:48.950583+0000","last_undegraded":"2023-11-30T23:12:48.950583+0000","last_fullsized":"2023-11-30T23:12:48.950583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950166+0000","last_change":"2023-11-30T23:12:47.515720+0000","last_active":"2023-11-30T23:12:48.950166+0000","last_peered":"2023-11-30T23:12:48.950166+0000","last_clean":"2023-11-30T23:12:48.950166+0000","last_became_active":"2023-11-30T23:12:47.515427+0000","last_became_peered":"2023-11-30T23:12:47.515427+0000","last_unstale":"2023-11-30T23:12:48.950166+0000","last_undegraded":"2023-11-30T23:12:48.950166+0000","last_fullsized":"2023-11-30T23:12:48.950166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:26:06.870586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949198+0000","last_change":"2023-11-30T23:12:47.129492+0000","last_active":"2023-11-30T23:12:48.949198+0000","last_peered":"2023-11-30T23:12:48.949198+0000","last_clean":"2023-11-30T23:12:48.949198+0000","last_became_active":"2023-11-30T23:12:47.129180+0000","last_became_peered":"2023-11-30T23:12:47.129180+0000","last_unstale":"2023-11-30T23:12:48.949198+0000","last_undegraded":"2023-11-30T23:12:48.949198+0000","last_fullsized":"2023-11-30T23:12:48.949198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948802+0000","last_change":"2023-11-30T23:12:47.517541+0000","last_active":"2023-11-30T23:12:48.948802+0000","last_peered":"2023-11-30T23:12:48.948802+0000","last_clean":"2023-11-30T23:12:48.948802+0000","last_became_active":"2023-11-30T23:12:47.516980+0000","last_became_peered":"2023-11-30T23:12:47.516980+0000","last_unstale":"2023-11-30T23:12:48.948802+0000","last_undegraded":"2023-11-30T23:12:48.948802+0000","last_fullsized":"2023-11-30T23:12:48.948802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492929+0000","last_change":"2023-11-30T23:12:47.129703+0000","last_active":"2023-11-30T23:12:48.492929+0000","last_peered":"2023-11-30T23:12:48.492929+0000","last_clean":"2023-11-30T23:12:48.492929+0000","last_became_active":"2023-11-30T23:12:47.129349+0000","last_became_peered":"2023-11-30T23:12:47.129349+0000","last_unstale":"2023-11-30T23:12:48.492929+0000","last_undegraded":"2023-11-30T23:12:48.492929+0000","last_fullsized":"2023-11-30T23:12:48.492929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949277+0000","last_change":"2023-11-30T23:12:47.514610+0000","last_active":"2023-11-30T23:12:48.949277+0000","last_peered":"2023-11-30T23:12:48.949277+0000","last_clean":"2023-11-30T23:12:48.949277+0000","last_became_active":"2023-11-30T23:12:47.514140+0000","last_became_peered":"2023-11-30T23:12:47.514140+0000","last_unstale":"2023-11-30T23:12:48.949277+0000","last_undegraded":"2023-11-30T23:12:48.949277+0000","last_fullsized":"2023-11-30T23:12:48.949277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:54:46.925262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952235+0000","last_change":"2023-11-30T23:12:47.136924+0000","last_active":"2023-11-30T23:12:48.952235+0000","last_peered":"2023-11-30T23:12:48.952235+0000","last_clean":"2023-11-30T23:12:48.952235+0000","last_became_active":"2023-11-30T23:12:47.136631+0000","last_became_peered":"2023-11-30T23:12:47.136631+0000","last_unstale":"2023-11-30T23:12:48.952235+0000","last_undegraded":"2023-11-30T23:12:48.952235+0000","last_fullsized":"2023-11-30T23:12:48.952235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:22:48.835054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950899+0000","last_change":"2023-11-30T23:12:47.514450+0000","last_active":"2023-11-30T23:12:48.950899+0000","last_peered":"2023-11-30T23:12:48.950899+0000","last_clean":"2023-11-30T23:12:48.950899+0000","last_became_active":"2023-11-30T23:12:47.514053+0000","last_became_peered":"2023-11-30T23:12:47.514053+0000","last_unstale":"2023-11-30T23:12:48.950899+0000","last_undegraded":"2023-11-30T23:12:48.950899+0000","last_fullsized":"2023-11-30T23:12:48.950899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.494177+0000","last_change":"2023-11-30T23:12:47.138008+0000","last_active":"2023-11-30T23:12:48.494177+0000","last_peered":"2023-11-30T23:12:48.494177+0000","last_clean":"2023-11-30T23:12:48.494177+0000","last_became_active":"2023-11-30T23:12:47.137695+0000","last_became_peered":"2023-11-30T23:12:47.137695+0000","last_unstale":"2023-11-30T23:12:48.494177+0000","last_undegraded":"2023-11-30T23:12:48.494177+0000","last_fullsized":"2023-11-30T23:12:48.494177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951499+0000","last_change":"2023-11-30T23:12:47.516065+0000","last_active":"2023-11-30T23:12:48.951499+0000","last_peered":"2023-11-30T23:12:48.951499+0000","last_clean":"2023-11-30T23:12:48.951499+0000","last_became_active":"2023-11-30T23:12:47.514822+0000","last_became_peered":"2023-11-30T23:12:47.514822+0000","last_unstale":"2023-11-30T23:12:48.951499+0000","last_undegraded":"2023-11-30T23:12:48.951499+0000","last_fullsized":"2023-11-30T23:12:48.951499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:02:36.020857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493499+0000","last_change":"2023-11-30T23:12:47.129184+0000","last_active":"2023-11-30T23:12:48.493499+0000","last_peered":"2023-11-30T23:12:48.493499+0000","last_clean":"2023-11-30T23:12:48.493499+0000","last_became_active":"2023-11-30T23:12:47.128682+0000","last_became_peered":"2023-11-30T23:12:47.128682+0000","last_unstale":"2023-11-30T23:12:48.493499+0000","last_undegraded":"2023-11-30T23:12:48.493499+0000","last_fullsized":"2023-11-30T23:12:48.493499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952861+0000","last_change":"2023-11-30T23:12:47.516581+0000","last_active":"2023-11-30T23:12:48.952861+0000","last_peered":"2023-11-30T23:12:48.952861+0000","last_clean":"2023-11-30T23:12:48.952861+0000","last_became_active":"2023-11-30T23:12:47.516317+0000","last_became_peered":"2023-11-30T23:12:47.516317+0000","last_unstale":"2023-11-30T23:12:48.952861+0000","last_undegraded":"2023-11-30T23:12:48.952861+0000","last_fullsized":"2023-11-30T23:12:48.952861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:20:31.102899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493457+0000","last_change":"2023-11-30T23:12:47.140679+0000","last_active":"2023-11-30T23:12:48.493457+0000","last_peered":"2023-11-30T23:12:48.493457+0000","last_clean":"2023-11-30T23:12:48.493457+0000","last_became_active":"2023-11-30T23:12:47.140400+0000","last_became_peered":"2023-11-30T23:12:47.140400+0000","last_unstale":"2023-11-30T23:12:48.493457+0000","last_undegraded":"2023-11-30T23:12:48.493457+0000","last_fullsized":"2023-11-30T23:12:48.493457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949914+0000","last_change":"2023-11-30T23:12:47.521764+0000","last_active":"2023-11-30T23:12:48.949914+0000","last_peered":"2023-11-30T23:12:48.949914+0000","last_clean":"2023-11-30T23:12:48.949914+0000","last_became_active":"2023-11-30T23:12:47.521481+0000","last_became_peered":"2023-11-30T23:12:47.521481+0000","last_unstale":"2023-11-30T23:12:48.949914+0000","last_undegraded":"2023-11-30T23:12:48.949914+0000","last_fullsized":"2023-11-30T23:12:48.949914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:17:01.774183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-30T23:12:47.490864+0000","last_change":"2023-11-30T23:12:36.558633+0000","last_active":"2023-11-30T23:12:47.490864+0000","last_peered":"2023-11-30T23:12:47.490864+0000","last_clean":"2023-11-30T23:12:47.490864+0000","last_became_active":"2023-11-30T23:12:36.556455+0000","last_became_peered":"2023-11-30T23:12:36.556455+0000","last_unstale":"2023-11-30T23:12:47.490864+0000","last_undegraded":"2023-11-30T23:12:47.490864+0000","last_fullsized":"2023-11-30T23:12:47.490864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:34.652815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:34.652815+0000","last_clean_scrub_stamp":"2023-11-30T23:12:34.652815+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:36:52.941511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948996+0000","last_change":"2023-11-30T23:12:47.132985+0000","last_active":"2023-11-30T23:12:48.948996+0000","last_peered":"2023-11-30T23:12:48.948996+0000","last_clean":"2023-11-30T23:12:48.948996+0000","last_became_active":"2023-11-30T23:12:47.132365+0000","last_became_peered":"2023-11-30T23:12:47.132365+0000","last_unstale":"2023-11-30T23:12:48.948996+0000","last_undegraded":"2023-11-30T23:12:48.948996+0000","last_fullsized":"2023-11-30T23:12:48.948996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949001+0000","last_change":"2023-11-30T23:12:47.509943+0000","last_active":"2023-11-30T23:12:48.949001+0000","last_peered":"2023-11-30T23:12:48.949001+0000","last_clean":"2023-11-30T23:12:48.949001+0000","last_became_active":"2023-11-30T23:12:47.508677+0000","last_became_peered":"2023-11-30T23:12:47.508677+0000","last_unstale":"2023-11-30T23:12:48.949001+0000","last_undegraded":"2023-11-30T23:12:48.949001+0000","last_fullsized":"2023-11-30T23:12:48.949001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948349+0000","last_change":"2023-11-30T23:12:47.148775+0000","last_active":"2023-11-30T23:12:48.948349+0000","last_peered":"2023-11-30T23:12:48.948349+0000","last_clean":"2023-11-30T23:12:48.948349+0000","last_became_active":"2023-11-30T23:12:47.148547+0000","last_became_peered":"2023-11-30T23:12:47.148547+0000","last_unstale":"2023-11-30T23:12:48.948349+0000","last_undegraded":"2023-11-30T23:12:48.948349+0000","last_fullsized":"2023-11-30T23:12:48.948349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:01.207700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.490955+0000","last_change":"2023-11-30T23:12:47.515805+0000","last_active":"2023-11-30T23:12:48.490955+0000","last_peered":"2023-11-30T23:12:48.490955+0000","last_clean":"2023-11-30T23:12:48.490955+0000","last_became_active":"2023-11-30T23:12:47.515553+0000","last_became_peered":"2023-11-30T23:12:47.515553+0000","last_unstale":"2023-11-30T23:12:48.490955+0000","last_undegraded":"2023-11-30T23:12:48.490955+0000","last_fullsized":"2023-11-30T23:12:48.490955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:22.086661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493249+0000","last_change":"2023-11-30T23:12:47.136018+0000","last_active":"2023-11-30T23:12:48.493249+0000","last_peered":"2023-11-30T23:12:48.493249+0000","last_clean":"2023-11-30T23:12:48.493249+0000","last_became_active":"2023-11-30T23:12:47.135746+0000","last_became_peered":"2023-11-30T23:12:47.135746+0000","last_unstale":"2023-11-30T23:12:48.493249+0000","last_undegraded":"2023-11-30T23:12:48.493249+0000","last_fullsized":"2023-11-30T23:12:48.493249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492802+0000","last_change":"2023-11-30T23:12:47.513832+0000","last_active":"2023-11-30T23:12:48.492802+0000","last_peered":"2023-11-30T23:12:48.492802+0000","last_clean":"2023-11-30T23:12:48.492802+0000","last_became_active":"2023-11-30T23:12:47.510024+0000","last_became_peered":"2023-11-30T23:12:47.510024+0000","last_unstale":"2023-11-30T23:12:48.492802+0000","last_undegraded":"2023-11-30T23:12:48.492802+0000","last_fullsized":"2023-11-30T23:12:48.492802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950516+0000","last_change":"2023-11-30T23:12:47.141605+0000","last_active":"2023-11-30T23:12:48.950516+0000","last_peered":"2023-11-30T23:12:48.950516+0000","last_clean":"2023-11-30T23:12:48.950516+0000","last_became_active":"2023-11-30T23:12:47.141115+0000","last_became_peered":"2023-11-30T23:12:47.141115+0000","last_unstale":"2023-11-30T23:12:48.950516+0000","last_undegraded":"2023-11-30T23:12:48.950516+0000","last_fullsized":"2023-11-30T23:12:48.950516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951647+0000","last_change":"2023-11-30T23:12:47.514830+0000","last_active":"2023-11-30T23:12:48.951647+0000","last_peered":"2023-11-30T23:12:48.951647+0000","last_clean":"2023-11-30T23:12:48.951647+0000","last_became_active":"2023-11-30T23:12:47.514572+0000","last_became_peered":"2023-11-30T23:12:47.514572+0000","last_unstale":"2023-11-30T23:12:48.951647+0000","last_undegraded":"2023-11-30T23:12:48.951647+0000","last_fullsized":"2023-11-30T23:12:48.951647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:29.167074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.494540+0000","last_change":"2023-11-30T23:12:47.141801+0000","last_active":"2023-11-30T23:12:48.494540+0000","last_peered":"2023-11-30T23:12:48.494540+0000","last_clean":"2023-11-30T23:12:48.494540+0000","last_became_active":"2023-11-30T23:12:47.141411+0000","last_became_peered":"2023-11-30T23:12:47.141411+0000","last_unstale":"2023-11-30T23:12:48.494540+0000","last_undegraded":"2023-11-30T23:12:48.494540+0000","last_fullsized":"2023-11-30T23:12:48.494540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951738+0000","last_change":"2023-11-30T23:12:47.519303+0000","last_active":"2023-11-30T23:12:48.951738+0000","last_peered":"2023-11-30T23:12:48.951738+0000","last_clean":"2023-11-30T23:12:48.951738+0000","last_became_active":"2023-11-30T23:12:47.517033+0000","last_became_peered":"2023-11-30T23:12:47.517033+0000","last_unstale":"2023-11-30T23:12:48.951738+0000","last_undegraded":"2023-11-30T23:12:48.951738+0000","last_fullsized":"2023-11-30T23:12:48.951738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950582+0000","last_change":"2023-11-30T23:12:47.143317+0000","last_active":"2023-11-30T23:12:48.950582+0000","last_peered":"2023-11-30T23:12:48.950582+0000","last_clean":"2023-11-30T23:12:48.950582+0000","last_became_active":"2023-11-30T23:12:47.143061+0000","last_became_peered":"2023-11-30T23:12:47.143061+0000","last_unstale":"2023-11-30T23:12:48.950582+0000","last_undegraded":"2023-11-30T23:12:48.950582+0000","last_fullsized":"2023-11-30T23:12:48.950582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:38.684081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.494595+0000","last_change":"2023-11-30T23:12:47.501784+0000","last_active":"2023-11-30T23:12:48.494595+0000","last_peered":"2023-11-30T23:12:48.494595+0000","last_clean":"2023-11-30T23:12:48.494595+0000","last_became_active":"2023-11-30T23:12:47.501516+0000","last_became_peered":"2023-11-30T23:12:47.501516+0000","last_unstale":"2023-11-30T23:12:48.494595+0000","last_undegraded":"2023-11-30T23:12:48.494595+0000","last_fullsized":"2023-11-30T23:12:48.494595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:34:32.232378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493069+0000","last_change":"2023-11-30T23:12:47.135053+0000","last_active":"2023-11-30T23:12:48.493069+0000","last_peered":"2023-11-30T23:12:48.493069+0000","last_clean":"2023-11-30T23:12:48.493069+0000","last_became_active":"2023-11-30T23:12:47.134776+0000","last_became_peered":"2023-11-30T23:12:47.134776+0000","last_unstale":"2023-11-30T23:12:48.493069+0000","last_undegraded":"2023-11-30T23:12:48.493069+0000","last_fullsized":"2023-11-30T23:12:48.493069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949473+0000","last_change":"2023-11-30T23:12:47.498935+0000","last_active":"2023-11-30T23:12:48.949473+0000","last_peered":"2023-11-30T23:12:48.949473+0000","last_clean":"2023-11-30T23:12:48.949473+0000","last_became_active":"2023-11-30T23:12:47.498631+0000","last_became_peered":"2023-11-30T23:12:47.498631+0000","last_unstale":"2023-11-30T23:12:48.949473+0000","last_undegraded":"2023-11-30T23:12:48.949473+0000","last_fullsized":"2023-11-30T23:12:48.949473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951298+0000","last_change":"2023-11-30T23:12:47.137707+0000","last_active":"2023-11-30T23:12:48.951298+0000","last_peered":"2023-11-30T23:12:48.951298+0000","last_clean":"2023-11-30T23:12:48.951298+0000","last_became_active":"2023-11-30T23:12:47.137406+0000","last_became_peered":"2023-11-30T23:12:47.137406+0000","last_unstale":"2023-11-30T23:12:48.951298+0000","last_undegraded":"2023-11-30T23:12:48.951298+0000","last_fullsized":"2023-11-30T23:12:48.951298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491277+0000","last_change":"2023-11-30T23:12:47.506770+0000","last_active":"2023-11-30T23:12:48.491277+0000","last_peered":"2023-11-30T23:12:48.491277+0000","last_clean":"2023-11-30T23:12:48.491277+0000","last_became_active":"2023-11-30T23:12:47.506447+0000","last_became_peered":"2023-11-30T23:12:47.506447+0000","last_unstale":"2023-11-30T23:12:48.491277+0000","last_undegraded":"2023-11-30T23:12:48.491277+0000","last_fullsized":"2023-11-30T23:12:48.491277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:35:21.183993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948253+0000","last_change":"2023-11-30T23:12:47.142532+0000","last_active":"2023-11-30T23:12:48.948253+0000","last_peered":"2023-11-30T23:12:48.948253+0000","last_clean":"2023-11-30T23:12:48.948253+0000","last_became_active":"2023-11-30T23:12:47.142135+0000","last_became_peered":"2023-11-30T23:12:47.142135+0000","last_unstale":"2023-11-30T23:12:48.948253+0000","last_undegraded":"2023-11-30T23:12:48.948253+0000","last_fullsized":"2023-11-30T23:12:48.948253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:53.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949668+0000","last_change":"2023-11-30T23:12:47.514258+0000","last_active":"2023-11-30T23:12:48.949668+0000","last_peered":"2023-11-30T23:12:48.949668+0000","last_clean":"2023-11-30T23:12:48.949668+0000","last_became_active":"2023-11-30T23:12:47.513966+0000","last_became_peered":"2023-11-30T23:12:47.513966+0000","last_unstale":"2023-11-30T23:12:48.949668+0000","last_undegraded":"2023-11-30T23:12:48.949668+0000","last_fullsized":"2023-11-30T23:12:48.949668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:02.220181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492838+0000","last_change":"2023-11-30T23:12:47.140898+0000","last_active":"2023-11-30T23:12:48.492838+0000","last_peered":"2023-11-30T23:12:48.492838+0000","last_clean":"2023-11-30T23:12:48.492838+0000","last_became_active":"2023-11-30T23:12:47.140565+0000","last_became_peered":"2023-11-30T23:12:47.140565+0000","last_unstale":"2023-11-30T23:12:48.492838+0000","last_undegraded":"2023-11-30T23:12:48.492838+0000","last_fullsized":"2023-11-30T23:12:48.492838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948628+0000","last_change":"2023-11-30T23:12:47.501516+0000","last_active":"2023-11-30T23:12:48.948628+0000","last_peered":"2023-11-30T23:12:48.948628+0000","last_clean":"2023-11-30T23:12:48.948628+0000","last_became_active":"2023-11-30T23:12:47.501315+0000","last_became_peered":"2023-11-30T23:12:47.501315+0000","last_unstale":"2023-11-30T23:12:48.948628+0000","last_undegraded":"2023-11-30T23:12:48.948628+0000","last_fullsized":"2023-11-30T23:12:48.948628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492956+0000","last_change":"2023-11-30T23:12:47.140328+0000","last_active":"2023-11-30T23:12:48.492956+0000","last_peered":"2023-11-30T23:12:48.492956+0000","last_clean":"2023-11-30T23:12:48.492956+0000","last_became_active":"2023-11-30T23:12:47.140037+0000","last_became_peered":"2023-11-30T23:12:47.140037+0000","last_unstale":"2023-11-30T23:12:48.492956+0000","last_undegraded":"2023-11-30T23:12:48.492956+0000","last_fullsized":"2023-11-30T23:12:48.492956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:38.684081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949106+0000","last_change":"2023-11-30T23:12:47.509056+0000","last_active":"2023-11-30T23:12:48.949106+0000","last_peered":"2023-11-30T23:12:48.949106+0000","last_clean":"2023-11-30T23:12:48.949106+0000","last_became_active":"2023-11-30T23:12:47.507181+0000","last_became_peered":"2023-11-30T23:12:47.507181+0000","last_unstale":"2023-11-30T23:12:48.949106+0000","last_undegraded":"2023-11-30T23:12:48.949106+0000","last_fullsized":"2023-11-30T23:12:48.949106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950357+0000","last_change":"2023-11-30T23:12:47.142027+0000","last_active":"2023-11-30T23:12:48.950357+0000","last_peered":"2023-11-30T23:12:48.950357+0000","last_clean":"2023-11-30T23:12:48.950357+0000","last_became_active":"2023-11-30T23:12:47.141664+0000","last_became_peered":"2023-11-30T23:12:47.141664+0000","last_unstale":"2023-11-30T23:12:48.950357+0000","last_undegraded":"2023-11-30T23:12:48.950357+0000","last_fullsized":"2023-11-30T23:12:48.950357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948584+0000","last_change":"2023-11-30T23:12:47.517183+0000","last_active":"2023-11-30T23:12:48.948584+0000","last_peered":"2023-11-30T23:12:48.948584+0000","last_clean":"2023-11-30T23:12:48.948584+0000","last_became_active":"2023-11-30T23:12:47.516939+0000","last_became_peered":"2023-11-30T23:12:47.516939+0000","last_unstale":"2023-11-30T23:12:48.948584+0000","last_undegraded":"2023-11-30T23:12:48.948584+0000","last_fullsized":"2023-11-30T23:12:48.948584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951672+0000","last_change":"2023-11-30T23:12:47.522937+0000","last_active":"2023-11-30T23:12:48.951672+0000","last_peered":"2023-11-30T23:12:48.951672+0000","last_clean":"2023-11-30T23:12:48.951672+0000","last_became_active":"2023-11-30T23:12:47.521310+0000","last_became_peered":"2023-11-30T23:12:47.521310+0000","last_unstale":"2023-11-30T23:12:48.951672+0000","last_undegraded":"2023-11-30T23:12:48.951672+0000","last_fullsized":"2023-11-30T23:12:48.951672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:08:47.117163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950610+0000","last_change":"2023-11-30T23:12:47.143819+0000","last_active":"2023-11-30T23:12:48.950610+0000","last_peered":"2023-11-30T23:12:48.950610+0000","last_clean":"2023-11-30T23:12:48.950610+0000","last_became_active":"2023-11-30T23:12:47.143512+0000","last_became_peered":"2023-11-30T23:12:47.143512+0000","last_unstale":"2023-11-30T23:12:48.950610+0000","last_undegraded":"2023-11-30T23:12:48.950610+0000","last_fullsized":"2023-11-30T23:12:48.950610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:35:20.171512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950946+0000","last_change":"2023-11-30T23:12:47.521920+0000","last_active":"2023-11-30T23:12:48.950946+0000","last_peered":"2023-11-30T23:12:48.950946+0000","last_clean":"2023-11-30T23:12:48.950946+0000","last_became_active":"2023-11-30T23:12:47.520322+0000","last_became_peered":"2023-11-30T23:12:47.520322+0000","last_unstale":"2023-11-30T23:12:48.950946+0000","last_undegraded":"2023-11-30T23:12:48.950946+0000","last_fullsized":"2023-11-30T23:12:48.950946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950135+0000","last_change":"2023-11-30T23:12:47.142276+0000","last_active":"2023-11-30T23:12:48.950135+0000","last_peered":"2023-11-30T23:12:48.950135+0000","last_clean":"2023-11-30T23:12:48.950135+0000","last_became_active":"2023-11-30T23:12:47.141965+0000","last_became_peered":"2023-11-30T23:12:47.141965+0000","last_unstale":"2023-11-30T23:12:48.950135+0000","last_undegraded":"2023-11-30T23:12:48.950135+0000","last_fullsized":"2023-11-30T23:12:48.950135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:28.154593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491664+0000","last_change":"2023-11-30T23:12:47.522292+0000","last_active":"2023-11-30T23:12:48.491664+0000","last_peered":"2023-11-30T23:12:48.491664+0000","last_clean":"2023-11-30T23:12:48.491664+0000","last_became_active":"2023-11-30T23:12:47.522002+0000","last_became_peered":"2023-11-30T23:12:47.522002+0000","last_unstale":"2023-11-30T23:12:48.491664+0000","last_undegraded":"2023-11-30T23:12:48.491664+0000","last_fullsized":"2023-11-30T23:12:48.491664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949635+0000","last_change":"2023-11-30T23:12:47.139186+0000","last_active":"2023-11-30T23:12:48.949635+0000","last_peered":"2023-11-30T23:12:48.949635+0000","last_clean":"2023-11-30T23:12:48.949635+0000","last_became_active":"2023-11-30T23:12:47.138275+0000","last_became_peered":"2023-11-30T23:12:47.138275+0000","last_unstale":"2023-11-30T23:12:48.949635+0000","last_undegraded":"2023-11-30T23:12:48.949635+0000","last_fullsized":"2023-11-30T23:12:48.949635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:58:25.168678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949437+0000","last_change":"2023-11-30T23:12:47.509024+0000","last_active":"2023-11-30T23:12:48.949437+0000","last_peered":"2023-11-30T23:12:48.949437+0000","last_clean":"2023-11-30T23:12:48.949437+0000","last_became_active":"2023-11-30T23:12:47.508718+0000","last_became_peered":"2023-11-30T23:12:47.508718+0000","last_unstale":"2023-11-30T23:12:48.949437+0000","last_undegraded":"2023-11-30T23:12:48.949437+0000","last_fullsized":"2023-11-30T23:12:48.949437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491906+0000","last_change":"2023-11-30T23:12:47.141150+0000","last_active":"2023-11-30T23:12:48.491906+0000","last_peered":"2023-11-30T23:12:48.491906+0000","last_clean":"2023-11-30T23:12:48.491906+0000","last_became_active":"2023-11-30T23:12:47.140891+0000","last_became_peered":"2023-11-30T23:12:47.140891+0000","last_unstale":"2023-11-30T23:12:48.491906+0000","last_undegraded":"2023-11-30T23:12:48.491906+0000","last_fullsized":"2023-11-30T23:12:48.491906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:22:48.835054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31820,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":790528,"data_stored":655548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31248,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340592,"statfs":{"total":96636764160,"available":96604766208,"internally_reserved":0,"allocated":204800,"data_stored":66162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31240,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340600,"statfs":{"total":96636764160,"available":96604774400,"internally_reserved":0,"allocated":196608,"data_stored":64688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31248,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340592,"statfs":{"total":96636764160,"available":96604766208,"internally_reserved":0,"allocated":204800,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":66162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":798720,"data_stored":655604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T23:12:51.148 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T23:12:51.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.299+0000 7fa59ffff700 1 Processor -- start 2023-11-30T23:12:51.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.299+0000 7fa59ffff700 1 -- start start 2023-11-30T23:12:51.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.299+0000 7fa59ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5a00af810 0x7fa5a00afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:51.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.299+0000 7fa59ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa5a00add80 0x7fa5a0150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:51.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.299+0000 7fa59ffff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a00b0130 con 0x7fa5a00ad940 2023-11-30T23:12:51.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.299+0000 7fa59ffff700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a00b1100 con 0x7fa5a00add80 2023-11-30T23:12:51.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.299+0000 7fa59ffff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a014a360 con 0x7fa5a00af810 2023-11-30T23:12:51.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.299+0000 7fa59effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5a00af810 0x7fa5a00afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:51.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.299+0000 7fa59f7fe700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa5a00add80 0x7fa5a0150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:51.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.299+0000 7fa59e7fc700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa5a00ad940 0x7fa5a0149c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.73:50106/0 (socket says 172.21.15.73:50106) 2023-11-30T23:12:51.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.299+0000 7fa59e7fc700 1 -- 172.21.15.73:0/3255929767 learned_addr learned my addr 172.21.15.73:0/3255929767 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:51.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.299+0000 7fa59effd700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5a00af810 0x7fa5a00afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:46556/0 (socket says 172.21.15.73:46556) 2023-11-30T23:12:51.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.299+0000 7fa59f7fe700 1 -- 172.21.15.73:0/3255929767 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5a00af810 msgr2=0x7fa5a00afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:51.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.299+0000 7fa59f7fe700 1 --2- 172.21.15.73:0/3255929767 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5a00af810 0x7fa5a00afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.299+0000 7fa59f7fe700 1 -- 172.21.15.73:0/3255929767 >> v1:172.21.15.156:6789/0 conn(0x7fa5a00ad940 legacy=0x7fa5a0149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:51.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.299+0000 7fa59f7fe700 1 -- 172.21.15.73:0/3255929767 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a00ae680 con 0x7fa5a00add80 2023-11-30T23:12:51.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.299+0000 7fa59f7fe700 1 --2- 172.21.15.73:0/3255929767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5a00add80 0x7fa5a0150fc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa590009880 tx=0x7fa590009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40567f45dc22a32e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:51.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59dffb700 1 -- 172.21.15.73:0/3255929767 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa590011830 con 0x7fa5a00add80 2023-11-30T23:12:51.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59dffb700 1 -- 172.21.15.73:0/3255929767 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa590011990 con 0x7fa5a00add80 2023-11-30T23:12:51.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59dffb700 1 -- 172.21.15.73:0/3255929767 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa590011d20 con 0x7fa5a00add80 2023-11-30T23:12:51.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59ffff700 1 -- 172.21.15.73:0/3255929767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5a00add80 msgr2=0x7fa5a0150fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:51.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59ffff700 1 --2- 172.21.15.73:0/3255929767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5a00add80 0x7fa5a0150fc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa590009880 tx=0x7fa590009b90 comp rx=0 tx=0).stop 2023-11-30T23:12:51.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59ffff700 1 -- 172.21.15.73:0/3255929767 shutdown_connections 2023-11-30T23:12:51.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59ffff700 1 --2- 172.21.15.73:0/3255929767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5a00add80 0x7fa5a0150fc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59ffff700 1 --2- 172.21.15.73:0/3255929767 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5a00af810 0x7fa5a00afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59ffff700 1 -- 172.21.15.73:0/3255929767 >> 172.21.15.73:0/3255929767 conn(0x7fa5a00b45a0 msgr2=0x7fa5a00b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:51.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59ffff700 1 -- 172.21.15.73:0/3255929767 shutdown_connections 2023-11-30T23:12:51.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59ffff700 1 -- 172.21.15.73:0/3255929767 wait complete. 2023-11-30T23:12:51.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59ffff700 1 Processor -- start 2023-11-30T23:12:51.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59ffff700 1 -- start start 2023-11-30T23:12:51.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a00ad940 0x7fa5a00b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:51.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5a00add80 0x7fa5a0142b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:51.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5a00af810 0x7fa5a0143070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:51.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59ffff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a00b68e0 con 0x7fa5a00ad940 2023-11-30T23:12:51.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59ffff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a00b79c0 con 0x7fa5a00af810 2023-11-30T23:12:51.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59ffff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a00a8880 con 0x7fa5a00add80 2023-11-30T23:12:51.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a00ad940 0x7fa5a00b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:51.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a00ad940 0x7fa5a00b63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34000/0 (socket says 172.21.15.73:34000) 2023-11-30T23:12:51.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59effd700 1 -- 172.21.15.73:0/653596599 learned_addr learned my addr 172.21.15.73:0/653596599 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:51.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59e7fc700 1 --2- 172.21.15.73:0/653596599 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5a00add80 0x7fa5a0142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:51.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59f7fe700 1 --2- 172.21.15.73:0/653596599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5a00af810 0x7fa5a0143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:51.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59e7fc700 1 -- 172.21.15.73:0/653596599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5a00af810 msgr2=0x7fa5a0143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:51.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59e7fc700 1 --2- 172.21.15.73:0/653596599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5a00af810 0x7fa5a0143070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59e7fc700 1 -- 172.21.15.73:0/653596599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a00ad940 msgr2=0x7fa5a00b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:51.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59e7fc700 1 --2- 172.21.15.73:0/653596599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a00ad940 0x7fa5a00b63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.303+0000 7fa59e7fc700 1 -- 172.21.15.73:0/653596599 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5900094b0 con 0x7fa5a00add80 2023-11-30T23:12:51.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.307+0000 7fa59e7fc700 1 --2- 172.21.15.73:0/653596599 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5a00add80 0x7fa5a0142b30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa59800cb10 tx=0x7fa59800cb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:51.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.307+0000 7fa597fff700 1 -- 172.21.15.73:0/653596599 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598007480 con 0x7fa5a00add80 2023-11-30T23:12:51.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.307+0000 7fa597fff700 1 -- 172.21.15.73:0/653596599 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5980075e0 con 0x7fa5a00add80 2023-11-30T23:12:51.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.307+0000 7fa59ffff700 1 -- 172.21.15.73:0/653596599 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a00b7180 con 0x7fa5a00add80 2023-11-30T23:12:51.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.307+0000 7fa597fff700 1 -- 172.21.15.73:0/653596599 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598007950 con 0x7fa5a00add80 2023-11-30T23:12:51.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.307+0000 7fa59ffff700 1 -- 172.21.15.73:0/653596599 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a00b7eb0 con 0x7fa5a00add80 2023-11-30T23:12:51.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.307+0000 7fa59ffff700 1 -- 172.21.15.73:0/653596599 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a004ed80 con 0x7fa5a00add80 2023-11-30T23:12:51.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.307+0000 7fa597fff700 1 -- 172.21.15.73:0/653596599 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa59801b3b0 con 0x7fa5a00add80 2023-11-30T23:12:51.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.307+0000 7fa597fff700 1 --2- 172.21.15.73:0/653596599 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa580065ad0 0x7fa580067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:51.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.307+0000 7fa597fff700 1 -- 172.21.15.73:0/653596599 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa598082930 con 0x7fa5a00add80 2023-11-30T23:12:51.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.307+0000 7fa59effd700 1 --2- 172.21.15.73:0/653596599 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa580065ad0 0x7fa580067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:51.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.311+0000 7fa59effd700 1 --2- 172.21.15.73:0/653596599 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa580065ad0 0x7fa580067f90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa588009c10 tx=0x7fa588009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:51.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.319+0000 7fa597fff700 1 -- 172.21.15.73:0/653596599 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fa598050320 con 0x7fa5a00add80 2023-11-30T23:12:51.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.479+0000 7fa59ffff700 1 -- 172.21.15.73:0/653596599 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5a00aec60 con 0x7fa580065ad0 2023-11-30T23:12:51.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.495+0000 7fa597fff700 1 -- 172.21.15.73:0/653596599 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264615 (secure 0 0 0) 0x7fa588004030 con 0x7fa580065ad0 2023-11-30T23:12:51.503 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:51.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.499+0000 7fa59ffff700 1 -- 172.21.15.73:0/653596599 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa580065ad0 msgr2=0x7fa580067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:51.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.499+0000 7fa59ffff700 1 --2- 172.21.15.73:0/653596599 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa580065ad0 0x7fa580067f90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa588009c10 tx=0x7fa588009240 comp rx=0 tx=0).stop 2023-11-30T23:12:51.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.499+0000 7fa59ffff700 1 -- 172.21.15.73:0/653596599 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5a00add80 msgr2=0x7fa5a0142b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:51.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.499+0000 7fa59ffff700 1 --2- 172.21.15.73:0/653596599 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5a00add80 0x7fa5a0142b30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa59800cb10 tx=0x7fa59800cb40 comp rx=0 tx=0).stop 2023-11-30T23:12:51.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.499+0000 7fa59ffff700 1 -- 172.21.15.73:0/653596599 shutdown_connections 2023-11-30T23:12:51.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.499+0000 7fa59ffff700 1 --2- 172.21.15.73:0/653596599 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa580065ad0 0x7fa580067f90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.499+0000 7fa59ffff700 1 --2- 172.21.15.73:0/653596599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5a00af810 0x7fa5a0143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.499+0000 7fa59ffff700 1 --2- 172.21.15.73:0/653596599 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5a00add80 0x7fa5a0142b30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.499+0000 7fa59ffff700 1 --2- 172.21.15.73:0/653596599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5a00ad940 0x7fa5a00b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.499+0000 7fa59ffff700 1 -- 172.21.15.73:0/653596599 >> 172.21.15.73:0/653596599 conn(0x7fa5a00b45a0 msgr2=0x7fa5a0149930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:51.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.499+0000 7fa59ffff700 1 -- 172.21.15.73:0/653596599 shutdown_connections 2023-11-30T23:12:51.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.499+0000 7fa59ffff700 1 -- 172.21.15.73:0/653596599 wait complete. 2023-11-30T23:12:51.508 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-11-30T23:12:51.516 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-30T23:12:50.348831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234752,"kb_used_data":2752,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739968,"statfs":{"total":773094113280,"available":772853727232,"internally_reserved":0,"allocated":2818048,"data_stored":1714844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.248072"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951239+0000","last_change":"2023-11-30T23:12:47.514628+0000","last_active":"2023-11-30T23:12:48.951239+0000","last_peered":"2023-11-30T23:12:48.951239+0000","last_clean":"2023-11-30T23:12:48.951239+0000","last_became_active":"2023-11-30T23:12:47.512980+0000","last_became_peered":"2023-11-30T23:12:47.512980+0000","last_unstale":"2023-11-30T23:12:48.951239+0000","last_undegraded":"2023-11-30T23:12:48.951239+0000","last_fullsized":"2023-11-30T23:12:48.951239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:18:44.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493012+0000","last_change":"2023-11-30T23:12:47.511277+0000","last_active":"2023-11-30T23:12:48.493012+0000","last_peered":"2023-11-30T23:12:48.493012+0000","last_clean":"2023-11-30T23:12:48.493012+0000","last_became_active":"2023-11-30T23:12:47.508771+0000","last_became_peered":"2023-11-30T23:12:47.508771+0000","last_unstale":"2023-11-30T23:12:48.493012+0000","last_undegraded":"2023-11-30T23:12:48.493012+0000","last_fullsized":"2023-11-30T23:12:48.493012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492167+0000","last_change":"2023-11-30T23:12:47.508068+0000","last_active":"2023-11-30T23:12:48.492167+0000","last_peered":"2023-11-30T23:12:48.492167+0000","last_clean":"2023-11-30T23:12:48.492167+0000","last_became_active":"2023-11-30T23:12:47.507829+0000","last_became_peered":"2023-11-30T23:12:47.507829+0000","last_unstale":"2023-11-30T23:12:48.492167+0000","last_undegraded":"2023-11-30T23:12:48.492167+0000","last_fullsized":"2023-11-30T23:12:48.492167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:39.696562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950918+0000","last_change":"2023-11-30T23:12:47.522516+0000","last_active":"2023-11-30T23:12:48.950918+0000","last_peered":"2023-11-30T23:12:48.950918+0000","last_clean":"2023-11-30T23:12:48.950918+0000","last_became_active":"2023-11-30T23:12:47.522208+0000","last_became_peered":"2023-11-30T23:12:47.522208+0000","last_unstale":"2023-11-30T23:12:48.950918+0000","last_undegraded":"2023-11-30T23:12:48.950918+0000","last_fullsized":"2023-11-30T23:12:48.950918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950044+0000","last_change":"2023-11-30T23:12:47.507130+0000","last_active":"2023-11-30T23:12:48.950044+0000","last_peered":"2023-11-30T23:12:48.950044+0000","last_clean":"2023-11-30T23:12:48.950044+0000","last_became_active":"2023-11-30T23:12:47.506816+0000","last_became_peered":"2023-11-30T23:12:47.506816+0000","last_unstale":"2023-11-30T23:12:48.950044+0000","last_undegraded":"2023-11-30T23:12:48.950044+0000","last_fullsized":"2023-11-30T23:12:48.950044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:21:32.262322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950103+0000","last_change":"2023-11-30T23:12:47.514855+0000","last_active":"2023-11-30T23:12:48.950103+0000","last_peered":"2023-11-30T23:12:48.950103+0000","last_clean":"2023-11-30T23:12:48.950103+0000","last_became_active":"2023-11-30T23:12:47.513491+0000","last_became_peered":"2023-11-30T23:12:47.513491+0000","last_unstale":"2023-11-30T23:12:48.950103+0000","last_undegraded":"2023-11-30T23:12:48.950103+0000","last_fullsized":"2023-11-30T23:12:48.950103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:18:44.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948350+0000","last_change":"2023-11-30T23:12:47.508060+0000","last_active":"2023-11-30T23:12:48.948350+0000","last_peered":"2023-11-30T23:12:48.948350+0000","last_clean":"2023-11-30T23:12:48.948350+0000","last_became_active":"2023-11-30T23:12:47.507747+0000","last_became_peered":"2023-11-30T23:12:47.507747+0000","last_unstale":"2023-11-30T23:12:48.948350+0000","last_undegraded":"2023-11-30T23:12:48.948350+0000","last_fullsized":"2023-11-30T23:12:48.948350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:27.789422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948363+0000","last_change":"2023-11-30T23:12:47.523687+0000","last_active":"2023-11-30T23:12:48.948363+0000","last_peered":"2023-11-30T23:12:48.948363+0000","last_clean":"2023-11-30T23:12:48.948363+0000","last_became_active":"2023-11-30T23:12:47.523430+0000","last_became_peered":"2023-11-30T23:12:47.523430+0000","last_unstale":"2023-11-30T23:12:48.948363+0000","last_undegraded":"2023-11-30T23:12:48.948363+0000","last_fullsized":"2023-11-30T23:12:48.948363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:26:33.640383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951748+0000","last_change":"2023-11-30T23:12:47.521698+0000","last_active":"2023-11-30T23:12:48.951748+0000","last_peered":"2023-11-30T23:12:48.951748+0000","last_clean":"2023-11-30T23:12:48.951748+0000","last_became_active":"2023-11-30T23:12:47.521393+0000","last_became_peered":"2023-11-30T23:12:47.521393+0000","last_unstale":"2023-11-30T23:12:48.951748+0000","last_undegraded":"2023-11-30T23:12:48.951748+0000","last_fullsized":"2023-11-30T23:12:48.951748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:23:17.254251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949276+0000","last_change":"2023-11-30T23:12:47.522937+0000","last_active":"2023-11-30T23:12:48.949276+0000","last_peered":"2023-11-30T23:12:48.949276+0000","last_clean":"2023-11-30T23:12:48.949276+0000","last_became_active":"2023-11-30T23:12:47.522618+0000","last_became_peered":"2023-11-30T23:12:47.522618+0000","last_unstale":"2023-11-30T23:12:48.949276+0000","last_undegraded":"2023-11-30T23:12:48.949276+0000","last_fullsized":"2023-11-30T23:12:48.949276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950146+0000","last_change":"2023-11-30T23:12:47.522869+0000","last_active":"2023-11-30T23:12:48.950146+0000","last_peered":"2023-11-30T23:12:48.950146+0000","last_clean":"2023-11-30T23:12:48.950146+0000","last_became_active":"2023-11-30T23:12:47.522552+0000","last_became_peered":"2023-11-30T23:12:47.522552+0000","last_unstale":"2023-11-30T23:12:48.950146+0000","last_undegraded":"2023-11-30T23:12:48.950146+0000","last_fullsized":"2023-11-30T23:12:48.950146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952576+0000","last_change":"2023-11-30T23:12:47.513660+0000","last_active":"2023-11-30T23:12:48.952576+0000","last_peered":"2023-11-30T23:12:48.952576+0000","last_clean":"2023-11-30T23:12:48.952576+0000","last_became_active":"2023-11-30T23:12:47.513401+0000","last_became_peered":"2023-11-30T23:12:47.513401+0000","last_unstale":"2023-11-30T23:12:48.952576+0000","last_undegraded":"2023-11-30T23:12:48.952576+0000","last_fullsized":"2023-11-30T23:12:48.952576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:22.086661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948954+0000","last_change":"2023-11-30T23:12:47.513995+0000","last_active":"2023-11-30T23:12:48.948954+0000","last_peered":"2023-11-30T23:12:48.948954+0000","last_clean":"2023-11-30T23:12:48.948954+0000","last_became_active":"2023-11-30T23:12:47.513714+0000","last_became_peered":"2023-11-30T23:12:47.513714+0000","last_unstale":"2023-11-30T23:12:48.948954+0000","last_undegraded":"2023-11-30T23:12:48.948954+0000","last_fullsized":"2023-11-30T23:12:48.948954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:20:31.102899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491646+0000","last_change":"2023-11-30T23:12:47.507240+0000","last_active":"2023-11-30T23:12:48.491646+0000","last_peered":"2023-11-30T23:12:48.491646+0000","last_clean":"2023-11-30T23:12:48.491646+0000","last_became_active":"2023-11-30T23:12:47.506967+0000","last_became_peered":"2023-11-30T23:12:47.506967+0000","last_unstale":"2023-11-30T23:12:48.491646+0000","last_undegraded":"2023-11-30T23:12:48.491646+0000","last_fullsized":"2023-11-30T23:12:48.491646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492735+0000","last_change":"2023-11-30T23:12:47.513430+0000","last_active":"2023-11-30T23:12:48.492735+0000","last_peered":"2023-11-30T23:12:48.492735+0000","last_clean":"2023-11-30T23:12:48.492735+0000","last_became_active":"2023-11-30T23:12:47.513018+0000","last_became_peered":"2023-11-30T23:12:47.513018+0000","last_unstale":"2023-11-30T23:12:48.492735+0000","last_undegraded":"2023-11-30T23:12:48.492735+0000","last_fullsized":"2023-11-30T23:12:48.492735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948206+0000","last_change":"2023-11-30T23:12:47.521933+0000","last_active":"2023-11-30T23:12:48.948206+0000","last_peered":"2023-11-30T23:12:48.948206+0000","last_clean":"2023-11-30T23:12:48.948206+0000","last_became_active":"2023-11-30T23:12:47.520518+0000","last_became_peered":"2023-11-30T23:12:47.520518+0000","last_unstale":"2023-11-30T23:12:48.948206+0000","last_undegraded":"2023-11-30T23:12:48.948206+0000","last_fullsized":"2023-11-30T23:12:48.948206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:27.789422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.953013+0000","last_change":"2023-11-30T23:12:47.516657+0000","last_active":"2023-11-30T23:12:48.953013+0000","last_peered":"2023-11-30T23:12:48.953013+0000","last_clean":"2023-11-30T23:12:48.953013+0000","last_became_active":"2023-11-30T23:12:47.516382+0000","last_became_peered":"2023-11-30T23:12:47.516382+0000","last_unstale":"2023-11-30T23:12:48.953013+0000","last_undegraded":"2023-11-30T23:12:48.953013+0000","last_fullsized":"2023-11-30T23:12:48.953013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:54:46.925262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.494119+0000","last_change":"2023-11-30T23:12:47.509616+0000","last_active":"2023-11-30T23:12:48.494119+0000","last_peered":"2023-11-30T23:12:48.494119+0000","last_clean":"2023-11-30T23:12:48.494119+0000","last_became_active":"2023-11-30T23:12:47.509340+0000","last_became_peered":"2023-11-30T23:12:47.509340+0000","last_unstale":"2023-11-30T23:12:48.494119+0000","last_undegraded":"2023-11-30T23:12:48.494119+0000","last_fullsized":"2023-11-30T23:12:48.494119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:29.167074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950366+0000","last_change":"2023-11-30T23:12:47.507039+0000","last_active":"2023-11-30T23:12:48.950366+0000","last_peered":"2023-11-30T23:12:48.950366+0000","last_clean":"2023-11-30T23:12:48.950366+0000","last_became_active":"2023-11-30T23:12:47.506733+0000","last_became_peered":"2023-11-30T23:12:47.506733+0000","last_unstale":"2023-11-30T23:12:48.950366+0000","last_undegraded":"2023-11-30T23:12:48.950366+0000","last_fullsized":"2023-11-30T23:12:48.950366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949761+0000","last_change":"2023-11-30T23:12:47.522534+0000","last_active":"2023-11-30T23:12:48.949761+0000","last_peered":"2023-11-30T23:12:48.949761+0000","last_clean":"2023-11-30T23:12:48.949761+0000","last_became_active":"2023-11-30T23:12:47.518819+0000","last_became_peered":"2023-11-30T23:12:47.518819+0000","last_unstale":"2023-11-30T23:12:48.949761+0000","last_undegraded":"2023-11-30T23:12:48.949761+0000","last_fullsized":"2023-11-30T23:12:48.949761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491549+0000","last_change":"2023-11-30T23:12:47.514472+0000","last_active":"2023-11-30T23:12:48.491549+0000","last_peered":"2023-11-30T23:12:48.491549+0000","last_clean":"2023-11-30T23:12:48.491549+0000","last_became_active":"2023-11-30T23:12:47.514223+0000","last_became_peered":"2023-11-30T23:12:47.514223+0000","last_unstale":"2023-11-30T23:12:48.491549+0000","last_undegraded":"2023-11-30T23:12:48.491549+0000","last_fullsized":"2023-11-30T23:12:48.491549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:34:32.232378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950329+0000","last_change":"2023-11-30T23:12:47.520514+0000","last_active":"2023-11-30T23:12:48.950329+0000","last_peered":"2023-11-30T23:12:48.950329+0000","last_clean":"2023-11-30T23:12:48.950329+0000","last_became_active":"2023-11-30T23:12:47.520228+0000","last_became_peered":"2023-11-30T23:12:47.520228+0000","last_unstale":"2023-11-30T23:12:48.950329+0000","last_undegraded":"2023-11-30T23:12:48.950329+0000","last_fullsized":"2023-11-30T23:12:48.950329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:26:06.870586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948524+0000","last_change":"2023-11-30T23:12:47.515492+0000","last_active":"2023-11-30T23:12:48.948524+0000","last_peered":"2023-11-30T23:12:48.948524+0000","last_clean":"2023-11-30T23:12:48.948524+0000","last_became_active":"2023-11-30T23:12:47.515247+0000","last_became_peered":"2023-11-30T23:12:47.515247+0000","last_unstale":"2023-11-30T23:12:48.948524+0000","last_undegraded":"2023-11-30T23:12:48.948524+0000","last_fullsized":"2023-11-30T23:12:48.948524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948562+0000","last_change":"2023-11-30T23:12:47.511363+0000","last_active":"2023-11-30T23:12:48.948562+0000","last_peered":"2023-11-30T23:12:48.948562+0000","last_clean":"2023-11-30T23:12:48.948562+0000","last_became_active":"2023-11-30T23:12:47.511097+0000","last_became_peered":"2023-11-30T23:12:47.511097+0000","last_unstale":"2023-11-30T23:12:48.948562+0000","last_undegraded":"2023-11-30T23:12:48.948562+0000","last_fullsized":"2023-11-30T23:12:48.948562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949389+0000","last_change":"2023-11-30T23:12:47.510657+0000","last_active":"2023-11-30T23:12:48.949389+0000","last_peered":"2023-11-30T23:12:48.949389+0000","last_clean":"2023-11-30T23:12:48.949389+0000","last_became_active":"2023-11-30T23:12:47.510404+0000","last_became_peered":"2023-11-30T23:12:47.510404+0000","last_unstale":"2023-11-30T23:12:48.949389+0000","last_undegraded":"2023-11-30T23:12:48.949389+0000","last_fullsized":"2023-11-30T23:12:48.949389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949508+0000","last_change":"2023-11-30T23:12:47.516808+0000","last_active":"2023-11-30T23:12:48.949508+0000","last_peered":"2023-11-30T23:12:48.949508+0000","last_clean":"2023-11-30T23:12:48.949508+0000","last_became_active":"2023-11-30T23:12:47.516539+0000","last_became_peered":"2023-11-30T23:12:47.516539+0000","last_unstale":"2023-11-30T23:12:48.949508+0000","last_undegraded":"2023-11-30T23:12:48.949508+0000","last_fullsized":"2023-11-30T23:12:48.949508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493067+0000","last_change":"2023-11-30T23:12:47.506558+0000","last_active":"2023-11-30T23:12:48.493067+0000","last_peered":"2023-11-30T23:12:48.493067+0000","last_clean":"2023-11-30T23:12:48.493067+0000","last_became_active":"2023-11-30T23:12:47.506284+0000","last_became_peered":"2023-11-30T23:12:47.506284+0000","last_unstale":"2023-11-30T23:12:48.493067+0000","last_undegraded":"2023-11-30T23:12:48.493067+0000","last_fullsized":"2023-11-30T23:12:48.493067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949214+0000","last_change":"2023-11-30T23:12:47.512060+0000","last_active":"2023-11-30T23:12:48.949214+0000","last_peered":"2023-11-30T23:12:48.949214+0000","last_clean":"2023-11-30T23:12:48.949214+0000","last_became_active":"2023-11-30T23:12:47.511800+0000","last_became_peered":"2023-11-30T23:12:47.511800+0000","last_unstale":"2023-11-30T23:12:48.949214+0000","last_undegraded":"2023-11-30T23:12:48.949214+0000","last_fullsized":"2023-11-30T23:12:48.949214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491631+0000","last_change":"2023-11-30T23:12:47.513225+0000","last_active":"2023-11-30T23:12:48.491631+0000","last_peered":"2023-11-30T23:12:48.491631+0000","last_clean":"2023-11-30T23:12:48.491631+0000","last_became_active":"2023-11-30T23:12:47.512978+0000","last_became_peered":"2023-11-30T23:12:47.512978+0000","last_unstale":"2023-11-30T23:12:48.491631+0000","last_undegraded":"2023-11-30T23:12:48.491631+0000","last_fullsized":"2023-11-30T23:12:48.491631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950359+0000","last_change":"2023-11-30T23:12:47.511972+0000","last_active":"2023-11-30T23:12:48.950359+0000","last_peered":"2023-11-30T23:12:48.950359+0000","last_clean":"2023-11-30T23:12:48.950359+0000","last_became_active":"2023-11-30T23:12:47.511699+0000","last_became_peered":"2023-11-30T23:12:47.511699+0000","last_unstale":"2023-11-30T23:12:48.950359+0000","last_undegraded":"2023-11-30T23:12:48.950359+0000","last_fullsized":"2023-11-30T23:12:48.950359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493146+0000","last_change":"2023-11-30T23:12:47.521874+0000","last_active":"2023-11-30T23:12:48.493146+0000","last_peered":"2023-11-30T23:12:48.493146+0000","last_clean":"2023-11-30T23:12:48.493146+0000","last_became_active":"2023-11-30T23:12:47.521604+0000","last_became_peered":"2023-11-30T23:12:47.521604+0000","last_unstale":"2023-11-30T23:12:48.493146+0000","last_undegraded":"2023-11-30T23:12:48.493146+0000","last_fullsized":"2023-11-30T23:12:48.493146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:02.220181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948617+0000","last_change":"2023-11-30T23:12:47.517728+0000","last_active":"2023-11-30T23:12:48.948617+0000","last_peered":"2023-11-30T23:12:48.948617+0000","last_clean":"2023-11-30T23:12:48.948617+0000","last_became_active":"2023-11-30T23:12:47.517283+0000","last_became_peered":"2023-11-30T23:12:47.517283+0000","last_unstale":"2023-11-30T23:12:48.948617+0000","last_undegraded":"2023-11-30T23:12:48.948617+0000","last_fullsized":"2023-11-30T23:12:48.948617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949668+0000","last_change":"2023-11-30T23:12:47.509055+0000","last_active":"2023-11-30T23:12:48.949668+0000","last_peered":"2023-11-30T23:12:48.949668+0000","last_clean":"2023-11-30T23:12:48.949668+0000","last_became_active":"2023-11-30T23:12:47.508725+0000","last_became_peered":"2023-11-30T23:12:47.508725+0000","last_unstale":"2023-11-30T23:12:48.949668+0000","last_undegraded":"2023-11-30T23:12:48.949668+0000","last_fullsized":"2023-11-30T23:12:48.949668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:54.893320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949177+0000","last_change":"2023-11-30T23:12:47.139071+0000","last_active":"2023-11-30T23:12:48.949177+0000","last_peered":"2023-11-30T23:12:48.949177+0000","last_clean":"2023-11-30T23:12:48.949177+0000","last_became_active":"2023-11-30T23:12:47.138768+0000","last_became_peered":"2023-11-30T23:12:47.138768+0000","last_unstale":"2023-11-30T23:12:48.949177+0000","last_undegraded":"2023-11-30T23:12:48.949177+0000","last_fullsized":"2023-11-30T23:12:48.949177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491791+0000","last_change":"2023-11-30T23:12:47.516574+0000","last_active":"2023-11-30T23:12:48.491791+0000","last_peered":"2023-11-30T23:12:48.491791+0000","last_clean":"2023-11-30T23:12:48.491791+0000","last_became_active":"2023-11-30T23:12:47.516214+0000","last_became_peered":"2023-11-30T23:12:47.516214+0000","last_unstale":"2023-11-30T23:12:48.491791+0000","last_undegraded":"2023-11-30T23:12:48.491791+0000","last_fullsized":"2023-11-30T23:12:48.491791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948803+0000","last_change":"2023-11-30T23:12:47.130416+0000","last_active":"2023-11-30T23:12:48.948803+0000","last_peered":"2023-11-30T23:12:48.948803+0000","last_clean":"2023-11-30T23:12:48.948803+0000","last_became_active":"2023-11-30T23:12:47.129771+0000","last_became_peered":"2023-11-30T23:12:47.129771+0000","last_unstale":"2023-11-30T23:12:48.948803+0000","last_undegraded":"2023-11-30T23:12:48.948803+0000","last_fullsized":"2023-11-30T23:12:48.948803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948794+0000","last_change":"2023-11-30T23:12:47.133733+0000","last_active":"2023-11-30T23:12:48.948794+0000","last_peered":"2023-11-30T23:12:48.948794+0000","last_clean":"2023-11-30T23:12:48.948794+0000","last_became_active":"2023-11-30T23:12:47.133440+0000","last_became_peered":"2023-11-30T23:12:47.133440+0000","last_unstale":"2023-11-30T23:12:48.948794+0000","last_undegraded":"2023-11-30T23:12:48.948794+0000","last_fullsized":"2023-11-30T23:12:48.948794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:48.913175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948507+0000","last_change":"2023-11-30T23:12:47.507868+0000","last_active":"2023-11-30T23:12:48.948507+0000","last_peered":"2023-11-30T23:12:48.948507+0000","last_clean":"2023-11-30T23:12:48.948507+0000","last_became_active":"2023-11-30T23:12:47.507617+0000","last_became_peered":"2023-11-30T23:12:47.507617+0000","last_unstale":"2023-11-30T23:12:48.948507+0000","last_undegraded":"2023-11-30T23:12:48.948507+0000","last_fullsized":"2023-11-30T23:12:48.948507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:08:47.117163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948855+0000","last_change":"2023-11-30T23:12:47.132638+0000","last_active":"2023-11-30T23:12:48.948855+0000","last_peered":"2023-11-30T23:12:48.948855+0000","last_clean":"2023-11-30T23:12:48.948855+0000","last_became_active":"2023-11-30T23:12:47.132351+0000","last_became_peered":"2023-11-30T23:12:47.132351+0000","last_unstale":"2023-11-30T23:12:48.948855+0000","last_undegraded":"2023-11-30T23:12:48.948855+0000","last_fullsized":"2023-11-30T23:12:48.948855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492595+0000","last_change":"2023-11-30T23:12:47.506332+0000","last_active":"2023-11-30T23:12:48.492595+0000","last_peered":"2023-11-30T23:12:48.492595+0000","last_clean":"2023-11-30T23:12:48.492595+0000","last_became_active":"2023-11-30T23:12:47.506082+0000","last_became_peered":"2023-11-30T23:12:47.506082+0000","last_unstale":"2023-11-30T23:12:48.492595+0000","last_undegraded":"2023-11-30T23:12:48.492595+0000","last_fullsized":"2023-11-30T23:12:48.492595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951065+0000","last_change":"2023-11-30T23:12:47.139722+0000","last_active":"2023-11-30T23:12:48.951065+0000","last_peered":"2023-11-30T23:12:48.951065+0000","last_clean":"2023-11-30T23:12:48.951065+0000","last_became_active":"2023-11-30T23:12:47.139400+0000","last_became_peered":"2023-11-30T23:12:47.139400+0000","last_unstale":"2023-11-30T23:12:48.951065+0000","last_undegraded":"2023-11-30T23:12:48.951065+0000","last_fullsized":"2023-11-30T23:12:48.951065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952521+0000","last_change":"2023-11-30T23:12:47.520429+0000","last_active":"2023-11-30T23:12:48.952521+0000","last_peered":"2023-11-30T23:12:48.952521+0000","last_clean":"2023-11-30T23:12:48.952521+0000","last_became_active":"2023-11-30T23:12:47.520153+0000","last_became_peered":"2023-11-30T23:12:47.520153+0000","last_unstale":"2023-11-30T23:12:48.952521+0000","last_undegraded":"2023-11-30T23:12:48.952521+0000","last_fullsized":"2023-11-30T23:12:48.952521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:17:01.774183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952510+0000","last_change":"2023-11-30T23:12:47.139328+0000","last_active":"2023-11-30T23:12:48.952510+0000","last_peered":"2023-11-30T23:12:48.952510+0000","last_clean":"2023-11-30T23:12:48.952510+0000","last_became_active":"2023-11-30T23:12:47.139047+0000","last_became_peered":"2023-11-30T23:12:47.139047+0000","last_unstale":"2023-11-30T23:12:48.952510+0000","last_undegraded":"2023-11-30T23:12:48.952510+0000","last_fullsized":"2023-11-30T23:12:48.952510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491614+0000","last_change":"2023-11-30T23:12:47.522974+0000","last_active":"2023-11-30T23:12:48.491614+0000","last_peered":"2023-11-30T23:12:48.491614+0000","last_clean":"2023-11-30T23:12:48.491614+0000","last_became_active":"2023-11-30T23:12:47.522711+0000","last_became_peered":"2023-11-30T23:12:47.522711+0000","last_unstale":"2023-11-30T23:12:48.491614+0000","last_undegraded":"2023-11-30T23:12:48.491614+0000","last_fullsized":"2023-11-30T23:12:48.491614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:19:43.387626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493283+0000","last_change":"2023-11-30T23:12:47.140794+0000","last_active":"2023-11-30T23:12:48.493283+0000","last_peered":"2023-11-30T23:12:48.493283+0000","last_clean":"2023-11-30T23:12:48.493283+0000","last_became_active":"2023-11-30T23:12:47.140531+0000","last_became_peered":"2023-11-30T23:12:47.140531+0000","last_unstale":"2023-11-30T23:12:48.493283+0000","last_undegraded":"2023-11-30T23:12:48.493283+0000","last_fullsized":"2023-11-30T23:12:48.493283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:53.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952707+0000","last_change":"2023-11-30T23:12:47.517475+0000","last_active":"2023-11-30T23:12:48.952707+0000","last_peered":"2023-11-30T23:12:48.952707+0000","last_clean":"2023-11-30T23:12:48.952707+0000","last_became_active":"2023-11-30T23:12:47.513983+0000","last_became_peered":"2023-11-30T23:12:47.513983+0000","last_unstale":"2023-11-30T23:12:48.952707+0000","last_undegraded":"2023-11-30T23:12:48.952707+0000","last_fullsized":"2023-11-30T23:12:48.952707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:39.696562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949883+0000","last_change":"2023-11-30T23:12:47.140168+0000","last_active":"2023-11-30T23:12:48.949883+0000","last_peered":"2023-11-30T23:12:48.949883+0000","last_clean":"2023-11-30T23:12:48.949883+0000","last_became_active":"2023-11-30T23:12:47.139799+0000","last_became_peered":"2023-11-30T23:12:47.139799+0000","last_unstale":"2023-11-30T23:12:48.949883+0000","last_undegraded":"2023-11-30T23:12:48.949883+0000","last_fullsized":"2023-11-30T23:12:48.949883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949684+0000","last_change":"2023-11-30T23:12:47.503606+0000","last_active":"2023-11-30T23:12:48.949684+0000","last_peered":"2023-11-30T23:12:48.949684+0000","last_clean":"2023-11-30T23:12:48.949684+0000","last_became_active":"2023-11-30T23:12:47.503333+0000","last_became_peered":"2023-11-30T23:12:47.503333+0000","last_unstale":"2023-11-30T23:12:48.949684+0000","last_undegraded":"2023-11-30T23:12:48.949684+0000","last_fullsized":"2023-11-30T23:12:48.949684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491844+0000","last_change":"2023-11-30T23:12:47.136931+0000","last_active":"2023-11-30T23:12:48.491844+0000","last_peered":"2023-11-30T23:12:48.491844+0000","last_clean":"2023-11-30T23:12:48.491844+0000","last_became_active":"2023-11-30T23:12:47.136620+0000","last_became_peered":"2023-11-30T23:12:47.136620+0000","last_unstale":"2023-11-30T23:12:48.491844+0000","last_undegraded":"2023-11-30T23:12:48.491844+0000","last_fullsized":"2023-11-30T23:12:48.491844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:22:43.069951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491335+0000","last_change":"2023-11-30T23:12:47.503541+0000","last_active":"2023-11-30T23:12:48.491335+0000","last_peered":"2023-11-30T23:12:48.491335+0000","last_clean":"2023-11-30T23:12:48.491335+0000","last_became_active":"2023-11-30T23:12:47.503294+0000","last_became_peered":"2023-11-30T23:12:47.503294+0000","last_unstale":"2023-11-30T23:12:48.491335+0000","last_undegraded":"2023-11-30T23:12:48.491335+0000","last_fullsized":"2023-11-30T23:12:48.491335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950583+0000","last_change":"2023-11-30T23:12:47.140575+0000","last_active":"2023-11-30T23:12:48.950583+0000","last_peered":"2023-11-30T23:12:48.950583+0000","last_clean":"2023-11-30T23:12:48.950583+0000","last_became_active":"2023-11-30T23:12:47.140125+0000","last_became_peered":"2023-11-30T23:12:47.140125+0000","last_unstale":"2023-11-30T23:12:48.950583+0000","last_undegraded":"2023-11-30T23:12:48.950583+0000","last_fullsized":"2023-11-30T23:12:48.950583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950166+0000","last_change":"2023-11-30T23:12:47.515720+0000","last_active":"2023-11-30T23:12:48.950166+0000","last_peered":"2023-11-30T23:12:48.950166+0000","last_clean":"2023-11-30T23:12:48.950166+0000","last_became_active":"2023-11-30T23:12:47.515427+0000","last_became_peered":"2023-11-30T23:12:47.515427+0000","last_unstale":"2023-11-30T23:12:48.950166+0000","last_undegraded":"2023-11-30T23:12:48.950166+0000","last_fullsized":"2023-11-30T23:12:48.950166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:26:06.870586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949198+0000","last_change":"2023-11-30T23:12:47.129492+0000","last_active":"2023-11-30T23:12:48.949198+0000","last_peered":"2023-11-30T23:12:48.949198+0000","last_clean":"2023-11-30T23:12:48.949198+0000","last_became_active":"2023-11-30T23:12:47.129180+0000","last_became_peered":"2023-11-30T23:12:47.129180+0000","last_unstale":"2023-11-30T23:12:48.949198+0000","last_undegraded":"2023-11-30T23:12:48.949198+0000","last_fullsized":"2023-11-30T23:12:48.949198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948802+0000","last_change":"2023-11-30T23:12:47.517541+0000","last_active":"2023-11-30T23:12:48.948802+0000","last_peered":"2023-11-30T23:12:48.948802+0000","last_clean":"2023-11-30T23:12:48.948802+0000","last_became_active":"2023-11-30T23:12:47.516980+0000","last_became_peered":"2023-11-30T23:12:47.516980+0000","last_unstale":"2023-11-30T23:12:48.948802+0000","last_undegraded":"2023-11-30T23:12:48.948802+0000","last_fullsized":"2023-11-30T23:12:48.948802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492929+0000","last_change":"2023-11-30T23:12:47.129703+0000","last_active":"2023-11-30T23:12:48.492929+0000","last_peered":"2023-11-30T23:12:48.492929+0000","last_clean":"2023-11-30T23:12:48.492929+0000","last_became_active":"2023-11-30T23:12:47.129349+0000","last_became_peered":"2023-11-30T23:12:47.129349+0000","last_unstale":"2023-11-30T23:12:48.492929+0000","last_undegraded":"2023-11-30T23:12:48.492929+0000","last_fullsized":"2023-11-30T23:12:48.492929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949277+0000","last_change":"2023-11-30T23:12:47.514610+0000","last_active":"2023-11-30T23:12:48.949277+0000","last_peered":"2023-11-30T23:12:48.949277+0000","last_clean":"2023-11-30T23:12:48.949277+0000","last_became_active":"2023-11-30T23:12:47.514140+0000","last_became_peered":"2023-11-30T23:12:47.514140+0000","last_unstale":"2023-11-30T23:12:48.949277+0000","last_undegraded":"2023-11-30T23:12:48.949277+0000","last_fullsized":"2023-11-30T23:12:48.949277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:54:46.925262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952235+0000","last_change":"2023-11-30T23:12:47.136924+0000","last_active":"2023-11-30T23:12:48.952235+0000","last_peered":"2023-11-30T23:12:48.952235+0000","last_clean":"2023-11-30T23:12:48.952235+0000","last_became_active":"2023-11-30T23:12:47.136631+0000","last_became_peered":"2023-11-30T23:12:47.136631+0000","last_unstale":"2023-11-30T23:12:48.952235+0000","last_undegraded":"2023-11-30T23:12:48.952235+0000","last_fullsized":"2023-11-30T23:12:48.952235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:22:48.835054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950899+0000","last_change":"2023-11-30T23:12:47.514450+0000","last_active":"2023-11-30T23:12:48.950899+0000","last_peered":"2023-11-30T23:12:48.950899+0000","last_clean":"2023-11-30T23:12:48.950899+0000","last_became_active":"2023-11-30T23:12:47.514053+0000","last_became_peered":"2023-11-30T23:12:47.514053+0000","last_unstale":"2023-11-30T23:12:48.950899+0000","last_undegraded":"2023-11-30T23:12:48.950899+0000","last_fullsized":"2023-11-30T23:12:48.950899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.494177+0000","last_change":"2023-11-30T23:12:47.138008+0000","last_active":"2023-11-30T23:12:48.494177+0000","last_peered":"2023-11-30T23:12:48.494177+0000","last_clean":"2023-11-30T23:12:48.494177+0000","last_became_active":"2023-11-30T23:12:47.137695+0000","last_became_peered":"2023-11-30T23:12:47.137695+0000","last_unstale":"2023-11-30T23:12:48.494177+0000","last_undegraded":"2023-11-30T23:12:48.494177+0000","last_fullsized":"2023-11-30T23:12:48.494177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951499+0000","last_change":"2023-11-30T23:12:47.516065+0000","last_active":"2023-11-30T23:12:48.951499+0000","last_peered":"2023-11-30T23:12:48.951499+0000","last_clean":"2023-11-30T23:12:48.951499+0000","last_became_active":"2023-11-30T23:12:47.514822+0000","last_became_peered":"2023-11-30T23:12:47.514822+0000","last_unstale":"2023-11-30T23:12:48.951499+0000","last_undegraded":"2023-11-30T23:12:48.951499+0000","last_fullsized":"2023-11-30T23:12:48.951499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:02:36.020857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493499+0000","last_change":"2023-11-30T23:12:47.129184+0000","last_active":"2023-11-30T23:12:48.493499+0000","last_peered":"2023-11-30T23:12:48.493499+0000","last_clean":"2023-11-30T23:12:48.493499+0000","last_became_active":"2023-11-30T23:12:47.128682+0000","last_became_peered":"2023-11-30T23:12:47.128682+0000","last_unstale":"2023-11-30T23:12:48.493499+0000","last_undegraded":"2023-11-30T23:12:48.493499+0000","last_fullsized":"2023-11-30T23:12:48.493499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952861+0000","last_change":"2023-11-30T23:12:47.516581+0000","last_active":"2023-11-30T23:12:48.952861+0000","last_peered":"2023-11-30T23:12:48.952861+0000","last_clean":"2023-11-30T23:12:48.952861+0000","last_became_active":"2023-11-30T23:12:47.516317+0000","last_became_peered":"2023-11-30T23:12:47.516317+0000","last_unstale":"2023-11-30T23:12:48.952861+0000","last_undegraded":"2023-11-30T23:12:48.952861+0000","last_fullsized":"2023-11-30T23:12:48.952861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:20:31.102899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493457+0000","last_change":"2023-11-30T23:12:47.140679+0000","last_active":"2023-11-30T23:12:48.493457+0000","last_peered":"2023-11-30T23:12:48.493457+0000","last_clean":"2023-11-30T23:12:48.493457+0000","last_became_active":"2023-11-30T23:12:47.140400+0000","last_became_peered":"2023-11-30T23:12:47.140400+0000","last_unstale":"2023-11-30T23:12:48.493457+0000","last_undegraded":"2023-11-30T23:12:48.493457+0000","last_fullsized":"2023-11-30T23:12:48.493457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949914+0000","last_change":"2023-11-30T23:12:47.521764+0000","last_active":"2023-11-30T23:12:48.949914+0000","last_peered":"2023-11-30T23:12:48.949914+0000","last_clean":"2023-11-30T23:12:48.949914+0000","last_became_active":"2023-11-30T23:12:47.521481+0000","last_became_peered":"2023-11-30T23:12:47.521481+0000","last_unstale":"2023-11-30T23:12:48.949914+0000","last_undegraded":"2023-11-30T23:12:48.949914+0000","last_fullsized":"2023-11-30T23:12:48.949914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:17:01.774183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-30T23:12:47.490864+0000","last_change":"2023-11-30T23:12:36.558633+0000","last_active":"2023-11-30T23:12:47.490864+0000","last_peered":"2023-11-30T23:12:47.490864+0000","last_clean":"2023-11-30T23:12:47.490864+0000","last_became_active":"2023-11-30T23:12:36.556455+0000","last_became_peered":"2023-11-30T23:12:36.556455+0000","last_unstale":"2023-11-30T23:12:47.490864+0000","last_undegraded":"2023-11-30T23:12:47.490864+0000","last_fullsized":"2023-11-30T23:12:47.490864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:34.652815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:34.652815+0000","last_clean_scrub_stamp":"2023-11-30T23:12:34.652815+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:36:52.941511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948996+0000","last_change":"2023-11-30T23:12:47.132985+0000","last_active":"2023-11-30T23:12:48.948996+0000","last_peered":"2023-11-30T23:12:48.948996+0000","last_clean":"2023-11-30T23:12:48.948996+0000","last_became_active":"2023-11-30T23:12:47.132365+0000","last_became_peered":"2023-11-30T23:12:47.132365+0000","last_unstale":"2023-11-30T23:12:48.948996+0000","last_undegraded":"2023-11-30T23:12:48.948996+0000","last_fullsized":"2023-11-30T23:12:48.948996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949001+0000","last_change":"2023-11-30T23:12:47.509943+0000","last_active":"2023-11-30T23:12:48.949001+0000","last_peered":"2023-11-30T23:12:48.949001+0000","last_clean":"2023-11-30T23:12:48.949001+0000","last_became_active":"2023-11-30T23:12:47.508677+0000","last_became_peered":"2023-11-30T23:12:47.508677+0000","last_unstale":"2023-11-30T23:12:48.949001+0000","last_undegraded":"2023-11-30T23:12:48.949001+0000","last_fullsized":"2023-11-30T23:12:48.949001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948349+0000","last_change":"2023-11-30T23:12:47.148775+0000","last_active":"2023-11-30T23:12:48.948349+0000","last_peered":"2023-11-30T23:12:48.948349+0000","last_clean":"2023-11-30T23:12:48.948349+0000","last_became_active":"2023-11-30T23:12:47.148547+0000","last_became_peered":"2023-11-30T23:12:47.148547+0000","last_unstale":"2023-11-30T23:12:48.948349+0000","last_undegraded":"2023-11-30T23:12:48.948349+0000","last_fullsized":"2023-11-30T23:12:48.948349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:01.207700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.490955+0000","last_change":"2023-11-30T23:12:47.515805+0000","last_active":"2023-11-30T23:12:48.490955+0000","last_peered":"2023-11-30T23:12:48.490955+0000","last_clean":"2023-11-30T23:12:48.490955+0000","last_became_active":"2023-11-30T23:12:47.515553+0000","last_became_peered":"2023-11-30T23:12:47.515553+0000","last_unstale":"2023-11-30T23:12:48.490955+0000","last_undegraded":"2023-11-30T23:12:48.490955+0000","last_fullsized":"2023-11-30T23:12:48.490955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:22.086661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493249+0000","last_change":"2023-11-30T23:12:47.136018+0000","last_active":"2023-11-30T23:12:48.493249+0000","last_peered":"2023-11-30T23:12:48.493249+0000","last_clean":"2023-11-30T23:12:48.493249+0000","last_became_active":"2023-11-30T23:12:47.135746+0000","last_became_peered":"2023-11-30T23:12:47.135746+0000","last_unstale":"2023-11-30T23:12:48.493249+0000","last_undegraded":"2023-11-30T23:12:48.493249+0000","last_fullsized":"2023-11-30T23:12:48.493249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492802+0000","last_change":"2023-11-30T23:12:47.513832+0000","last_active":"2023-11-30T23:12:48.492802+0000","last_peered":"2023-11-30T23:12:48.492802+0000","last_clean":"2023-11-30T23:12:48.492802+0000","last_became_active":"2023-11-30T23:12:47.510024+0000","last_became_peered":"2023-11-30T23:12:47.510024+0000","last_unstale":"2023-11-30T23:12:48.492802+0000","last_undegraded":"2023-11-30T23:12:48.492802+0000","last_fullsized":"2023-11-30T23:12:48.492802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950516+0000","last_change":"2023-11-30T23:12:47.141605+0000","last_active":"2023-11-30T23:12:48.950516+0000","last_peered":"2023-11-30T23:12:48.950516+0000","last_clean":"2023-11-30T23:12:48.950516+0000","last_became_active":"2023-11-30T23:12:47.141115+0000","last_became_peered":"2023-11-30T23:12:47.141115+0000","last_unstale":"2023-11-30T23:12:48.950516+0000","last_undegraded":"2023-11-30T23:12:48.950516+0000","last_fullsized":"2023-11-30T23:12:48.950516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951647+0000","last_change":"2023-11-30T23:12:47.514830+0000","last_active":"2023-11-30T23:12:48.951647+0000","last_peered":"2023-11-30T23:12:48.951647+0000","last_clean":"2023-11-30T23:12:48.951647+0000","last_became_active":"2023-11-30T23:12:47.514572+0000","last_became_peered":"2023-11-30T23:12:47.514572+0000","last_unstale":"2023-11-30T23:12:48.951647+0000","last_undegraded":"2023-11-30T23:12:48.951647+0000","last_fullsized":"2023-11-30T23:12:48.951647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:29.167074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.494540+0000","last_change":"2023-11-30T23:12:47.141801+0000","last_active":"2023-11-30T23:12:48.494540+0000","last_peered":"2023-11-30T23:12:48.494540+0000","last_clean":"2023-11-30T23:12:48.494540+0000","last_became_active":"2023-11-30T23:12:47.141411+0000","last_became_peered":"2023-11-30T23:12:47.141411+0000","last_unstale":"2023-11-30T23:12:48.494540+0000","last_undegraded":"2023-11-30T23:12:48.494540+0000","last_fullsized":"2023-11-30T23:12:48.494540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951738+0000","last_change":"2023-11-30T23:12:47.519303+0000","last_active":"2023-11-30T23:12:48.951738+0000","last_peered":"2023-11-30T23:12:48.951738+0000","last_clean":"2023-11-30T23:12:48.951738+0000","last_became_active":"2023-11-30T23:12:47.517033+0000","last_became_peered":"2023-11-30T23:12:47.517033+0000","last_unstale":"2023-11-30T23:12:48.951738+0000","last_undegraded":"2023-11-30T23:12:48.951738+0000","last_fullsized":"2023-11-30T23:12:48.951738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950582+0000","last_change":"2023-11-30T23:12:47.143317+0000","last_active":"2023-11-30T23:12:48.950582+0000","last_peered":"2023-11-30T23:12:48.950582+0000","last_clean":"2023-11-30T23:12:48.950582+0000","last_became_active":"2023-11-30T23:12:47.143061+0000","last_became_peered":"2023-11-30T23:12:47.143061+0000","last_unstale":"2023-11-30T23:12:48.950582+0000","last_undegraded":"2023-11-30T23:12:48.950582+0000","last_fullsized":"2023-11-30T23:12:48.950582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:38.684081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.494595+0000","last_change":"2023-11-30T23:12:47.501784+0000","last_active":"2023-11-30T23:12:48.494595+0000","last_peered":"2023-11-30T23:12:48.494595+0000","last_clean":"2023-11-30T23:12:48.494595+0000","last_became_active":"2023-11-30T23:12:47.501516+0000","last_became_peered":"2023-11-30T23:12:47.501516+0000","last_unstale":"2023-11-30T23:12:48.494595+0000","last_undegraded":"2023-11-30T23:12:48.494595+0000","last_fullsized":"2023-11-30T23:12:48.494595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:34:32.232378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493069+0000","last_change":"2023-11-30T23:12:47.135053+0000","last_active":"2023-11-30T23:12:48.493069+0000","last_peered":"2023-11-30T23:12:48.493069+0000","last_clean":"2023-11-30T23:12:48.493069+0000","last_became_active":"2023-11-30T23:12:47.134776+0000","last_became_peered":"2023-11-30T23:12:47.134776+0000","last_unstale":"2023-11-30T23:12:48.493069+0000","last_undegraded":"2023-11-30T23:12:48.493069+0000","last_fullsized":"2023-11-30T23:12:48.493069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949473+0000","last_change":"2023-11-30T23:12:47.498935+0000","last_active":"2023-11-30T23:12:48.949473+0000","last_peered":"2023-11-30T23:12:48.949473+0000","last_clean":"2023-11-30T23:12:48.949473+0000","last_became_active":"2023-11-30T23:12:47.498631+0000","last_became_peered":"2023-11-30T23:12:47.498631+0000","last_unstale":"2023-11-30T23:12:48.949473+0000","last_undegraded":"2023-11-30T23:12:48.949473+0000","last_fullsized":"2023-11-30T23:12:48.949473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951298+0000","last_change":"2023-11-30T23:12:47.137707+0000","last_active":"2023-11-30T23:12:48.951298+0000","last_peered":"2023-11-30T23:12:48.951298+0000","last_clean":"2023-11-30T23:12:48.951298+0000","last_became_active":"2023-11-30T23:12:47.137406+0000","last_became_peered":"2023-11-30T23:12:47.137406+0000","last_unstale":"2023-11-30T23:12:48.951298+0000","last_undegraded":"2023-11-30T23:12:48.951298+0000","last_fullsized":"2023-11-30T23:12:48.951298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491277+0000","last_change":"2023-11-30T23:12:47.506770+0000","last_active":"2023-11-30T23:12:48.491277+0000","last_peered":"2023-11-30T23:12:48.491277+0000","last_clean":"2023-11-30T23:12:48.491277+0000","last_became_active":"2023-11-30T23:12:47.506447+0000","last_became_peered":"2023-11-30T23:12:47.506447+0000","last_unstale":"2023-11-30T23:12:48.491277+0000","last_undegraded":"2023-11-30T23:12:48.491277+0000","last_fullsized":"2023-11-30T23:12:48.491277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:35:21.183993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948253+0000","last_change":"2023-11-30T23:12:47.142532+0000","last_active":"2023-11-30T23:12:48.948253+0000","last_peered":"2023-11-30T23:12:48.948253+0000","last_clean":"2023-11-30T23:12:48.948253+0000","last_became_active":"2023-11-30T23:12:47.142135+0000","last_became_peered":"2023-11-30T23:12:47.142135+0000","last_unstale":"2023-11-30T23:12:48.948253+0000","last_undegraded":"2023-11-30T23:12:48.948253+0000","last_fullsized":"2023-11-30T23:12:48.948253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:53.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949668+0000","last_change":"2023-11-30T23:12:47.514258+0000","last_active":"2023-11-30T23:12:48.949668+0000","last_peered":"2023-11-30T23:12:48.949668+0000","last_clean":"2023-11-30T23:12:48.949668+0000","last_became_active":"2023-11-30T23:12:47.513966+0000","last_became_peered":"2023-11-30T23:12:47.513966+0000","last_unstale":"2023-11-30T23:12:48.949668+0000","last_undegraded":"2023-11-30T23:12:48.949668+0000","last_fullsized":"2023-11-30T23:12:48.949668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:02.220181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492838+0000","last_change":"2023-11-30T23:12:47.140898+0000","last_active":"2023-11-30T23:12:48.492838+0000","last_peered":"2023-11-30T23:12:48.492838+0000","last_clean":"2023-11-30T23:12:48.492838+0000","last_became_active":"2023-11-30T23:12:47.140565+0000","last_became_peered":"2023-11-30T23:12:47.140565+0000","last_unstale":"2023-11-30T23:12:48.492838+0000","last_undegraded":"2023-11-30T23:12:48.492838+0000","last_fullsized":"2023-11-30T23:12:48.492838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948628+0000","last_change":"2023-11-30T23:12:47.501516+0000","last_active":"2023-11-30T23:12:48.948628+0000","last_peered":"2023-11-30T23:12:48.948628+0000","last_clean":"2023-11-30T23:12:48.948628+0000","last_became_active":"2023-11-30T23:12:47.501315+0000","last_became_peered":"2023-11-30T23:12:47.501315+0000","last_unstale":"2023-11-30T23:12:48.948628+0000","last_undegraded":"2023-11-30T23:12:48.948628+0000","last_fullsized":"2023-11-30T23:12:48.948628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492956+0000","last_change":"2023-11-30T23:12:47.140328+0000","last_active":"2023-11-30T23:12:48.492956+0000","last_peered":"2023-11-30T23:12:48.492956+0000","last_clean":"2023-11-30T23:12:48.492956+0000","last_became_active":"2023-11-30T23:12:47.140037+0000","last_became_peered":"2023-11-30T23:12:47.140037+0000","last_unstale":"2023-11-30T23:12:48.492956+0000","last_undegraded":"2023-11-30T23:12:48.492956+0000","last_fullsized":"2023-11-30T23:12:48.492956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:38.684081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949106+0000","last_change":"2023-11-30T23:12:47.509056+0000","last_active":"2023-11-30T23:12:48.949106+0000","last_peered":"2023-11-30T23:12:48.949106+0000","last_clean":"2023-11-30T23:12:48.949106+0000","last_became_active":"2023-11-30T23:12:47.507181+0000","last_became_peered":"2023-11-30T23:12:47.507181+0000","last_unstale":"2023-11-30T23:12:48.949106+0000","last_undegraded":"2023-11-30T23:12:48.949106+0000","last_fullsized":"2023-11-30T23:12:48.949106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950357+0000","last_change":"2023-11-30T23:12:47.142027+0000","last_active":"2023-11-30T23:12:48.950357+0000","last_peered":"2023-11-30T23:12:48.950357+0000","last_clean":"2023-11-30T23:12:48.950357+0000","last_became_active":"2023-11-30T23:12:47.141664+0000","last_became_peered":"2023-11-30T23:12:47.141664+0000","last_unstale":"2023-11-30T23:12:48.950357+0000","last_undegraded":"2023-11-30T23:12:48.950357+0000","last_fullsized":"2023-11-30T23:12:48.950357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948584+0000","last_change":"2023-11-30T23:12:47.517183+0000","last_active":"2023-11-30T23:12:48.948584+0000","last_peered":"2023-11-30T23:12:48.948584+0000","last_clean":"2023-11-30T23:12:48.948584+0000","last_became_active":"2023-11-30T23:12:47.516939+0000","last_became_peered":"2023-11-30T23:12:47.516939+0000","last_unstale":"2023-11-30T23:12:48.948584+0000","last_undegraded":"2023-11-30T23:12:48.948584+0000","last_fullsized":"2023-11-30T23:12:48.948584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951672+0000","last_change":"2023-11-30T23:12:47.522937+0000","last_active":"2023-11-30T23:12:48.951672+0000","last_peered":"2023-11-30T23:12:48.951672+0000","last_clean":"2023-11-30T23:12:48.951672+0000","last_became_active":"2023-11-30T23:12:47.521310+0000","last_became_peered":"2023-11-30T23:12:47.521310+0000","last_unstale":"2023-11-30T23:12:48.951672+0000","last_undegraded":"2023-11-30T23:12:48.951672+0000","last_fullsized":"2023-11-30T23:12:48.951672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:08:47.117163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950610+0000","last_change":"2023-11-30T23:12:47.143819+0000","last_active":"2023-11-30T23:12:48.950610+0000","last_peered":"2023-11-30T23:12:48.950610+0000","last_clean":"2023-11-30T23:12:48.950610+0000","last_became_active":"2023-11-30T23:12:47.143512+0000","last_became_peered":"2023-11-30T23:12:47.143512+0000","last_unstale":"2023-11-30T23:12:48.950610+0000","last_undegraded":"2023-11-30T23:12:48.950610+0000","last_fullsized":"2023-11-30T23:12:48.950610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:35:20.171512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950946+0000","last_change":"2023-11-30T23:12:47.521920+0000","last_active":"2023-11-30T23:12:48.950946+0000","last_peered":"2023-11-30T23:12:48.950946+0000","last_clean":"2023-11-30T23:12:48.950946+0000","last_became_active":"2023-11-30T23:12:47.520322+0000","last_became_peered":"2023-11-30T23:12:47.520322+0000","last_unstale":"2023-11-30T23:12:48.950946+0000","last_undegraded":"2023-11-30T23:12:48.950946+0000","last_fullsized":"2023-11-30T23:12:48.950946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950135+0000","last_change":"2023-11-30T23:12:47.142276+0000","last_active":"2023-11-30T23:12:48.950135+0000","last_peered":"2023-11-30T23:12:48.950135+0000","last_clean":"2023-11-30T23:12:48.950135+0000","last_became_active":"2023-11-30T23:12:47.141965+0000","last_became_peered":"2023-11-30T23:12:47.141965+0000","last_unstale":"2023-11-30T23:12:48.950135+0000","last_undegraded":"2023-11-30T23:12:48.950135+0000","last_fullsized":"2023-11-30T23:12:48.950135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:28.154593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491664+0000","last_change":"2023-11-30T23:12:47.522292+0000","last_active":"2023-11-30T23:12:48.491664+0000","last_peered":"2023-11-30T23:12:48.491664+0000","last_clean":"2023-11-30T23:12:48.491664+0000","last_became_active":"2023-11-30T23:12:47.522002+0000","last_became_peered":"2023-11-30T23:12:47.522002+0000","last_unstale":"2023-11-30T23:12:48.491664+0000","last_undegraded":"2023-11-30T23:12:48.491664+0000","last_fullsized":"2023-11-30T23:12:48.491664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949635+0000","last_change":"2023-11-30T23:12:47.139186+0000","last_active":"2023-11-30T23:12:48.949635+0000","last_peered":"2023-11-30T23:12:48.949635+0000","last_clean":"2023-11-30T23:12:48.949635+0000","last_became_active":"2023-11-30T23:12:47.138275+0000","last_became_peered":"2023-11-30T23:12:47.138275+0000","last_unstale":"2023-11-30T23:12:48.949635+0000","last_undegraded":"2023-11-30T23:12:48.949635+0000","last_fullsized":"2023-11-30T23:12:48.949635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:58:25.168678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949437+0000","last_change":"2023-11-30T23:12:47.509024+0000","last_active":"2023-11-30T23:12:48.949437+0000","last_peered":"2023-11-30T23:12:48.949437+0000","last_clean":"2023-11-30T23:12:48.949437+0000","last_became_active":"2023-11-30T23:12:47.508718+0000","last_became_peered":"2023-11-30T23:12:47.508718+0000","last_unstale":"2023-11-30T23:12:48.949437+0000","last_undegraded":"2023-11-30T23:12:48.949437+0000","last_fullsized":"2023-11-30T23:12:48.949437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491906+0000","last_change":"2023-11-30T23:12:47.141150+0000","last_active":"2023-11-30T23:12:48.491906+0000","last_peered":"2023-11-30T23:12:48.491906+0000","last_clean":"2023-11-30T23:12:48.491906+0000","last_became_active":"2023-11-30T23:12:47.140891+0000","last_became_peered":"2023-11-30T23:12:47.140891+0000","last_unstale":"2023-11-30T23:12:48.491906+0000","last_undegraded":"2023-11-30T23:12:48.491906+0000","last_fullsized":"2023-11-30T23:12:48.491906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:22:48.835054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31820,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":790528,"data_stored":655548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31248,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340592,"statfs":{"total":96636764160,"available":96604766208,"internally_reserved":0,"allocated":204800,"data_stored":66162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31240,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340600,"statfs":{"total":96636764160,"available":96604774400,"internally_reserved":0,"allocated":196608,"data_stored":64688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31248,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340592,"statfs":{"total":96636764160,"available":96604766208,"internally_reserved":0,"allocated":204800,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":66162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":798720,"data_stored":655604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T23:12:51.520 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-30T23:12:51.521 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-30T23:12:51.521 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-30T23:12:51.521 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-30T23:12:51.522 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-30T23:12:51.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c37621700 1 Processor -- start 2023-11-30T23:12:51.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c37621700 1 -- start start 2023-11-30T23:12:51.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c37621700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7c300b1ee0 0x7f7c301449d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:51.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c37621700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c300af890 con 0x7f7c300aec00 2023-11-30T23:12:51.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c37621700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c300b0450 con 0x7f7c300b86c0 2023-11-30T23:12:51.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c37621700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c300b0df0 con 0x7f7c300b1ee0 2023-11-30T23:12:51.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c35bbe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7c300aec00 0x7f7c30144f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37042/0 (socket says 172.21.15.73:37042) 2023-11-30T23:12:51.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c35bbe700 1 -- 172.21.15.73:0/3071293633 learned_addr learned my addr 172.21.15.73:0/3071293633 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:51.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c34bbc700 1 --2- 172.21.15.73:0/3071293633 >> v2:172.21.15.156:3300/0 conn(0x7f7c300b1ee0 0x7f7c301449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:51.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c23fff700 1 -- 172.21.15.73:0/3071293633 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326587455 0 0) 0x7f7c300af890 con 0x7f7c300aec00 2023-11-30T23:12:51.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c23fff700 1 -- 172.21.15.73:0/3071293633 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c1c0035d0 con 0x7f7c300aec00 2023-11-30T23:12:51.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c23fff700 1 -- 172.21.15.73:0/3071293633 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346768416 0 0) 0x7f7c300b0450 con 0x7f7c300b86c0 2023-11-30T23:12:51.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c23fff700 1 -- 172.21.15.73:0/3071293633 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c300af890 con 0x7f7c300b86c0 2023-11-30T23:12:51.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c34bbc700 1 -- 172.21.15.73:0/3071293633 >> v1:172.21.15.156:6789/0 conn(0x7f7c300b86c0 legacy=0x7f7c300af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:51.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c34bbc700 1 -- 172.21.15.73:0/3071293633 >> v1:172.21.15.73:6789/0 conn(0x7f7c300aec00 legacy=0x7f7c30144f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:51.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c23fff700 1 -- 172.21.15.73:0/3071293633 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2658667198 0 0) 0x7f7c1c0035d0 con 0x7f7c300aec00 2023-11-30T23:12:51.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c34bbc700 1 -- 172.21.15.73:0/3071293633 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c300b8aa0 con 0x7f7c300b1ee0 2023-11-30T23:12:51.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c34bbc700 1 --2- 172.21.15.73:0/3071293633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c300b1ee0 0x7f7c301449d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009850 tx=0x7f7c24009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0fa2f102e698d59 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:51.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c23fff700 1 -- 172.21.15.73:0/3071293633 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c0016c0 con 0x7f7c300b1ee0 2023-11-30T23:12:51.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c23fff700 1 -- 172.21.15.73:0/3071293633 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c24004030 con 0x7f7c300b1ee0 2023-11-30T23:12:51.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.627+0000 7f7c23fff700 1 -- 172.21.15.73:0/3071293633 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240043c0 con 0x7f7c300b1ee0 2023-11-30T23:12:51.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c37621700 1 -- 172.21.15.73:0/3071293633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c300b1ee0 msgr2=0x7f7c301449d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:51.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c37621700 1 --2- 172.21.15.73:0/3071293633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c300b1ee0 0x7f7c301449d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009850 tx=0x7f7c24009b60 comp rx=0 tx=0).stop 2023-11-30T23:12:51.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c37621700 1 -- 172.21.15.73:0/3071293633 shutdown_connections 2023-11-30T23:12:51.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c37621700 1 --2- 172.21.15.73:0/3071293633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c300b1ee0 0x7f7c301449d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c37621700 1 -- 172.21.15.73:0/3071293633 >> 172.21.15.73:0/3071293633 conn(0x7f7c3006a7b0 msgr2=0x7f7c300b7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:51.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c37621700 1 -- 172.21.15.73:0/3071293633 shutdown_connections 2023-11-30T23:12:51.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c37621700 1 -- 172.21.15.73:0/3071293633 wait complete. 2023-11-30T23:12:51.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c37621700 1 Processor -- start 2023-11-30T23:12:51.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c37621700 1 -- start start 2023-11-30T23:12:51.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c37621700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c300aec00 0x7f7c3006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:51.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c37621700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c300b1ee0 0x7f7c3006fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:51.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c37621700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c300b86c0 0x7f7c301e0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:51.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c37621700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3006f390 con 0x7f7c300b1ee0 2023-11-30T23:12:51.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c37621700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c30149ca0 con 0x7f7c300b86c0 2023-11-30T23:12:51.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c37621700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c301dfd20 con 0x7f7c300aec00 2023-11-30T23:12:51.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c34bbc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c300b1ee0 0x7f7c3006fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:51.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c34bbc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c300b1ee0 0x7f7c3006fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34006/0 (socket says 172.21.15.73:34006) 2023-11-30T23:12:51.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c35bbe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c300b86c0 0x7f7c301e0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:51.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c34bbc700 1 -- 172.21.15.73:0/61920509 learned_addr learned my addr 172.21.15.73:0/61920509 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:51.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c353bd700 1 --2- 172.21.15.73:0/61920509 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c300aec00 0x7f7c3006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:51.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c34bbc700 1 -- 172.21.15.73:0/61920509 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c300aec00 msgr2=0x7f7c3006ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:51.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c34bbc700 1 --2- 172.21.15.73:0/61920509 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c300aec00 0x7f7c3006ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c34bbc700 1 -- 172.21.15.73:0/61920509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c300b86c0 msgr2=0x7f7c301e0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:51.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c34bbc700 1 --2- 172.21.15.73:0/61920509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c300b86c0 0x7f7c301e0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.631+0000 7f7c34bbc700 1 -- 172.21.15.73:0/61920509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c240094b0 con 0x7f7c300b1ee0 2023-11-30T23:12:51.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.635+0000 7f7c34bbc700 1 --2- 172.21.15.73:0/61920509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c300b1ee0 0x7f7c3006fbe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c300b8e40 tx=0x7f7c24004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:51.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.635+0000 7f7c21ffb700 1 -- 172.21.15.73:0/61920509 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24011630 con 0x7f7c300b1ee0 2023-11-30T23:12:51.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.635+0000 7f7c21ffb700 1 -- 172.21.15.73:0/61920509 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2401f070 con 0x7f7c300b1ee0 2023-11-30T23:12:51.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.635+0000 7f7c37621700 1 -- 172.21.15.73:0/61920509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c301dffc0 con 0x7f7c300b1ee0 2023-11-30T23:12:51.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.635+0000 7f7c21ffb700 1 -- 172.21.15.73:0/61920509 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240119d0 con 0x7f7c300b1ee0 2023-11-30T23:12:51.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.635+0000 7f7c37621700 1 -- 172.21.15.73:0/61920509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3014bce0 con 0x7f7c300b1ee0 2023-11-30T23:12:51.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.635+0000 7f7c37621700 1 -- 172.21.15.73:0/61920509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3004ed80 con 0x7f7c300b1ee0 2023-11-30T23:12:51.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.635+0000 7f7c21ffb700 1 -- 172.21.15.73:0/61920509 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7c24011b30 con 0x7f7c300b1ee0 2023-11-30T23:12:51.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.639+0000 7f7c21ffb700 1 --2- 172.21.15.73:0/61920509 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7c14065ad0 0x7f7c14067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:51.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.639+0000 7f7c21ffb700 1 -- 172.21.15.73:0/61920509 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c24021070 con 0x7f7c300b1ee0 2023-11-30T23:12:51.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.639+0000 7f7c353bd700 1 --2- 172.21.15.73:0/61920509 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7c14065ad0 0x7f7c14067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:51.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.639+0000 7f7c353bd700 1 --2- 172.21.15.73:0/61920509 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7c14065ad0 0x7f7c14067f90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7c28001560 tx=0x7f7c28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:51.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.643+0000 7f7c21ffb700 1 -- 172.21.15.73:0/61920509 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f7c24052310 con 0x7f7c300b1ee0 2023-11-30T23:12:51.683 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:12:51.686 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:12:51.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.851+0000 7f7c37621700 1 -- 172.21.15.73:0/61920509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7c300b0b80 con 0x7f7c300b1ee0 2023-11-30T23:12:51.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.859+0000 7f7c21ffb700 1 -- 172.21.15.73:0/61920509 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163361 (secure 0 0 0) 0x7f7c24055930 con 0x7f7c300b1ee0 2023-11-30T23:12:51.863 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:51.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.863+0000 7f7c37621700 1 -- 172.21.15.73:0/61920509 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7c14065ad0 msgr2=0x7f7c14067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:51.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.863+0000 7f7c37621700 1 --2- 172.21.15.73:0/61920509 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7c14065ad0 0x7f7c14067f90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7c28001560 tx=0x7f7c28009040 comp rx=0 tx=0).stop 2023-11-30T23:12:51.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.863+0000 7f7c37621700 1 -- 172.21.15.73:0/61920509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c300b1ee0 msgr2=0x7f7c3006fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:51.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.863+0000 7f7c37621700 1 --2- 172.21.15.73:0/61920509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c300b1ee0 0x7f7c3006fbe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c300b8e40 tx=0x7f7c24004770 comp rx=0 tx=0).stop 2023-11-30T23:12:51.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.863+0000 7f7c37621700 1 -- 172.21.15.73:0/61920509 shutdown_connections 2023-11-30T23:12:51.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.863+0000 7f7c37621700 1 --2- 172.21.15.73:0/61920509 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7c14065ad0 0x7f7c14067f90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.863+0000 7f7c37621700 1 --2- 172.21.15.73:0/61920509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c300b86c0 0x7f7c301e0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.863+0000 7f7c37621700 1 --2- 172.21.15.73:0/61920509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c300b1ee0 0x7f7c3006fbe0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.863+0000 7f7c37621700 1 --2- 172.21.15.73:0/61920509 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7c300aec00 0x7f7c3006ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:51.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.863+0000 7f7c37621700 1 -- 172.21.15.73:0/61920509 >> 172.21.15.73:0/61920509 conn(0x7f7c3006a7b0 msgr2=0x7f7c301447a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:51.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.863+0000 7f7c37621700 1 -- 172.21.15.73:0/61920509 shutdown_connections 2023-11-30T23:12:51.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.863+0000 7f7c37621700 1 -- 172.21.15.73:0/61920509 wait complete. 2023-11-30T23:12:51.886 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":36559},{"type":"v1","addr":"172.21.15.73:6833","nonce":36559}]},"active_addr":"172.21.15.73:6833/36559","active_change":"2023-11-30T23:12:28.331926+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3254063293}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":96674514}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3191558438}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1962912587}]}]} 2023-11-30T23:12:51.890 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-30T23:12:51.890 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-30T23:12:51.890 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T23:12:52.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5be367700 1 Processor -- start 2023-11-30T23:12:52.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5be367700 1 -- start start 2023-11-30T23:12:52.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5be367700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb5b813d070 0x7fb5b813d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5be367700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5b8146990 0x7fb5b8146e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5be367700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b806f210 con 0x7fb5b80b2710 2023-11-30T23:12:52.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5be367700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b80afe30 con 0x7fb5b813d070 2023-11-30T23:12:52.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5be367700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b8147360 con 0x7fb5b8146990 2023-11-30T23:12:52.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5bdb66700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5b8146990 0x7fb5b8146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5bcb64700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb5b813d070 0x7fb5b813d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5bcb64700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb5b813d070 0x7fb5b813d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:49976/0 (socket says 172.21.15.73:49976) 2023-11-30T23:12:52.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5bdb66700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5b8146990 0x7fb5b8146e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:46580/0 (socket says 172.21.15.73:46580) 2023-11-30T23:12:52.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5bd365700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb5b80b2710 0x7fb5b80aefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.73:50124/0 (socket says 172.21.15.73:50124) 2023-11-30T23:12:52.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5bcb64700 1 -- 172.21.15.73:0/3532669105 learned_addr learned my addr 172.21.15.73:0/3532669105 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5bdb66700 1 -- 172.21.15.73:0/3532669105 >> v2:172.21.15.156:3300/0 conn(0x7fb5b813d070 msgr2=0x7fb5b813d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:52.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5affff700 1 -- 172.21.15.73:0/3532669105 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737610450 0 0) 0x7fb5b806f210 con 0x7fb5b80b2710 2023-11-30T23:12:52.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5bdb66700 1 --2- 172.21.15.73:0/3532669105 >> v2:172.21.15.156:3300/0 conn(0x7fb5b813d070 0x7fb5b813d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5bdb66700 1 -- 172.21.15.73:0/3532669105 >> v1:172.21.15.156:6789/0 conn(0x7fb5b80b2710 legacy=0x7fb5b80aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5bdb66700 1 -- 172.21.15.73:0/3532669105 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b80b2af0 con 0x7fb5b8146990 2023-11-30T23:12:52.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5bcb64700 1 --2- 172.21.15.73:0/3532669105 >> v2:172.21.15.156:3300/0 conn(0x7fb5b813d070 0x7fb5b813d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:52.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5bdb66700 1 --2- 172.21.15.73:0/3532669105 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5b8146990 0x7fb5b8146e20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0009d90 tx=0x7fb5b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dd2d3902138211 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5affff700 1 -- 172.21.15.73:0/3532669105 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b000e070 con 0x7fb5b8146990 2023-11-30T23:12:52.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5affff700 1 -- 172.21.15.73:0/3532669105 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b000bb20 con 0x7fb5b8146990 2023-11-30T23:12:52.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:51.999+0000 7fb5affff700 1 -- 172.21.15.73:0/3532669105 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0012430 con 0x7fb5b8146990 2023-11-30T23:12:52.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5be367700 1 -- 172.21.15.73:0/3532669105 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5b8146990 msgr2=0x7fb5b8146e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5be367700 1 --2- 172.21.15.73:0/3532669105 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5b8146990 0x7fb5b8146e20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0009d90 tx=0x7fb5b000b330 comp rx=0 tx=0).stop 2023-11-30T23:12:52.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5be367700 1 -- 172.21.15.73:0/3532669105 shutdown_connections 2023-11-30T23:12:52.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5be367700 1 --2- 172.21.15.73:0/3532669105 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5b8146990 0x7fb5b8146e20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5be367700 1 --2- 172.21.15.73:0/3532669105 >> v2:172.21.15.156:3300/0 conn(0x7fb5b813d070 0x7fb5b813d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5be367700 1 -- 172.21.15.73:0/3532669105 >> 172.21.15.73:0/3532669105 conn(0x7fb5b80b45a0 msgr2=0x7fb5b80b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5be367700 1 -- 172.21.15.73:0/3532669105 shutdown_connections 2023-11-30T23:12:52.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5be367700 1 -- 172.21.15.73:0/3532669105 wait complete. 2023-11-30T23:12:52.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5be367700 1 Processor -- start 2023-11-30T23:12:52.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5be367700 1 -- start start 2023-11-30T23:12:52.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5be367700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5b80b2710 0x7fb5b812b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5be367700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5b813d070 0x7fb5b8142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5be367700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5b8146990 0x7fb5b81dcb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5be367700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b8143430 con 0x7fb5b8146990 2023-11-30T23:12:52.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5be367700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b8141100 con 0x7fb5b80b2710 2023-11-30T23:12:52.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5be367700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b8140c80 con 0x7fb5b813d070 2023-11-30T23:12:52.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5bdb66700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5b8146990 0x7fb5b81dcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5bd365700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5b80b2710 0x7fb5b812b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5bcb64700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5b813d070 0x7fb5b8142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5bdb66700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5b8146990 0x7fb5b81dcb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34018/0 (socket says 172.21.15.73:34018) 2023-11-30T23:12:52.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5bdb66700 1 -- 172.21.15.73:0/2057042017 learned_addr learned my addr 172.21.15.73:0/2057042017 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5bd365700 1 -- 172.21.15.73:0/2057042017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5b813d070 msgr2=0x7fb5b8142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5bd365700 1 --2- 172.21.15.73:0/2057042017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5b813d070 0x7fb5b8142300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5bd365700 1 -- 172.21.15.73:0/2057042017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5b8146990 msgr2=0x7fb5b81dcb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5bd365700 1 --2- 172.21.15.73:0/2057042017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5b8146990 0x7fb5b81dcb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.003+0000 7fb5bd365700 1 -- 172.21.15.73:0/2057042017 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a8009570 con 0x7fb5b80b2710 2023-11-30T23:12:52.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.007+0000 7fb5bd365700 1 --2- 172.21.15.73:0/2057042017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5b80b2710 0x7fb5b812b710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40011e0 tx=0x7fb5b400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.007+0000 7fb5adffb700 1 -- 172.21.15.73:0/2057042017 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4004ca0 con 0x7fb5b80b2710 2023-11-30T23:12:52.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.007+0000 7fb5adffb700 1 -- 172.21.15.73:0/2057042017 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b4004e00 con 0x7fb5b80b2710 2023-11-30T23:12:52.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.007+0000 7fb5be367700 1 -- 172.21.15.73:0/2057042017 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b0009a70 con 0x7fb5b80b2710 2023-11-30T23:12:52.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.007+0000 7fb5adffb700 1 -- 172.21.15.73:0/2057042017 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4007310 con 0x7fb5b80b2710 2023-11-30T23:12:52.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.007+0000 7fb5be367700 1 -- 172.21.15.73:0/2057042017 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b8143680 con 0x7fb5b80b2710 2023-11-30T23:12:52.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.007+0000 7fb5be367700 1 -- 172.21.15.73:0/2057042017 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b806ed00 con 0x7fb5b80b2710 2023-11-30T23:12:52.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.007+0000 7fb5adffb700 1 -- 172.21.15.73:0/2057042017 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb5b4007470 con 0x7fb5b80b2710 2023-11-30T23:12:52.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.007+0000 7fb5adffb700 1 --2- 172.21.15.73:0/2057042017 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb59c065ad0 0x7fb59c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.007+0000 7fb5adffb700 1 -- 172.21.15.73:0/2057042017 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5b4082c40 con 0x7fb5b80b2710 2023-11-30T23:12:52.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.011+0000 7fb5bcb64700 1 --2- 172.21.15.73:0/2057042017 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb59c065ad0 0x7fb59c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.011+0000 7fb5bcb64700 1 --2- 172.21.15.73:0/2057042017 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb59c065ad0 0x7fb59c067f90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb5b81347d0 tx=0x7fb5a80092e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.019+0000 7fb5adffb700 1 -- 172.21.15.73:0/2057042017 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fb5b4050690 con 0x7fb5b80b2710 2023-11-30T23:12:52.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.187+0000 7fb5be367700 1 -- 172.21.15.73:0/2057042017 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5b8133420 con 0x7fb5b80b2710 2023-11-30T23:12:52.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.191+0000 7fb5adffb700 1 -- 172.21.15.73:0/2057042017 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7fb5b4053cb0 con 0x7fb5b80b2710 2023-11-30T23:12:52.195 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:52.195 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"a677cb6a-4a54-4567-a30d-f0fa4bc22b17","created":"2023-11-30T23:12:23.260968+0000","modified":"2023-11-30T23:12:48.484283+0000","last_up_change":"2023-11-30T23:12:33.649318+0000","last_in_change":"2023-11-30T23:12:25.326689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-30T23:12:34.413317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-30T23:12:45.403156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-30T23:12:46.475384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbf1c93f-0775-4780-8524-cf25792d9aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36686},{"type":"v1","addr":"172.21.15.73:6817","nonce":36686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36686},{"type":"v1","addr":"172.21.15.73:6819","nonce":36686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36686},{"type":"v1","addr":"172.21.15.73:6823","nonce":36686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36686},{"type":"v1","addr":"172.21.15.73:6821","nonce":36686}]},"public_addr":"172.21.15.73:6817/36686","cluster_addr":"172.21.15.73:6819/36686","heartbeat_back_addr":"172.21.15.73:6823/36686","heartbeat_front_addr":"172.21.15.73:6821/36686","state":["exists","up"]},{"osd":1,"uuid":"9d9dd122-9a42-4588-a0d2-50d13b13eba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36687},{"type":"v1","addr":"172.21.15.73:6809","nonce":36687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":36687},{"type":"v1","addr":"172.21.15.73:6811","nonce":36687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36687},{"type":"v1","addr":"172.21.15.73:6815","nonce":36687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36687},{"type":"v1","addr":"172.21.15.73:6813","nonce":36687}]},"public_addr":"172.21.15.73:6809/36687","cluster_addr":"172.21.15.73:6811/36687","heartbeat_back_addr":"172.21.15.73:6815/36687","heartbeat_front_addr":"172.21.15.73:6813/36687","state":["exists","up"]},{"osd":2,"uuid":"68ff4f1e-ec45-42e0-bb83-fe03598e4940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36688},{"type":"v1","addr":"172.21.15.73:6825","nonce":36688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36688},{"type":"v1","addr":"172.21.15.73:6827","nonce":36688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36688},{"type":"v1","addr":"172.21.15.73:6831","nonce":36688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36688},{"type":"v1","addr":"172.21.15.73:6829","nonce":36688}]},"public_addr":"172.21.15.73:6825/36688","cluster_addr":"172.21.15.73:6827/36688","heartbeat_back_addr":"172.21.15.73:6831/36688","heartbeat_front_addr":"172.21.15.73:6829/36688","state":["exists","up"]},{"osd":3,"uuid":"e4b08c98-6a4d-4ec8-a245-59a35f70a16f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36685},{"type":"v1","addr":"172.21.15.73:6801","nonce":36685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36685},{"type":"v1","addr":"172.21.15.73:6803","nonce":36685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":36685},{"type":"v1","addr":"172.21.15.73:6807","nonce":36685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36685},{"type":"v1","addr":"172.21.15.73:6805","nonce":36685}]},"public_addr":"172.21.15.73:6801/36685","cluster_addr":"172.21.15.73:6803/36685","heartbeat_back_addr":"172.21.15.73:6807/36685","heartbeat_front_addr":"172.21.15.73:6805/36685","state":["exists","up"]},{"osd":4,"uuid":"d0922b0e-5170-474d-b270-ddb5adc858cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":36908},{"type":"v1","addr":"172.21.15.156:6801","nonce":36908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":36908},{"type":"v1","addr":"172.21.15.156:6803","nonce":36908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":36908},{"type":"v1","addr":"172.21.15.156:6807","nonce":36908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":36908},{"type":"v1","addr":"172.21.15.156:6805","nonce":36908}]},"public_addr":"172.21.15.156:6801/36908","cluster_addr":"172.21.15.156:6803/36908","heartbeat_back_addr":"172.21.15.156:6807/36908","heartbeat_front_addr":"172.21.15.156:6805/36908","state":["exists","up"]},{"osd":5,"uuid":"f2791a77-db25-479c-95d5-ea7f77458685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":36909},{"type":"v1","addr":"172.21.15.156:6809","nonce":36909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":36909},{"type":"v1","addr":"172.21.15.156:6811","nonce":36909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":36909},{"type":"v1","addr":"172.21.15.156:6815","nonce":36909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":36909},{"type":"v1","addr":"172.21.15.156:6813","nonce":36909}]},"public_addr":"172.21.15.156:6809/36909","cluster_addr":"172.21.15.156:6811/36909","heartbeat_back_addr":"172.21.15.156:6815/36909","heartbeat_front_addr":"172.21.15.156:6813/36909","state":["exists","up"]},{"osd":6,"uuid":"f86c2fe9-ec8b-406e-af26-5dc65c926382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":36910},{"type":"v1","addr":"172.21.15.156:6817","nonce":36910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":36910},{"type":"v1","addr":"172.21.15.156:6819","nonce":36910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":36910},{"type":"v1","addr":"172.21.15.156:6823","nonce":36910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":36910},{"type":"v1","addr":"172.21.15.156:6821","nonce":36910}]},"public_addr":"172.21.15.156:6817/36910","cluster_addr":"172.21.15.156:6819/36910","heartbeat_back_addr":"172.21.15.156:6823/36910","heartbeat_front_addr":"172.21.15.156:6821/36910","state":["exists","up"]},{"osd":7,"uuid":"56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":36911},{"type":"v1","addr":"172.21.15.156:6825","nonce":36911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":36911},{"type":"v1","addr":"172.21.15.156:6827","nonce":36911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":36911},{"type":"v1","addr":"172.21.15.156:6831","nonce":36911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":36911},{"type":"v1","addr":"172.21.15.156:6829","nonce":36911}]},"public_addr":"172.21.15.156:6825/36911","cluster_addr":"172.21.15.156:6827/36911","heartbeat_back_addr":"172.21.15.156:6831/36911","heartbeat_front_addr":"172.21.15.156:6829/36911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.597534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.505493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.811871+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.586741+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.366817+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.101605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.627496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.829046+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T23:12:52.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.191+0000 7fb5be367700 1 -- 172.21.15.73:0/2057042017 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb59c065ad0 msgr2=0x7fb59c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.195+0000 7fb5be367700 1 --2- 172.21.15.73:0/2057042017 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb59c065ad0 0x7fb59c067f90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb5b81347d0 tx=0x7fb5a80092e0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.195+0000 7fb5be367700 1 -- 172.21.15.73:0/2057042017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5b80b2710 msgr2=0x7fb5b812b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.195+0000 7fb5be367700 1 --2- 172.21.15.73:0/2057042017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5b80b2710 0x7fb5b812b710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40011e0 tx=0x7fb5b400c800 comp rx=0 tx=0).stop 2023-11-30T23:12:52.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.195+0000 7fb5be367700 1 -- 172.21.15.73:0/2057042017 shutdown_connections 2023-11-30T23:12:52.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.195+0000 7fb5be367700 1 --2- 172.21.15.73:0/2057042017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5b8146990 0x7fb5b81dcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.195+0000 7fb5be367700 1 --2- 172.21.15.73:0/2057042017 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb5b813d070 0x7fb5b8142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.195+0000 7fb5be367700 1 --2- 172.21.15.73:0/2057042017 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb59c065ad0 0x7fb59c067f90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.195+0000 7fb5be367700 1 --2- 172.21.15.73:0/2057042017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5b80b2710 0x7fb5b812b710 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.195+0000 7fb5be367700 1 -- 172.21.15.73:0/2057042017 >> 172.21.15.73:0/2057042017 conn(0x7fb5b80b45a0 msgr2=0x7fb5b8133b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.195+0000 7fb5be367700 1 -- 172.21.15.73:0/2057042017 shutdown_connections 2023-11-30T23:12:52.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.195+0000 7fb5be367700 1 -- 172.21.15.73:0/2057042017 wait complete. 2023-11-30T23:12:52.211 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-30T23:12:52.211 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T23:12:52.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb6923e700 1 Processor -- start 2023-11-30T23:12:52.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb6923e700 1 -- start start 2023-11-30T23:12:52.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb6923e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbb640afcc0 0x7fbb64144e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb6923e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbb640b24a0 0x7fbb6414e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb6923e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb640b0fb0 con 0x7fbb6414e1f0 2023-11-30T23:12:52.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb6923e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb640af5e0 con 0x7fbb640afcc0 2023-11-30T23:12:52.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb6923e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6414ee90 con 0x7fbb640b24a0 2023-11-30T23:12:52.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb5b7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbb640afcc0 0x7fbb64144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb5b7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbb640afcc0 0x7fbb64144e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37926/0 (socket says 172.21.15.73:37926) 2023-11-30T23:12:52.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb5b7fe700 1 -- 172.21.15.73:0/3397572495 learned_addr learned my addr 172.21.15.73:0/3397572495 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb68a3d700 1 --2- 172.21.15.73:0/3397572495 >> v2:172.21.15.156:3300/0 conn(0x7fbb640b24a0 0x7fbb6414e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb5b7fe700 1 -- 172.21.15.73:0/3397572495 >> v2:172.21.15.156:3300/0 conn(0x7fbb640b24a0 msgr2=0x7fbb6414e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:52.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb5b7fe700 1 --2- 172.21.15.73:0/3397572495 >> v2:172.21.15.156:3300/0 conn(0x7fbb640b24a0 0x7fbb6414e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb5b7fe700 1 -- 172.21.15.73:0/3397572495 >> v1:172.21.15.73:6789/0 conn(0x7fbb6414e1f0 legacy=0x7fbb64144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb5b7fe700 1 -- 172.21.15.73:0/3397572495 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb640b1c80 con 0x7fbb640afcc0 2023-11-30T23:12:52.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb5b7fe700 1 --2- 172.21.15.73:0/3397572495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb640afcc0 0x7fbb64144e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbb64072910 tx=0x7fbb4c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2f1c7fff3514d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb637fe700 1 -- 172.21.15.73:0/3397572495 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c00ba20 con 0x7fbb640afcc0 2023-11-30T23:12:52.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb637fe700 1 -- 172.21.15.73:0/3397572495 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4c00bb80 con 0x7fbb640afcc0 2023-11-30T23:12:52.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb637fe700 1 -- 172.21.15.73:0/3397572495 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c009e60 con 0x7fbb640afcc0 2023-11-30T23:12:52.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb6923e700 1 -- 172.21.15.73:0/3397572495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb640afcc0 msgr2=0x7fbb64144e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb6923e700 1 --2- 172.21.15.73:0/3397572495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb640afcc0 0x7fbb64144e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbb64072910 tx=0x7fbb4c009c20 comp rx=0 tx=0).stop 2023-11-30T23:12:52.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb6923e700 1 -- 172.21.15.73:0/3397572495 shutdown_connections 2023-11-30T23:12:52.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb6923e700 1 --2- 172.21.15.73:0/3397572495 >> v2:172.21.15.156:3300/0 conn(0x7fbb640b24a0 0x7fbb6414e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb6923e700 1 --2- 172.21.15.73:0/3397572495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb640afcc0 0x7fbb64144e10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb6923e700 1 -- 172.21.15.73:0/3397572495 >> 172.21.15.73:0/3397572495 conn(0x7fbb640b45a0 msgr2=0x7fbb640b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb6923e700 1 -- 172.21.15.73:0/3397572495 shutdown_connections 2023-11-30T23:12:52.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.315+0000 7fbb6923e700 1 -- 172.21.15.73:0/3397572495 wait complete. 2023-11-30T23:12:52.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb6923e700 1 Processor -- start 2023-11-30T23:12:52.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb6923e700 1 -- start start 2023-11-30T23:12:52.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb6923e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb640afcc0 0x7fbb6414adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb6923e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb640b24a0 0x7fbb64146d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb6923e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb6414e1f0 0x7fbb64147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb6923e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb641457b0 con 0x7fbb6414e1f0 2023-11-30T23:12:52.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb6923e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb64146880 con 0x7fbb640afcc0 2023-11-30T23:12:52.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb6923e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb64142ca0 con 0x7fbb640b24a0 2023-11-30T23:12:52.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb68a3d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb6414e1f0 0x7fbb64147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb68a3d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb6414e1f0 0x7fbb64147250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37936/0 (socket says 172.21.15.73:37936) 2023-11-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb68a3d700 1 -- 172.21.15.73:0/1070825442 learned_addr learned my addr 172.21.15.73:0/1070825442 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb5b7fe700 1 --2- 172.21.15.73:0/1070825442 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb640b24a0 0x7fbb64146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb63fff700 1 --2- 172.21.15.73:0/1070825442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb640afcc0 0x7fbb6414adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb68a3d700 1 -- 172.21.15.73:0/1070825442 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb640b24a0 msgr2=0x7fbb64146d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb68a3d700 1 --2- 172.21.15.73:0/1070825442 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb640b24a0 0x7fbb64146d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb68a3d700 1 -- 172.21.15.73:0/1070825442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb640afcc0 msgr2=0x7fbb6414adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb68a3d700 1 --2- 172.21.15.73:0/1070825442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb640afcc0 0x7fbb6414adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb68a3d700 1 -- 172.21.15.73:0/1070825442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4c009570 con 0x7fbb6414e1f0 2023-11-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb68a3d700 1 --2- 172.21.15.73:0/1070825442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb6414e1f0 0x7fbb64147250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c00cd70 tx=0x7fbb5c00a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb617fa700 1 -- 172.21.15.73:0/1070825442 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c003a40 con 0x7fbb6414e1f0 2023-11-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb617fa700 1 -- 172.21.15.73:0/1070825442 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5c003ba0 con 0x7fbb6414e1f0 2023-11-30T23:12:52.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb6923e700 1 -- 172.21.15.73:0/1070825442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb64147ea0 con 0x7fbb6414e1f0 2023-11-30T23:12:52.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb617fa700 1 -- 172.21.15.73:0/1070825442 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c004020 con 0x7fbb6414e1f0 2023-11-30T23:12:52.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.319+0000 7fbb6923e700 1 -- 172.21.15.73:0/1070825442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6414b440 con 0x7fbb6414e1f0 2023-11-30T23:12:52.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.323+0000 7fbb6923e700 1 -- 172.21.15.73:0/1070825442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb64147d00 con 0x7fbb6414e1f0 2023-11-30T23:12:52.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.323+0000 7fbb617fa700 1 -- 172.21.15.73:0/1070825442 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbb5c004180 con 0x7fbb6414e1f0 2023-11-30T23:12:52.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.323+0000 7fbb617fa700 1 --2- 172.21.15.73:0/1070825442 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbb44065ad0 0x7fbb44067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.323+0000 7fbb617fa700 1 -- 172.21.15.73:0/1070825442 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb5c012070 con 0x7fbb6414e1f0 2023-11-30T23:12:52.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.323+0000 7fbb63fff700 1 --2- 172.21.15.73:0/1070825442 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbb44065ad0 0x7fbb44067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.323+0000 7fbb63fff700 1 --2- 172.21.15.73:0/1070825442 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbb44065ad0 0x7fbb44067f90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbb54001800 tx=0x7fbb54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.331+0000 7fbb617fa700 1 -- 172.21.15.73:0/1070825442 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fbb64147d00 con 0x7fbb6414e1f0 2023-11-30T23:12:52.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.499+0000 7fbb6923e700 1 -- 172.21.15.73:0/1070825442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb64147d00 con 0x7fbb6414e1f0 2023-11-30T23:12:52.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.499+0000 7fbb617fa700 1 -- 172.21.15.73:0/1070825442 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7fbb64147d00 con 0x7fbb6414e1f0 2023-11-30T23:12:52.505 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:52.505 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"a677cb6a-4a54-4567-a30d-f0fa4bc22b17","created":"2023-11-30T23:12:23.260968+0000","modified":"2023-11-30T23:12:48.484283+0000","last_up_change":"2023-11-30T23:12:33.649318+0000","last_in_change":"2023-11-30T23:12:25.326689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-30T23:12:34.413317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-30T23:12:45.403156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-30T23:12:46.475384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbf1c93f-0775-4780-8524-cf25792d9aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36686},{"type":"v1","addr":"172.21.15.73:6817","nonce":36686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36686},{"type":"v1","addr":"172.21.15.73:6819","nonce":36686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36686},{"type":"v1","addr":"172.21.15.73:6823","nonce":36686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36686},{"type":"v1","addr":"172.21.15.73:6821","nonce":36686}]},"public_addr":"172.21.15.73:6817/36686","cluster_addr":"172.21.15.73:6819/36686","heartbeat_back_addr":"172.21.15.73:6823/36686","heartbeat_front_addr":"172.21.15.73:6821/36686","state":["exists","up"]},{"osd":1,"uuid":"9d9dd122-9a42-4588-a0d2-50d13b13eba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36687},{"type":"v1","addr":"172.21.15.73:6809","nonce":36687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":36687},{"type":"v1","addr":"172.21.15.73:6811","nonce":36687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36687},{"type":"v1","addr":"172.21.15.73:6815","nonce":36687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36687},{"type":"v1","addr":"172.21.15.73:6813","nonce":36687}]},"public_addr":"172.21.15.73:6809/36687","cluster_addr":"172.21.15.73:6811/36687","heartbeat_back_addr":"172.21.15.73:6815/36687","heartbeat_front_addr":"172.21.15.73:6813/36687","state":["exists","up"]},{"osd":2,"uuid":"68ff4f1e-ec45-42e0-bb83-fe03598e4940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36688},{"type":"v1","addr":"172.21.15.73:6825","nonce":36688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36688},{"type":"v1","addr":"172.21.15.73:6827","nonce":36688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36688},{"type":"v1","addr":"172.21.15.73:6831","nonce":36688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36688},{"type":"v1","addr":"172.21.15.73:6829","nonce":36688}]},"public_addr":"172.21.15.73:6825/36688","cluster_addr":"172.21.15.73:6827/36688","heartbeat_back_addr":"172.21.15.73:6831/36688","heartbeat_front_addr":"172.21.15.73:6829/36688","state":["exists","up"]},{"osd":3,"uuid":"e4b08c98-6a4d-4ec8-a245-59a35f70a16f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36685},{"type":"v1","addr":"172.21.15.73:6801","nonce":36685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36685},{"type":"v1","addr":"172.21.15.73:6803","nonce":36685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":36685},{"type":"v1","addr":"172.21.15.73:6807","nonce":36685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36685},{"type":"v1","addr":"172.21.15.73:6805","nonce":36685}]},"public_addr":"172.21.15.73:6801/36685","cluster_addr":"172.21.15.73:6803/36685","heartbeat_back_addr":"172.21.15.73:6807/36685","heartbeat_front_addr":"172.21.15.73:6805/36685","state":["exists","up"]},{"osd":4,"uuid":"d0922b0e-5170-474d-b270-ddb5adc858cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":36908},{"type":"v1","addr":"172.21.15.156:6801","nonce":36908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":36908},{"type":"v1","addr":"172.21.15.156:6803","nonce":36908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":36908},{"type":"v1","addr":"172.21.15.156:6807","nonce":36908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":36908},{"type":"v1","addr":"172.21.15.156:6805","nonce":36908}]},"public_addr":"172.21.15.156:6801/36908","cluster_addr":"172.21.15.156:6803/36908","heartbeat_back_addr":"172.21.15.156:6807/36908","heartbeat_front_addr":"172.21.15.156:6805/36908","state":["exists","up"]},{"osd":5,"uuid":"f2791a77-db25-479c-95d5-ea7f77458685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":36909},{"type":"v1","addr":"172.21.15.156:6809","nonce":36909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":36909},{"type":"v1","addr":"172.21.15.156:6811","nonce":36909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":36909},{"type":"v1","addr":"172.21.15.156:6815","nonce":36909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":36909},{"type":"v1","addr":"172.21.15.156:6813","nonce":36909}]},"public_addr":"172.21.15.156:6809/36909","cluster_addr":"172.21.15.156:6811/36909","heartbeat_back_addr":"172.21.15.156:6815/36909","heartbeat_front_addr":"172.21.15.156:6813/36909","state":["exists","up"]},{"osd":6,"uuid":"f86c2fe9-ec8b-406e-af26-5dc65c926382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":36910},{"type":"v1","addr":"172.21.15.156:6817","nonce":36910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":36910},{"type":"v1","addr":"172.21.15.156:6819","nonce":36910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":36910},{"type":"v1","addr":"172.21.15.156:6823","nonce":36910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":36910},{"type":"v1","addr":"172.21.15.156:6821","nonce":36910}]},"public_addr":"172.21.15.156:6817/36910","cluster_addr":"172.21.15.156:6819/36910","heartbeat_back_addr":"172.21.15.156:6823/36910","heartbeat_front_addr":"172.21.15.156:6821/36910","state":["exists","up"]},{"osd":7,"uuid":"56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":36911},{"type":"v1","addr":"172.21.15.156:6825","nonce":36911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":36911},{"type":"v1","addr":"172.21.15.156:6827","nonce":36911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":36911},{"type":"v1","addr":"172.21.15.156:6831","nonce":36911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":36911},{"type":"v1","addr":"172.21.15.156:6829","nonce":36911}]},"public_addr":"172.21.15.156:6825/36911","cluster_addr":"172.21.15.156:6827/36911","heartbeat_back_addr":"172.21.15.156:6831/36911","heartbeat_front_addr":"172.21.15.156:6829/36911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.597534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.505493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.811871+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.586741+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.366817+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.101605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.627496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.829046+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T23:12:52.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.503+0000 7fbb6923e700 1 -- 172.21.15.73:0/1070825442 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbb44065ad0 msgr2=0x7fbb44067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.503+0000 7fbb6923e700 1 --2- 172.21.15.73:0/1070825442 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbb44065ad0 0x7fbb44067f90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbb54001800 tx=0x7fbb54009040 comp rx=0 tx=0).stop 2023-11-30T23:12:52.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.503+0000 7fbb6923e700 1 -- 172.21.15.73:0/1070825442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb6414e1f0 msgr2=0x7fbb64147250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.503+0000 7fbb6923e700 1 --2- 172.21.15.73:0/1070825442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb6414e1f0 0x7fbb64147250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c00cd70 tx=0x7fbb5c00a570 comp rx=0 tx=0).stop 2023-11-30T23:12:52.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.503+0000 7fbb6923e700 1 -- 172.21.15.73:0/1070825442 shutdown_connections 2023-11-30T23:12:52.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.503+0000 7fbb6923e700 1 --2- 172.21.15.73:0/1070825442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb6414e1f0 0x7fbb64147250 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.503+0000 7fbb6923e700 1 --2- 172.21.15.73:0/1070825442 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb640b24a0 0x7fbb64146d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.503+0000 7fbb6923e700 1 --2- 172.21.15.73:0/1070825442 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbb44065ad0 0x7fbb44067f90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.503+0000 7fbb6923e700 1 --2- 172.21.15.73:0/1070825442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb640afcc0 0x7fbb6414adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.503+0000 7fbb6923e700 1 -- 172.21.15.73:0/1070825442 >> 172.21.15.73:0/1070825442 conn(0x7fbb640b45a0 msgr2=0x7fbb64143b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.503+0000 7fbb6923e700 1 -- 172.21.15.73:0/1070825442 shutdown_connections 2023-11-30T23:12:52.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.503+0000 7fbb6923e700 1 -- 172.21.15.73:0/1070825442 wait complete. 2023-11-30T23:12:52.520 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-30T23:12:52.520 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-30T23:12:52.521 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-30T23:12:52.521 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-30T23:12:52.521 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-30T23:12:52.523 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-30T23:12:52.523 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-30T23:12:52.524 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-30T23:12:52.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.667+0000 7f71357e6700 1 Processor -- start 2023-11-30T23:12:52.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.667+0000 7f015d2ab700 1 Processor -- start 2023-11-30T23:12:52.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.667+0000 7f015d2ab700 1 -- start start 2023-11-30T23:12:52.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.667+0000 7f71357e6700 1 -- start start 2023-11-30T23:12:52.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f71357e6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f71300b01c0 0x7f7130142b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f71357e6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713006e280 con 0x7f71300b1260 2023-11-30T23:12:52.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f71357e6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71301430f0 con 0x7f71300b0e80 2023-11-30T23:12:52.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f71357e6700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71300af660 con 0x7f71300b01c0 2023-11-30T23:12:52.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015d2ab700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01580b1420 0x7f0158144470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015d2ab700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f015813e820 0x7f01581449b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015d2ab700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0158144ef0 con 0x7f015806efb0 2023-11-30T23:12:52.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015d2ab700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01580b3880 con 0x7f015813e820 2023-11-30T23:12:52.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015d2ab700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01580b3e40 con 0x7f01580b1420 2023-11-30T23:12:52.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f712f7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f71300b1260 0x7f71300afab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38078/0 (socket says 172.21.15.73:38078) 2023-11-30T23:12:52.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f712f7fe700 1 -- 172.21.15.73:0/4096619808 learned_addr learned my addr 172.21.15.73:0/4096619808 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:52.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015caaa700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f015813e820 0x7f01581449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015caaa700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f015813e820 0x7f01581449b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37952/0 (socket says 172.21.15.73:37952) 2023-11-30T23:12:52.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015caaa700 1 -- 172.21.15.73:0/3488432566 learned_addr learned my addr 172.21.15.73:0/3488432566 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f01577fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f015806efb0 0x7f015813e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38094/0 (socket says 172.21.15.73:38094) 2023-11-30T23:12:52.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f0157fff700 1 --2- 172.21.15.73:0/3488432566 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01580b1420 0x7f0158144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f7134fe5700 1 --2- 172.21.15.73:0/4096619808 >> v2:172.21.15.73:3300/0 conn(0x7f71300b01c0 0x7f7130142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f0156ffd700 1 -- 172.21.15.73:0/3488432566 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137623213 0 0) 0x7f0158144ef0 con 0x7f015806efb0 2023-11-30T23:12:52.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015caaa700 1 -- 172.21.15.73:0/3488432566 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01580b1420 msgr2=0x7f0158144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:52.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015caaa700 1 --2- 172.21.15.73:0/3488432566 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01580b1420 0x7f0158144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015caaa700 1 -- 172.21.15.73:0/3488432566 >> v1:172.21.15.73:6789/0 conn(0x7f015806efb0 legacy=0x7f015813e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015caaa700 1 -- 172.21.15.73:0/3488432566 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0158070410 con 0x7f015813e820 2023-11-30T23:12:52.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f7134fe5700 1 -- 172.21.15.73:0/4096619808 >> v1:172.21.15.156:6789/0 conn(0x7f71300b0e80 legacy=0x7f7130071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f7134fe5700 1 -- 172.21.15.73:0/4096619808 >> v1:172.21.15.73:6789/0 conn(0x7f71300b1260 legacy=0x7f71300afab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015caaa700 1 --2- 172.21.15.73:0/3488432566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f015813e820 0x7f01581449b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0150009e50 tx=0x7f015000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6080d78bd38c5c0e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f712effd700 1 -- 172.21.15.73:0/4096619808 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743614077 0 0) 0x7f713006e280 con 0x7f71300b1260 2023-11-30T23:12:52.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f7134fe5700 1 -- 172.21.15.73:0/4096619808 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71301433d0 con 0x7f71300b01c0 2023-11-30T23:12:52.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f0156ffd700 1 -- 172.21.15.73:0/3488432566 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015000e070 con 0x7f015813e820 2023-11-30T23:12:52.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f0156ffd700 1 -- 172.21.15.73:0/3488432566 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015000b910 con 0x7f015813e820 2023-11-30T23:12:52.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f0156ffd700 1 -- 172.21.15.73:0/3488432566 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015000bcc0 con 0x7f015813e820 2023-11-30T23:12:52.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f7134fe5700 1 --2- 172.21.15.73:0/4096619808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71300b01c0 0x7f7130142b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f712800aed0 tx=0x7f712800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d73a62fb19e28d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f712effd700 1 -- 172.21.15.73:0/4096619808 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712800f070 con 0x7f71300b01c0 2023-11-30T23:12:52.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f712effd700 1 -- 172.21.15.73:0/4096619808 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712800a2e0 con 0x7f71300b01c0 2023-11-30T23:12:52.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015d2ab700 1 -- 172.21.15.73:0/3488432566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f015813e820 msgr2=0x7f01581449b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015d2ab700 1 --2- 172.21.15.73:0/3488432566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f015813e820 0x7f01581449b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0150009e50 tx=0x7f015000b330 comp rx=0 tx=0).stop 2023-11-30T23:12:52.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f712effd700 1 -- 172.21.15.73:0/4096619808 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128003c60 con 0x7f71300b01c0 2023-11-30T23:12:52.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015d2ab700 1 -- 172.21.15.73:0/3488432566 shutdown_connections 2023-11-30T23:12:52.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015d2ab700 1 --2- 172.21.15.73:0/3488432566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f015813e820 0x7f01581449b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015d2ab700 1 --2- 172.21.15.73:0/3488432566 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01580b1420 0x7f0158144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015d2ab700 1 -- 172.21.15.73:0/3488432566 >> 172.21.15.73:0/3488432566 conn(0x7f015806ab90 msgr2=0x7f01580b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f71357e6700 1 -- 172.21.15.73:0/4096619808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71300b01c0 msgr2=0x7f7130142b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f71357e6700 1 --2- 172.21.15.73:0/4096619808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71300b01c0 0x7f7130142b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f712800aed0 tx=0x7f712800c330 comp rx=0 tx=0).stop 2023-11-30T23:12:52.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f71357e6700 1 -- 172.21.15.73:0/4096619808 shutdown_connections 2023-11-30T23:12:52.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f71357e6700 1 --2- 172.21.15.73:0/4096619808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71300b01c0 0x7f7130142b10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f71357e6700 1 -- 172.21.15.73:0/4096619808 >> 172.21.15.73:0/4096619808 conn(0x7f713006ab90 msgr2=0x7f71300b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.671+0000 7f015d2ab700 1 -- 172.21.15.73:0/3488432566 shutdown_connections 2023-11-30T23:12:52.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f015d2ab700 1 -- 172.21.15.73:0/3488432566 wait complete. 2023-11-30T23:12:52.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f5397fff700 1 Processor -- start 2023-11-30T23:12:52.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f943a59f700 1 Processor -- start 2023-11-30T23:12:52.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f5397fff700 1 -- start start 2023-11-30T23:12:52.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f71357e6700 1 -- 172.21.15.73:0/4096619808 shutdown_connections 2023-11-30T23:12:52.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f943a59f700 1 -- start start 2023-11-30T23:12:52.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f71357e6700 1 -- 172.21.15.73:0/4096619808 wait complete. 2023-11-30T23:12:52.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f015d2ab700 1 Processor -- start 2023-11-30T23:12:52.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f015d2ab700 1 -- start start 2023-11-30T23:12:52.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fbe4a455700 1 Processor -- start 2023-11-30T23:12:52.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f943a59f700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f94340b0bb0 0x7f943414b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f943a59f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f94340b24a0 0x7f94340af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f5397fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53980b2fa0 0x7f5398142b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f5397fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f53980b15d0 0x7f539813fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f5397fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f53981403b0 0x7f53981460d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f5397fff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539806e990 con 0x7f53980b15d0 2023-11-30T23:12:52.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f5397fff700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53980b1120 con 0x7f53981403b0 2023-11-30T23:12:52.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f5397fff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53980ae730 con 0x7f53980b2fa0 2023-11-30T23:12:52.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f943a59f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94340b1d30 con 0x7f9434144800 2023-11-30T23:12:52.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f53967fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f53980b15d0 0x7f539813fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fbe4a455700 1 -- start start 2023-11-30T23:12:52.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fbe4a455700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbe440b0e80 0x7fbe44142b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fbe4a455700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbe440afab0 0x7fbe440afee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fbe4a455700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe440b0420 con 0x7fbe440b1260 2023-11-30T23:12:52.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fbe4a455700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe440af660 con 0x7fbe440b0e80 2023-11-30T23:12:52.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fbe4a455700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4406e280 con 0x7fbe440afab0 2023-11-30T23:12:52.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f943a59f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943414aa30 con 0x7f94340b24a0 2023-11-30T23:12:52.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fb7a7fff700 1 Processor -- start 2023-11-30T23:12:52.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fb7a7fff700 1 -- start start 2023-11-30T23:12:52.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fb7a7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7a8145ff0 0x7fb7a8071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fb7a7fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb7a80724d0 0x7fb7a80afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fb7a7fff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a8146bd0 con 0x7fb7a8145c10 2023-11-30T23:12:52.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fb7a7fff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a80b1e90 con 0x7fb7a80724d0 2023-11-30T23:12:52.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fb7a7fff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a806e280 con 0x7fb7a8145ff0 2023-11-30T23:12:52.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f015d2ab700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f015806efb0 0x7f01581cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f015d2ab700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01580b1420 0x7f01580b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f015d2ab700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f015813e820 0x7f0158138c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f015d2ab700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01580af0a0 con 0x7f015813e820 2023-11-30T23:12:52.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f015d2ab700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01580b0300 con 0x7f015806efb0 2023-11-30T23:12:52.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f015d2ab700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01580b0fd0 con 0x7f01580b1420 2023-11-30T23:12:52.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f01577fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01580b1420 0x7f01580b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f01577fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01580b1420 0x7f01580b0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:42922/0 (socket says 172.21.15.73:42922) 2023-11-30T23:12:52.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f01577fe700 1 -- 172.21.15.73:0/1452596537 learned_addr learned my addr 172.21.15.73:0/1452596537 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f71357e6700 1 Processor -- start 2023-11-30T23:12:52.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f9438d9c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f94340b24a0 0x7f94340af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f943a59f700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94340b04f0 con 0x7f94340b0bb0 2023-11-30T23:12:52.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f9438d9c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f94340b24a0 0x7f94340af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37970/0 (socket says 172.21.15.73:37970) 2023-11-30T23:12:52.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fbe49453700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbe440b0e80 0x7fbe44142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fbe49453700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbe440b0e80 0x7fbe44142b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37986/0 (socket says 172.21.15.73:37986) 2023-11-30T23:12:52.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f9438d9c700 1 -- 172.21.15.73:0/801436686 learned_addr learned my addr 172.21.15.73:0/801436686 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fbe49453700 1 -- 172.21.15.73:0/4204079952 learned_addr learned my addr 172.21.15.73:0/4204079952 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f71357e6700 1 -- start start 2023-11-30T23:12:52.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f015caaa700 1 --2- 172.21.15.73:0/1452596537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f015813e820 0x7f0158138c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fbe49453700 1 -- 172.21.15.73:0/4204079952 >> v2:172.21.15.156:3300/0 conn(0x7fbe440afab0 msgr2=0x7fbe440afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:52.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fbe49453700 1 --2- 172.21.15.73:0/4204079952 >> v2:172.21.15.156:3300/0 conn(0x7fbe440afab0 0x7fbe440afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fbe49453700 1 -- 172.21.15.73:0/4204079952 >> v1:172.21.15.156:6789/0 conn(0x7fbe440b1260 legacy=0x7fbe44071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:52.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fbe49453700 1 -- 172.21.15.73:0/4204079952 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe441430f0 con 0x7fbe440b0e80 2023-11-30T23:12:52.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f943959d700 1 --2- 172.21.15.73:0/801436686 >> v2:172.21.15.156:3300/0 conn(0x7f94340b0bb0 0x7f943414b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f53967fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f53980b15d0 0x7f539813fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37964/0 (socket says 172.21.15.73:37964) 2023-11-30T23:12:52.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f53967fc700 1 -- 172.21.15.73:0/780045523 learned_addr learned my addr 172.21.15.73:0/780045523 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f5396ffd700 1 --2- 172.21.15.73:0/780045523 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53980b2fa0 0x7f5398142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f53977fe700 1 --2- 172.21.15.73:0/780045523 >> v2:172.21.15.156:3300/0 conn(0x7f53981403b0 0x7f53981460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f5396ffd700 1 -- 172.21.15.73:0/780045523 >> v2:172.21.15.156:3300/0 conn(0x7f53981403b0 msgr2=0x7f53981460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:52.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f5396ffd700 1 --2- 172.21.15.73:0/780045523 >> v2:172.21.15.156:3300/0 conn(0x7f53981403b0 0x7f53981460d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f5396ffd700 1 -- 172.21.15.73:0/780045523 >> v2:172.21.15.73:3300/0 conn(0x7f53980b15d0 msgr2=0x7f539813fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:52.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f5396ffd700 1 --2- 172.21.15.73:0/780045523 >> v2:172.21.15.73:3300/0 conn(0x7f53980b15d0 0x7f539813fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f5396ffd700 1 -- 172.21.15.73:0/780045523 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53980b3380 con 0x7f53980b2fa0 2023-11-30T23:12:52.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f01577fe700 1 -- 172.21.15.73:0/1452596537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f015806efb0 msgr2=0x7f01581cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f01577fe700 1 --2- 172.21.15.73:0/1452596537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f015806efb0 0x7f01581cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f01577fe700 1 -- 172.21.15.73:0/1452596537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f015813e820 msgr2=0x7f0158138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f01577fe700 1 --2- 172.21.15.73:0/1452596537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f015813e820 0x7f0158138c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7f01577fe700 1 -- 172.21.15.73:0/1452596537 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0150009b30 con 0x7f01580b1420 2023-11-30T23:12:52.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fbe49453700 1 --2- 172.21.15.73:0/4204079952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe440b0e80 0x7fbe44142b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbe440af410 tx=0x7fbe3400d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6131535cd5ec1a2d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f5396ffd700 1 --2- 172.21.15.73:0/780045523 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53980b2fa0 0x7f5398142b60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f53980b4530 tx=0x7f539000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5411b64fdd6afff5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f71357e6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71300b01c0 0x7f71301d0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f71357e6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71300b0e80 0x7f71301ec370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f71357e6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71300b1260 0x7f71301ec8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f71357e6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71301e8810 con 0x7f71300b01c0 2023-11-30T23:12:52.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f71357e6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71301ca1d0 con 0x7f71300b1260 2023-11-30T23:12:52.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f71357e6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71301c86a0 con 0x7f71300b0e80 2023-11-30T23:12:52.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f01577fe700 1 --2- 172.21.15.73:0/1452596537 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01580b1420 0x7f01580b0a90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f014800c4e0 tx=0x7f014800c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f9438d9c700 1 -- 172.21.15.73:0/801436686 >> v2:172.21.15.156:3300/0 conn(0x7f94340b0bb0 msgr2=0x7f943414b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:52.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f9438d9c700 1 --2- 172.21.15.73:0/801436686 >> v2:172.21.15.156:3300/0 conn(0x7f94340b0bb0 0x7f943414b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f9438d9c700 1 -- 172.21.15.73:0/801436686 >> v1:172.21.15.73:6789/0 conn(0x7f9434144800 legacy=0x7f9434144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f9438d9c700 1 -- 172.21.15.73:0/801436686 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94340b0f90 con 0x7f94340b24a0 2023-11-30T23:12:52.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fb7a67fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7a8145ff0 0x7fb7a8071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fb7a67fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7a8145ff0 0x7fb7a8071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:42934/0 (socket says 172.21.15.73:42934) 2023-11-30T23:12:52.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.675+0000 7fb7a67fc700 1 -- 172.21.15.73:0/3037378058 learned_addr learned my addr 172.21.15.73:0/3037378058 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fb7a67fc700 1 -- 172.21.15.73:0/3037378058 >> v2:172.21.15.73:3300/0 conn(0x7fb7a80724d0 msgr2=0x7fb7a80afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:52.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fb7a67fc700 1 --2- 172.21.15.73:0/3037378058 >> v2:172.21.15.73:3300/0 conn(0x7fb7a80724d0 0x7fb7a80afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fb7a67fc700 1 -- 172.21.15.73:0/3037378058 >> v1:172.21.15.73:6789/0 conn(0x7fb7a8145c10 legacy=0x7fb7a80b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:52.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fb7a67fc700 1 -- 172.21.15.73:0/3037378058 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a8146610 con 0x7fb7a8145ff0 2023-11-30T23:12:52.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f712f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71300b0e80 0x7f71301ec370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f712f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71300b0e80 0x7f71301ec370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:42942/0 (socket says 172.21.15.73:42942) 2023-11-30T23:12:52.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f712f7fe700 1 -- 172.21.15.73:0/3532949696 learned_addr learned my addr 172.21.15.73:0/3532949696 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f943959d700 1 --2- 172.21.15.73:0/801436686 >> v2:172.21.15.156:3300/0 conn(0x7f94340b0bb0 0x7f943414b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:52.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f5395ffb700 1 -- 172.21.15.73:0/780045523 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539000e070 con 0x7f53980b2fa0 2023-11-30T23:12:52.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f5395ffb700 1 -- 172.21.15.73:0/780045523 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539000bb20 con 0x7f53980b2fa0 2023-11-30T23:12:52.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f5395ffb700 1 -- 172.21.15.73:0/780045523 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5390012430 con 0x7f53980b2fa0 2023-11-30T23:12:52.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f7134fe5700 1 --2- 172.21.15.73:0/3532949696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71300b1260 0x7f71301ec8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f0154ff9700 1 -- 172.21.15.73:0/1452596537 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148004ca0 con 0x7f01580b1420 2023-11-30T23:12:52.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fb7a67fc700 1 --2- 172.21.15.73:0/3037378058 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7a8145ff0 0x7fb7a8071f90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0007a60 tx=0x7fb7a0010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f98b573cefef40bd server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f9438d9c700 1 --2- 172.21.15.73:0/801436686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94340b24a0 0x7f94340af770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94340b1330 tx=0x7f9424009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777e0c4c0abc34c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fbe3bfff700 1 -- 172.21.15.73:0/4204079952 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34010070 con 0x7fbe440b0e80 2023-11-30T23:12:52.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fbe3bfff700 1 -- 172.21.15.73:0/4204079952 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3400da40 con 0x7fbe440b0e80 2023-11-30T23:12:52.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f0154ff9700 1 -- 172.21.15.73:0/1452596537 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0148004e00 con 0x7f01580b1420 2023-11-30T23:12:52.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fbe3bfff700 1 -- 172.21.15.73:0/4204079952 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3400ddd0 con 0x7fbe440b0e80 2023-11-30T23:12:52.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f942bfff700 1 -- 172.21.15.73:0/801436686 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424011830 con 0x7f94340b24a0 2023-11-30T23:12:52.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f942bfff700 1 -- 172.21.15.73:0/801436686 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9424011990 con 0x7f94340b24a0 2023-11-30T23:12:52.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f942bfff700 1 -- 172.21.15.73:0/801436686 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424011d20 con 0x7f94340b24a0 2023-11-30T23:12:52.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f0154ff9700 1 -- 172.21.15.73:0/1452596537 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148007310 con 0x7f01580b1420 2023-11-30T23:12:52.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fb7a5ffb700 1 -- 172.21.15.73:0/3037378058 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0010270 con 0x7fb7a8145ff0 2023-11-30T23:12:52.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fb7a5ffb700 1 -- 172.21.15.73:0/3037378058 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a0019a60 con 0x7fb7a8145ff0 2023-11-30T23:12:52.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fb7a5ffb700 1 -- 172.21.15.73:0/3037378058 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0019e10 con 0x7fb7a8145ff0 2023-11-30T23:12:52.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f015d2ab700 1 -- 172.21.15.73:0/1452596537 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01580b0570 con 0x7f01580b1420 2023-11-30T23:12:52.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f015d2ab700 1 -- 172.21.15.73:0/1452596537 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0158144330 con 0x7f01580b1420 2023-11-30T23:12:52.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fbe4a455700 1 -- 172.21.15.73:0/4204079952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe440b0e80 msgr2=0x7fbe44142b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fbe4a455700 1 --2- 172.21.15.73:0/4204079952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe440b0e80 0x7fbe44142b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbe440af410 tx=0x7fbe3400d330 comp rx=0 tx=0).stop 2023-11-30T23:12:52.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f943a59f700 1 -- 172.21.15.73:0/801436686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94340b24a0 msgr2=0x7f94340af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f943a59f700 1 --2- 172.21.15.73:0/801436686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94340b24a0 0x7f94340af770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94340b1330 tx=0x7f9424009bf0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f5397fff700 1 -- 172.21.15.73:0/780045523 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53980b2fa0 msgr2=0x7f5398142b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f5397fff700 1 --2- 172.21.15.73:0/780045523 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53980b2fa0 0x7f5398142b60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f53980b4530 tx=0x7f539000b330 comp rx=0 tx=0).stop 2023-11-30T23:12:52.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f5397fff700 1 -- 172.21.15.73:0/780045523 shutdown_connections 2023-11-30T23:12:52.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f5397fff700 1 --2- 172.21.15.73:0/780045523 >> v2:172.21.15.156:3300/0 conn(0x7f53981403b0 0x7f53981460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f5397fff700 1 --2- 172.21.15.73:0/780045523 >> v2:172.21.15.73:3300/0 conn(0x7f53980b15d0 0x7f539813fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f5397fff700 1 --2- 172.21.15.73:0/780045523 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53980b2fa0 0x7f5398142b60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f5397fff700 1 -- 172.21.15.73:0/780045523 >> 172.21.15.73:0/780045523 conn(0x7f53980b45a0 msgr2=0x7f53980b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f712f7fe700 1 -- 172.21.15.73:0/3532949696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71300b1260 msgr2=0x7f71301ec8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f712f7fe700 1 --2- 172.21.15.73:0/3532949696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71300b1260 0x7f71301ec8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f712f7fe700 1 -- 172.21.15.73:0/3532949696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71300b01c0 msgr2=0x7f71301d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f712f7fe700 1 --2- 172.21.15.73:0/3532949696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71300b01c0 0x7f71301d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f943a59f700 1 -- 172.21.15.73:0/801436686 shutdown_connections 2023-11-30T23:12:52.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f712f7fe700 1 -- 172.21.15.73:0/3532949696 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712800ab80 con 0x7f71300b0e80 2023-11-30T23:12:52.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f7134fe5700 1 --2- 172.21.15.73:0/3532949696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71300b1260 0x7f71301ec8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:52.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f943a59f700 1 --2- 172.21.15.73:0/801436686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94340b24a0 0x7f94340af770 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f943a59f700 1 --2- 172.21.15.73:0/801436686 >> v2:172.21.15.156:3300/0 conn(0x7f94340b0bb0 0x7f943414b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f943a59f700 1 -- 172.21.15.73:0/801436686 >> 172.21.15.73:0/801436686 conn(0x7f943406ab90 msgr2=0x7f94340b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fb7a7fff700 1 -- 172.21.15.73:0/3037378058 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7a8145ff0 msgr2=0x7fb7a8071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fb7a7fff700 1 --2- 172.21.15.73:0/3037378058 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7a8145ff0 0x7fb7a8071f90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0007a60 tx=0x7fb7a0010800 comp rx=0 tx=0).stop 2023-11-30T23:12:52.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f712f7fe700 1 --2- 172.21.15.73:0/3532949696 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71300b0e80 0x7f71301ec370 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f712400c570 tx=0x7f712400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f943a59f700 1 -- 172.21.15.73:0/801436686 shutdown_connections 2023-11-30T23:12:52.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f943a59f700 1 -- 172.21.15.73:0/801436686 wait complete. 2023-11-30T23:12:52.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fbe4a455700 1 -- 172.21.15.73:0/4204079952 shutdown_connections 2023-11-30T23:12:52.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fbe4a455700 1 --2- 172.21.15.73:0/4204079952 >> v2:172.21.15.156:3300/0 conn(0x7fbe440afab0 0x7fbe440afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fbe4a455700 1 --2- 172.21.15.73:0/4204079952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe440b0e80 0x7fbe44142b10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fbe4a455700 1 -- 172.21.15.73:0/4204079952 >> 172.21.15.73:0/4204079952 conn(0x7fbe4406ab90 msgr2=0x7fbe440b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f5397fff700 1 -- 172.21.15.73:0/780045523 shutdown_connections 2023-11-30T23:12:52.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fbe4a455700 1 -- 172.21.15.73:0/4204079952 shutdown_connections 2023-11-30T23:12:52.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fb7a7fff700 1 -- 172.21.15.73:0/3037378058 shutdown_connections 2023-11-30T23:12:52.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fb7a7fff700 1 --2- 172.21.15.73:0/3037378058 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7a8145ff0 0x7fb7a8071f90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fb7a7fff700 1 --2- 172.21.15.73:0/3037378058 >> v2:172.21.15.73:3300/0 conn(0x7fb7a80724d0 0x7fb7a80afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fb7a7fff700 1 -- 172.21.15.73:0/3037378058 >> 172.21.15.73:0/3037378058 conn(0x7fb7a80b45a0 msgr2=0x7fb7a80b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f1b91663700 1 Processor -- start 2023-11-30T23:12:52.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fb7a7fff700 1 -- 172.21.15.73:0/3037378058 shutdown_connections 2023-11-30T23:12:52.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f1b91663700 1 -- start start 2023-11-30T23:12:52.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f712cff9700 1 -- 172.21.15.73:0/3532949696 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7124004dd0 con 0x7f71300b0e80 2023-11-30T23:12:52.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fb7a7fff700 1 -- 172.21.15.73:0/3037378058 wait complete. 2023-11-30T23:12:52.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f015d2ab700 1 -- 172.21.15.73:0/1452596537 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f01580b3ad0 con 0x7f01580b1420 2023-11-30T23:12:52.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f5397fff700 1 -- 172.21.15.73:0/780045523 wait complete. 2023-11-30T23:12:52.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f71357e6700 1 -- 172.21.15.73:0/3532949696 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71301c88f0 con 0x7f71300b0e80 2023-11-30T23:12:52.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f712cff9700 1 -- 172.21.15.73:0/3532949696 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71240070d0 con 0x7f71300b0e80 2023-11-30T23:12:52.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f712cff9700 1 -- 172.21.15.73:0/3532949696 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7124007480 con 0x7f71300b0e80 2023-11-30T23:12:52.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7f71357e6700 1 -- 172.21.15.73:0/3532949696 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71300ad580 con 0x7f71300b0e80 2023-11-30T23:12:52.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.679+0000 7fbe4a455700 1 -- 172.21.15.73:0/4204079952 wait complete. 2023-11-30T23:12:52.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f0154ff9700 1 -- 172.21.15.73:0/1452596537 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0148007470 con 0x7f01580b1420 2023-11-30T23:12:52.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943a59f700 1 Processor -- start 2023-11-30T23:12:52.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f71357e6700 1 -- 172.21.15.73:0/3532949696 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71300ae8c0 con 0x7f71300b0e80 2023-11-30T23:12:52.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943a59f700 1 -- start start 2023-11-30T23:12:52.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fa92a178700 1 Processor -- start 2023-11-30T23:12:52.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe4a455700 1 Processor -- start 2023-11-30T23:12:52.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fb7a7fff700 1 Processor -- start 2023-11-30T23:12:52.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe4a455700 1 -- start start 2023-11-30T23:12:52.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f0154ff9700 1 --2- 172.21.15.73:0/1452596537 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0144065b50 0x7f0144068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f0154ff9700 1 -- 172.21.15.73:0/1452596537 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0148083110 con 0x7f01580b1420 2023-11-30T23:12:52.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f0157fff700 1 --2- 172.21.15.73:0/1452596537 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0144065b50 0x7f0144068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f0154ff9700 1 --2- 172.21.15.73:0/1452596537 >> [v2:172.21.15.156:6800/36908,v1:172.21.15.156:6801/36908] conn(0x7f014406dd70 0x7f0144070190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f0154ff9700 1 -- 172.21.15.73:0/1452596537 --> [v2:172.21.15.156:6800/36908,v1:172.21.15.156:6801/36908] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0144070840 con 0x7f014406dd70 2023-11-30T23:12:52.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f0154ff9700 1 -- 172.21.15.73:0/1452596537 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01480835b0 con 0x7f01580b1420 2023-11-30T23:12:52.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f015caaa700 1 --2- 172.21.15.73:0/1452596537 >> [v2:172.21.15.156:6800/36908,v1:172.21.15.156:6801/36908] conn(0x7f014406dd70 0x7f0144070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943a59f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94340b0bb0 0x7f94341455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943a59f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f94340b24a0 0x7f943414e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943a59f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9434144800 0x7f9434147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f5397fff700 1 Processor -- start 2023-11-30T23:12:52.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe4a455700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe440afab0 0x7fbe440a8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe4a455700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe440b0e80 0x7fbe440aa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe4a455700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe440b1260 0x7fbe441e3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe4a455700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4413ef40 con 0x7fbe440b1260 2023-11-30T23:12:52.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe4a455700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe440aa850 con 0x7fbe440afab0 2023-11-30T23:12:52.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe4a455700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe440ab790 con 0x7fbe440b0e80 2023-11-30T23:12:52.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f1b91663700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1b8c0adb60 0x7f1b8c0b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f0157fff700 1 --2- 172.21.15.73:0/1452596537 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0144065b50 0x7f0144068010 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f014c006b40 tx=0x7f014c006ad0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943a59f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94341e0a40 con 0x7f94340b0bb0 2023-11-30T23:12:52.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943a59f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9434147a40 con 0x7f9434144800 2023-11-30T23:12:52.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943a59f700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943414e740 con 0x7f94340b24a0 2023-11-30T23:12:52.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f712cff9700 1 -- 172.21.15.73:0/3532949696 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f71240075e0 con 0x7f71300b0e80 2023-11-30T23:12:52.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe49c54700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe440b1260 0x7fbe441e3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe49c54700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe440b1260 0x7fbe441e3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38026/0 (socket says 172.21.15.73:38026) 2023-11-30T23:12:52.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe49c54700 1 -- 172.21.15.73:0/2953654540 learned_addr learned my addr 172.21.15.73:0/2953654540 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe48c52700 1 --2- 172.21.15.73:0/2953654540 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe440b0e80 0x7fbe440aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943959d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94340b0bb0 0x7f94341455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943959d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94340b0bb0 0x7f94341455f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38024/0 (socket says 172.21.15.73:38024) 2023-11-30T23:12:52.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943959d700 1 -- 172.21.15.73:0/1643845405 learned_addr learned my addr 172.21.15.73:0/1643845405 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f9439d9e700 1 --2- 172.21.15.73:0/1643845405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9434144800 0x7f9434147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f1b8bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1b8c0adb60 0x7f1b8c0b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f1b8bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1b8c0adb60 0x7f1b8c0b05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59290/0 (socket says 172.21.15.73:59290) 2023-11-30T23:12:52.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f1b91663700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b8c14a420 0x7f1b8c150f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f1b91663700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b8c0af9d0 con 0x7f1b8c0afd70 2023-11-30T23:12:52.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f1b91663700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8c0b43d0 con 0x7f1b8c0adb60 2023-11-30T23:12:52.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f1b91663700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c0af380 con 0x7f1b8c14a420 2023-11-30T23:12:52.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f1b8bfff700 1 -- 172.21.15.73:0/2924505728 learned_addr learned my addr 172.21.15.73:0/2924505728 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f9438d9c700 1 --2- 172.21.15.73:0/1643845405 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f94340b24a0 0x7f943414e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fa92a178700 1 -- start start 2023-11-30T23:12:52.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f1b90e62700 1 --2- 172.21.15.73:0/2924505728 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b8c14a420 0x7f1b8c150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f712cff9700 1 --2- 172.21.15.73:0/3532949696 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f711c065b00 0x7f711c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f712cff9700 1 -- 172.21.15.73:0/3532949696 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7124083700 con 0x7f71300b0e80 2023-11-30T23:12:52.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fb7a7fff700 1 -- start start 2023-11-30T23:12:52.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f1b8bfff700 1 -- 172.21.15.73:0/2924505728 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b8c14a420 msgr2=0x7f1b8c150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:52.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f1b8bfff700 1 --2- 172.21.15.73:0/2924505728 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b8c14a420 0x7f1b8c150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f1b8bfff700 1 -- 172.21.15.73:0/2924505728 >> v1:172.21.15.73:6789/0 conn(0x7f1b8c0afd70 legacy=0x7f1b8c149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f1b8bfff700 1 -- 172.21.15.73:0/2924505728 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c0af660 con 0x7f1b8c0adb60 2023-11-30T23:12:52.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f712ffff700 1 --2- 172.21.15.73:0/3532949696 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f711c065b00 0x7f711c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f712cff9700 1 --2- 172.21.15.73:0/3532949696 >> [v2:172.21.15.73:6800/36685,v1:172.21.15.73:6801/36685] conn(0x7f711c06dca0 0x7f711c0700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f712cff9700 1 -- 172.21.15.73:0/3532949696 --> [v2:172.21.15.73:6800/36685,v1:172.21.15.73:6801/36685] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f711c070770 con 0x7f711c06dca0 2023-11-30T23:12:52.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f712cff9700 1 -- 172.21.15.73:0/3532949696 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7124083b50 con 0x7f71300b0e80 2023-11-30T23:12:52.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943959d700 1 -- 172.21.15.73:0/1643845405 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f94340b24a0 msgr2=0x7f943414e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943959d700 1 --2- 172.21.15.73:0/1643845405 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f94340b24a0 0x7f943414e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943959d700 1 -- 172.21.15.73:0/1643845405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9434144800 msgr2=0x7f9434147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943959d700 1 --2- 172.21.15.73:0/1643845405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9434144800 0x7f9434147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943959d700 1 -- 172.21.15.73:0/1643845405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94300094b0 con 0x7f94340b0bb0 2023-11-30T23:12:52.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943959d700 1 --2- 172.21.15.73:0/1643845405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94340b0bb0 0x7f94341455f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f943000ec10 tx=0x7f943000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe48c52700 1 -- 172.21.15.73:0/2953654540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe440afab0 msgr2=0x7fbe440a8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe48c52700 1 --2- 172.21.15.73:0/2953654540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe440afab0 0x7fbe440a8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe48c52700 1 -- 172.21.15.73:0/2953654540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe440b1260 msgr2=0x7fbe441e3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe48c52700 1 --2- 172.21.15.73:0/2953654540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe440b1260 0x7fbe441e3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe48c52700 1 -- 172.21.15.73:0/2953654540 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe340085f0 con 0x7fbe440b0e80 2023-11-30T23:12:52.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f7134fe5700 1 --2- 172.21.15.73:0/3532949696 >> [v2:172.21.15.73:6800/36685,v1:172.21.15.73:6801/36685] conn(0x7f711c06dca0 0x7f711c0700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f9429ffb700 1 -- 172.21.15.73:0/1643845405 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943000c850 con 0x7f94340b0bb0 2023-11-30T23:12:52.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe48c52700 1 --2- 172.21.15.73:0/2953654540 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe440b0e80 0x7fbe440aa310 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00cb90 tx=0x7fbe3c00cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f712ffff700 1 --2- 172.21.15.73:0/3532949696 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f711c065b00 0x7f711c067fc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7120000f60 tx=0x7f7120007a60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f015caaa700 1 --2- 172.21.15.73:0/1452596537 >> [v2:172.21.15.156:6800/36908,v1:172.21.15.156:6801/36908] conn(0x7f014406dd70 0x7f0144070190 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f9429ffb700 1 -- 172.21.15.73:0/1643845405 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943000c9b0 con 0x7f94340b0bb0 2023-11-30T23:12:52.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f9429ffb700 1 -- 172.21.15.73:0/1643845405 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943000cd40 con 0x7f94340b0bb0 2023-11-30T23:12:52.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943a59f700 1 -- 172.21.15.73:0/1643845405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9424009570 con 0x7f94340b0bb0 2023-11-30T23:12:52.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f943a59f700 1 -- 172.21.15.73:0/1643845405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94341473f0 con 0x7f94340b0bb0 2023-11-30T23:12:52.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f5397fff700 1 -- start start 2023-11-30T23:12:52.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f1b8bfff700 1 --2- 172.21.15.73:0/2924505728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b8c0adb60 0x7f1b8c0b05f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009910 tx=0x7f1b7c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2550b87c17bd716b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe39ffb700 1 -- 172.21.15.73:0/2953654540 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00aa80 con 0x7fbe440b0e80 2023-11-30T23:12:52.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe39ffb700 1 -- 172.21.15.73:0/2953654540 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c00abe0 con 0x7fbe440b0e80 2023-11-30T23:12:52.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7f7134fe5700 1 --2- 172.21.15.73:0/3532949696 >> [v2:172.21.15.73:6800/36685,v1:172.21.15.73:6801/36685] conn(0x7f711c06dca0 0x7f711c0700c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe4a455700 1 -- 172.21.15.73:0/2953654540 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe440abc70 con 0x7fbe440b0e80 2023-11-30T23:12:52.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.683+0000 7fbe4a455700 1 -- 172.21.15.73:0/2953654540 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe440ac1b0 con 0x7fbe440b0e80 2023-11-30T23:12:52.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f943a59f700 1 -- 172.21.15.73:0/1643845405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f943414ac20 con 0x7f94340b0bb0 2023-11-30T23:12:52.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7a80724d0 0x7fb7a8070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a7fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7a8145c10 0x7fb7a81d78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7a8145ff0 0x7fb7a81d7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a7fff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a8071230 con 0x7fb7a80724d0 2023-11-30T23:12:52.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a7fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a813d5e0 con 0x7fb7a8145ff0 2023-11-30T23:12:52.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a7fff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a806f490 con 0x7fb7a8145c10 2023-11-30T23:12:52.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f1b8affd700 1 -- 172.21.15.73:0/2924505728 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c00ba60 con 0x7f1b8c0adb60 2023-11-30T23:12:52.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f1b8affd700 1 -- 172.21.15.73:0/2924505728 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c00bbc0 con 0x7f1b8c0adb60 2023-11-30T23:12:52.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f1b8affd700 1 -- 172.21.15.73:0/2924505728 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c009e60 con 0x7f1b8c0adb60 2023-11-30T23:12:52.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fa92a178700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa924066490 0x7fa9241432a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fa92a178700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa924066870 0x7fa92413d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fbe39ffb700 1 -- 172.21.15.73:0/2953654540 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c012420 con 0x7fbe440b0e80 2023-11-30T23:12:52.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a67fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7a8145c10 0x7fb7a81d78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a67fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7a8145c10 0x7fb7a81d78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:42962/0 (socket says 172.21.15.73:42962) 2023-11-30T23:12:52.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a67fc700 1 -- 172.21.15.73:0/2874831595 learned_addr learned my addr 172.21.15.73:0/2874831595 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a77fe700 1 --2- 172.21.15.73:0/2874831595 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7a8145ff0 0x7fb7a81d7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f712cff9700 1 -- 172.21.15.73:0/3532949696 <== osd.3 v2:172.21.15.73:6800/36685 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f711c070770 con 0x7f711c06dca0 2023-11-30T23:12:52.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f9429ffb700 1 -- 172.21.15.73:0/1643845405 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9430013470 con 0x7f94340b0bb0 2023-11-30T23:12:52.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f5397fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53980b15d0 0x7f539814aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f5397fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53980b2fa0 0x7f53981e31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f5397fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53981403b0 0x7f53981e3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f5397fff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539813e6c0 con 0x7f53980b15d0 2023-11-30T23:12:52.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f5397fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53980a99d0 con 0x7f53980b2fa0 2023-11-30T23:12:52.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f5397fff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539806ffa0 con 0x7f53981403b0 2023-11-30T23:12:52.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f53967fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53980b2fa0 0x7f53981e31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f53967fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53980b2fa0 0x7f53981e31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59292/0 (socket says 172.21.15.73:59292) 2023-11-30T23:12:52.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f53967fc700 1 -- 172.21.15.73:0/953420353 learned_addr learned my addr 172.21.15.73:0/953420353 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f53977fe700 1 --2- 172.21.15.73:0/953420353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53981403b0 0x7f53981e3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f5396ffd700 1 --2- 172.21.15.73:0/953420353 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53980b15d0 0x7f539814aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fa928975700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa924066870 0x7fa92413d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fa928975700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa924066870 0x7fa92413d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59310/0 (socket says 172.21.15.73:59310) 2023-11-30T23:12:52.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fa928975700 1 -- 172.21.15.73:0/911926068 learned_addr learned my addr 172.21.15.73:0/911926068 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f0154ff9700 1 -- 172.21.15.73:0/1452596537 <== osd.4 v2:172.21.15.156:6800/36908 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0144070840 con 0x7f014406dd70 2023-11-30T23:12:52.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f1b91663700 1 -- 172.21.15.73:0/2924505728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b8c0adb60 msgr2=0x7f1b8c0b05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f1b91663700 1 --2- 172.21.15.73:0/2924505728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b8c0adb60 0x7f1b8c0b05f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009910 tx=0x7f1b7c009c20 comp rx=0 tx=0).stop 2023-11-30T23:12:52.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f53977fe700 1 -- 172.21.15.73:0/953420353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53980b2fa0 msgr2=0x7f53981e31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f53977fe700 1 --2- 172.21.15.73:0/953420353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f53980b2fa0 0x7f53981e31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f53977fe700 1 -- 172.21.15.73:0/953420353 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53980b15d0 msgr2=0x7f539814aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f53977fe700 1 --2- 172.21.15.73:0/953420353 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53980b15d0 0x7f539814aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f53977fe700 1 -- 172.21.15.73:0/953420353 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5390009a70 con 0x7f53981403b0 2023-11-30T23:12:52.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fbe4a455700 1 -- 172.21.15.73:0/2953654540 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe441433d0 con 0x7fbe440b0e80 2023-11-30T23:12:52.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f9429ffb700 1 --2- 172.21.15.73:0/1643845405 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9418065ad0 0x7f9418067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f53977fe700 1 --2- 172.21.15.73:0/953420353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53981403b0 0x7f53981e3700 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f538800d560 tx=0x7f538800d870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f9429ffb700 1 -- 172.21.15.73:0/1643845405 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9430083210 con 0x7f94340b0bb0 2023-11-30T23:12:52.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f9438d9c700 1 --2- 172.21.15.73:0/1643845405 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9418065ad0 0x7f9418067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f9429ffb700 1 --2- 172.21.15.73:0/1643845405 >> [v2:172.21.15.156:6808/36909,v1:172.21.15.156:6809/36909] conn(0x7f941806dc70 0x7f9418070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f9429ffb700 1 -- 172.21.15.73:0/1643845405 --> [v2:172.21.15.156:6808/36909,v1:172.21.15.156:6809/36909] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9418070740 con 0x7f941806dc70 2023-11-30T23:12:52.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f1b91663700 1 -- 172.21.15.73:0/2924505728 shutdown_connections 2023-11-30T23:12:52.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f1b91663700 1 --2- 172.21.15.73:0/2924505728 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b8c14a420 0x7f1b8c150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f1b91663700 1 --2- 172.21.15.73:0/2924505728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b8c0adb60 0x7f1b8c0b05f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f1b91663700 1 -- 172.21.15.73:0/2924505728 >> 172.21.15.73:0/2924505728 conn(0x7f1b8c06ab90 msgr2=0x7f1b8c0b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f1b91663700 1 -- 172.21.15.73:0/2924505728 shutdown_connections 2023-11-30T23:12:52.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f9429ffb700 1 -- 172.21.15.73:0/1643845405 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94300857f0 con 0x7f94340b0bb0 2023-11-30T23:12:52.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f9438d9c700 1 --2- 172.21.15.73:0/1643845405 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9418065ad0 0x7f9418067f90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f94340b28c0 tx=0x7f942401d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f9439d9e700 1 --2- 172.21.15.73:0/1643845405 >> [v2:172.21.15.156:6808/36909,v1:172.21.15.156:6809/36909] conn(0x7f941806dc70 0x7f9418070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f537f7fe700 1 -- 172.21.15.73:0/953420353 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53880125f0 con 0x7f53981403b0 2023-11-30T23:12:52.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f537f7fe700 1 -- 172.21.15.73:0/953420353 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5388012750 con 0x7f53981403b0 2023-11-30T23:12:52.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f5397fff700 1 -- 172.21.15.73:0/953420353 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53981e4050 con 0x7f53981403b0 2023-11-30T23:12:52.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f537f7fe700 1 -- 172.21.15.73:0/953420353 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388012b00 con 0x7f53981403b0 2023-11-30T23:12:52.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f5397fff700 1 -- 172.21.15.73:0/953420353 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53980aa580 con 0x7f53981403b0 2023-11-30T23:12:52.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f1b91663700 1 -- 172.21.15.73:0/2924505728 wait complete. 2023-11-30T23:12:52.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7f9439d9e700 1 --2- 172.21.15.73:0/1643845405 >> [v2:172.21.15.156:6808/36909,v1:172.21.15.156:6809/36909] conn(0x7f941806dc70 0x7f9418070090 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a6ffd700 1 --2- 172.21.15.73:0/2874831595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7a80724d0 0x7fb7a8070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a67fc700 1 -- 172.21.15.73:0/2874831595 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7a8145ff0 msgr2=0x7fb7a81d7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a67fc700 1 --2- 172.21.15.73:0/2874831595 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7a8145ff0 0x7fb7a81d7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a67fc700 1 -- 172.21.15.73:0/2874831595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7a80724d0 msgr2=0x7fb7a8070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a67fc700 1 --2- 172.21.15.73:0/2874831595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7a80724d0 0x7fb7a8070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a67fc700 1 -- 172.21.15.73:0/2874831595 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a0007790 con 0x7fb7a8145c10 2023-11-30T23:12:52.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a67fc700 1 --2- 172.21.15.73:0/2874831595 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7a8145c10 0x7fb7a81d78e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0010c00 tx=0x7fb7a0004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb78f7fe700 1 -- 172.21.15.73:0/2874831595 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0003c40 con 0x7fb7a8145c10 2023-11-30T23:12:52.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb78f7fe700 1 -- 172.21.15.73:0/2874831595 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a0028070 con 0x7fb7a8145c10 2023-11-30T23:12:52.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a7fff700 1 -- 172.21.15.73:0/2874831595 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a81d73e0 con 0x7fb7a8145c10 2023-11-30T23:12:52.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb78f7fe700 1 -- 172.21.15.73:0/2874831595 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a001aee0 con 0x7fb7a8145c10 2023-11-30T23:12:52.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fb7a7fff700 1 -- 172.21.15.73:0/2874831595 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a8071840 con 0x7fb7a8145c10 2023-11-30T23:12:52.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa929176700 1 --2- 172.21.15.73:0/911926068 >> v2:172.21.15.73:3300/0 conn(0x7fa924066490 0x7fa9241432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.687+0000 7fbe39ffb700 1 -- 172.21.15.73:0/2953654540 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbe3c012580 con 0x7fbe440b0e80 2023-11-30T23:12:52.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fbe39ffb700 1 --2- 172.21.15.73:0/2953654540 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbe28065b50 0x7fbe28068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fbe39ffb700 1 -- 172.21.15.73:0/2953654540 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe3c083de0 con 0x7fbe440b0e80 2023-11-30T23:12:52.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fbe49453700 1 --2- 172.21.15.73:0/2953654540 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbe28065b50 0x7fbe28068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fbe39ffb700 1 --2- 172.21.15.73:0/2953654540 >> [v2:172.21.15.73:6816/36686,v1:172.21.15.73:6817/36686] conn(0x7fbe2806dcf0 0x7fbe28070110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fbe39ffb700 1 -- 172.21.15.73:0/2953654540 --> [v2:172.21.15.73:6816/36686,v1:172.21.15.73:6817/36686] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe280707c0 con 0x7fbe2806dcf0 2023-11-30T23:12:52.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fbe39ffb700 1 -- 172.21.15.73:0/2953654540 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe3c084230 con 0x7fbe440b0e80 2023-11-30T23:12:52.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fbe49c54700 1 --2- 172.21.15.73:0/2953654540 >> [v2:172.21.15.73:6816/36686,v1:172.21.15.73:6817/36686] conn(0x7fbe2806dcf0 0x7fbe28070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b91663700 1 Processor -- start 2023-11-30T23:12:52.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b91663700 1 -- start start 2023-11-30T23:12:52.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f9429ffb700 1 -- 172.21.15.73:0/1643845405 <== osd.5 v2:172.21.15.156:6808/36909 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9418070740 con 0x7f941806dc70 2023-11-30T23:12:52.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa92a178700 1 -- 172.21.15.73:0/911926068 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9240b1a10 con 0x7fa9241437e0 2023-11-30T23:12:52.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa92a178700 1 -- 172.21.15.73:0/911926068 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9240b4880 con 0x7fa924066490 2023-11-30T23:12:52.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa92a178700 1 -- 172.21.15.73:0/911926068 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9240b1cf0 con 0x7fa924066870 2023-11-30T23:12:52.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fbe49453700 1 --2- 172.21.15.73:0/2953654540 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbe28065b50 0x7fbe28068010 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400d370 tx=0x7fbe34014000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fb7a7fff700 1 -- 172.21.15.73:0/2874831595 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb788000fc0 con 0x7fb7a8145c10 2023-11-30T23:12:52.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa91bfff700 1 -- 172.21.15.73:0/911926068 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691676285 0 0) 0x7fa9240b1a10 con 0x7fa9241437e0 2023-11-30T23:12:52.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa928975700 1 -- 172.21.15.73:0/911926068 >> v2:172.21.15.73:3300/0 conn(0x7fa924066490 msgr2=0x7fa9241432a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:52.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa928975700 1 --2- 172.21.15.73:0/911926068 >> v2:172.21.15.73:3300/0 conn(0x7fa924066490 0x7fa9241432a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa928975700 1 -- 172.21.15.73:0/911926068 >> v1:172.21.15.73:6789/0 conn(0x7fa9241437e0 legacy=0x7fa924146890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa928975700 1 -- 172.21.15.73:0/911926068 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9240b2180 con 0x7fa924066870 2023-11-30T23:12:52.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa929176700 1 --2- 172.21.15.73:0/911926068 >> v2:172.21.15.73:3300/0 conn(0x7fa924066490 0x7fa9241432a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-30T23:12:52.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa928975700 1 --2- 172.21.15.73:0/911926068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa924066870 0x7fa92413d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa9240723e0 tx=0x7fa914009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c130558b93c2737a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa91bfff700 1 -- 172.21.15.73:0/911926068 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91400b8a0 con 0x7fa924066870 2023-11-30T23:12:52.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa91bfff700 1 -- 172.21.15.73:0/911926068 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91400ba00 con 0x7fa924066870 2023-11-30T23:12:52.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa91bfff700 1 -- 172.21.15.73:0/911926068 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91400bd70 con 0x7fa924066870 2023-11-30T23:12:52.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa92a178700 1 -- 172.21.15.73:0/911926068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa924066870 msgr2=0x7fa92413d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa92a178700 1 --2- 172.21.15.73:0/911926068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa924066870 0x7fa92413d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa9240723e0 tx=0x7fa914009bf0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa92a178700 1 -- 172.21.15.73:0/911926068 shutdown_connections 2023-11-30T23:12:52.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa92a178700 1 --2- 172.21.15.73:0/911926068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa924066870 0x7fa92413d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa92a178700 1 --2- 172.21.15.73:0/911926068 >> v2:172.21.15.73:3300/0 conn(0x7fa924066490 0x7fa9241432a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa92a178700 1 -- 172.21.15.73:0/911926068 >> 172.21.15.73:0/911926068 conn(0x7fa9240b4fe0 msgr2=0x7fa9240b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa92a178700 1 -- 172.21.15.73:0/911926068 shutdown_connections 2023-11-30T23:12:52.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fa92a178700 1 -- 172.21.15.73:0/911926068 wait complete. 2023-11-30T23:12:52.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fb78f7fe700 1 -- 172.21.15.73:0/2874831595 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb7a002a030 con 0x7fb7a8145c10 2023-11-30T23:12:52.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fb78f7fe700 1 --2- 172.21.15.73:0/2874831595 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb794065ad0 0x7fb794067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fb78f7fe700 1 -- 172.21.15.73:0/2874831595 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7a008d440 con 0x7fb7a8145c10 2023-11-30T23:12:52.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fb7a6ffd700 1 --2- 172.21.15.73:0/2874831595 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb794065ad0 0x7fb794067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fb78f7fe700 1 --2- 172.21.15.73:0/2874831595 >> [v2:172.21.15.73:6808/36687,v1:172.21.15.73:6809/36687] conn(0x7fb79406dcf0 0x7fb794070110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fb78f7fe700 1 -- 172.21.15.73:0/2874831595 --> [v2:172.21.15.73:6808/36687,v1:172.21.15.73:6809/36687] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7940707c0 con 0x7fb79406dcf0 2023-11-30T23:12:52.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7fb78f7fe700 1 -- 172.21.15.73:0/2874831595 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7a008fa60 con 0x7fb7a8145c10 2023-11-30T23:12:52.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fb7a77fe700 1 --2- 172.21.15.73:0/2874831595 >> [v2:172.21.15.73:6808/36687,v1:172.21.15.73:6809/36687] conn(0x7fb79406dcf0 0x7fb794070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fb7a77fe700 1 --2- 172.21.15.73:0/2874831595 >> [v2:172.21.15.73:6808/36687,v1:172.21.15.73:6809/36687] conn(0x7fb79406dcf0 0x7fb794070110 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa92a178700 1 Processor -- start 2023-11-30T23:12:52.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fb7a6ffd700 1 --2- 172.21.15.73:0/2874831595 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb794065ad0 0x7fb794067f90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb798007fd0 tx=0x7fb798009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa92a178700 1 -- start start 2023-11-30T23:12:52.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fb78f7fe700 1 -- 172.21.15.73:0/2874831595 <== osd.1 v2:172.21.15.73:6808/36687 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb7940707c0 con 0x7fb79406dcf0 2023-11-30T23:12:52.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa92a178700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa924066490 0x7fa9241424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa92a178700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa924066870 0x7fa9241e3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa92a178700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9241437e0 0x7fa9241e3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa92a178700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa924143270 con 0x7fa9241437e0 2023-11-30T23:12:52.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa92a178700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa924143060 con 0x7fa924066870 2023-11-30T23:12:52.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa92a178700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240a9380 con 0x7fa924066490 2023-11-30T23:12:52.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa929977700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9241437e0 0x7fa9241e3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa929176700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa924066490 0x7fa9241424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa929977700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9241437e0 0x7fa9241e3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38080/0 (socket says 172.21.15.73:38080) 2023-11-30T23:12:52.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa929977700 1 -- 172.21.15.73:0/1446511619 learned_addr learned my addr 172.21.15.73:0/1446511619 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa928975700 1 --2- 172.21.15.73:0/1446511619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa924066870 0x7fa9241e3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa929977700 1 -- 172.21.15.73:0/1446511619 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa924066490 msgr2=0x7fa9241424d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa929977700 1 --2- 172.21.15.73:0/1446511619 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa924066490 0x7fa9241424d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa929977700 1 -- 172.21.15.73:0/1446511619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa924066870 msgr2=0x7fa9241e3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa929977700 1 --2- 172.21.15.73:0/1446511619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa924066870 0x7fa9241e3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa929977700 1 -- 172.21.15.73:0/1446511619 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa914009570 con 0x7fa9241437e0 2023-11-30T23:12:52.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa929176700 1 --2- 172.21.15.73:0/1446511619 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa924066490 0x7fa9241424d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:52.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7fa929977700 1 --2- 172.21.15.73:0/1446511619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9241437e0 0x7fa9241e3aa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00cb90 tx=0x7fa91c00cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f537f7fe700 1 -- 172.21.15.73:0/953420353 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5388012c60 con 0x7f53981403b0 2023-11-30T23:12:52.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f537f7fe700 1 --2- 172.21.15.73:0/953420353 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f5384065ad0 0x7f5384067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f537f7fe700 1 -- 172.21.15.73:0/953420353 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5388083130 con 0x7f53981403b0 2023-11-30T23:12:52.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f5396ffd700 1 --2- 172.21.15.73:0/953420353 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f5384065ad0 0x7f5384067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f5396ffd700 1 --2- 172.21.15.73:0/953420353 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f5384065ad0 0x7f5384067f90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5390014040 tx=0x7f5390011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b91663700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b8c0adb60 0x7f1b8c0a9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b91663700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b8c0afd70 0x7f1b8c146d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b8b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b8c0afd70 0x7f1b8c146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b8b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b8c0afd70 0x7f1b8c146d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38078/0 (socket says 172.21.15.73:38078) 2023-11-30T23:12:52.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b91663700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b8c14a420 0x7f1b8c1df600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b8bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b8c0adb60 0x7f1b8c0a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b8bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b8c0adb60 0x7f1b8c0a9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59326/0 (socket says 172.21.15.73:59326) 2023-11-30T23:12:52.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b91663700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c0aa1f0 con 0x7f1b8c0afd70 2023-11-30T23:12:52.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b91663700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c1df1e0 con 0x7f1b8c0adb60 2023-11-30T23:12:52.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b91663700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c0a9e70 con 0x7f1b8c14a420 2023-11-30T23:12:52.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b90e62700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b8c14a420 0x7f1b8c1df600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b90e62700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b8c14a420 0x7f1b8c1df600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:42970/0 (socket says 172.21.15.73:42970) 2023-11-30T23:12:52.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b90e62700 1 -- 172.21.15.73:0/3387489994 learned_addr learned my addr 172.21.15.73:0/3387489994 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b90e62700 1 -- 172.21.15.73:0/3387489994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b8c0adb60 msgr2=0x7f1b8c0a9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b90e62700 1 --2- 172.21.15.73:0/3387489994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b8c0adb60 0x7f1b8c0a9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b90e62700 1 -- 172.21.15.73:0/3387489994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b8c0afd70 msgr2=0x7f1b8c146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b90e62700 1 --2- 172.21.15.73:0/3387489994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b8c0afd70 0x7f1b8c146d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b90e62700 1 -- 172.21.15.73:0/3387489994 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c009570 con 0x7f1b8c14a420 2023-11-30T23:12:52.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b90e62700 1 --2- 172.21.15.73:0/3387489994 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b8c14a420 0x7f1b8c1df600 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1b84007e90 tx=0x7f1b8400e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b8b7fe700 1 --2- 172.21.15.73:0/3387489994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b8c0afd70 0x7f1b8c146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-11-30T23:12:52.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b8bfff700 1 --2- 172.21.15.73:0/3387489994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b8c0adb60 0x7f1b8c0a9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-11-30T23:12:52.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b88ff9700 1 -- 172.21.15.73:0/3387489994 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8400ede0 con 0x7f1b8c14a420 2023-11-30T23:12:52.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.691+0000 7f1b88ff9700 1 -- 172.21.15.73:0/3387489994 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b84014420 con 0x7f1b8c14a420 2023-11-30T23:12:52.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7f1b91663700 1 -- 172.21.15.73:0/3387489994 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8c0acd80 con 0x7f1b8c14a420 2023-11-30T23:12:52.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7f1b91663700 1 -- 172.21.15.73:0/3387489994 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8c143200 con 0x7f1b8c14a420 2023-11-30T23:12:52.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7f1b88ff9700 1 -- 172.21.15.73:0/3387489994 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b840147b0 con 0x7f1b8c14a420 2023-11-30T23:12:52.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.695+0000 7f1b91663700 1 -- 172.21.15.73:0/3387489994 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b78000fc0 con 0x7f1b8c14a420 2023-11-30T23:12:52.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7fa919ffb700 1 -- 172.21.15.73:0/1446511619 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c003e50 con 0x7fa9241437e0 2023-11-30T23:12:52.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7f1b88ff9700 1 -- 172.21.15.73:0/3387489994 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1b84014910 con 0x7f1b8c14a420 2023-11-30T23:12:52.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7f5397fff700 1 --2- 172.21.15.73:0/953420353 >> [v2:172.21.15.156:6816/36910,v1:172.21.15.156:6817/36910] conn(0x7f539814b400 0x7f5398070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7fbe49c54700 1 --2- 172.21.15.73:0/2953654540 >> [v2:172.21.15.73:6816/36686,v1:172.21.15.73:6817/36686] conn(0x7fbe2806dcf0 0x7fbe28070110 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7fa92a178700 1 -- 172.21.15.73:0/1446511619 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa924140940 con 0x7fa9241437e0 2023-11-30T23:12:52.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7fa92a178700 1 -- 172.21.15.73:0/1446511619 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9240a8fe0 con 0x7fa9241437e0 2023-11-30T23:12:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7fa919ffb700 1 -- 172.21.15.73:0/1446511619 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c00a6b0 con 0x7fa9241437e0 2023-11-30T23:12:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7fa919ffb700 1 -- 172.21.15.73:0/1446511619 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c00aa60 con 0x7fa9241437e0 2023-11-30T23:12:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7fa92a178700 1 -- 172.21.15.73:0/1446511619 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa9240b4a90 con 0x7fa9241437e0 2023-11-30T23:12:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7f5397fff700 1 -- 172.21.15.73:0/953420353 --> [v2:172.21.15.156:6816/36910,v1:172.21.15.156:6817/36910] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53980b1a50 con 0x7f539814b400 2023-11-30T23:12:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7f53967fc700 1 --2- 172.21.15.73:0/953420353 >> [v2:172.21.15.156:6816/36910,v1:172.21.15.156:6817/36910] conn(0x7f539814b400 0x7f5398070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7fbe39ffb700 1 -- 172.21.15.73:0/2953654540 <== osd.0 v2:172.21.15.73:6816/36686 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbe280707c0 con 0x7fbe2806dcf0 2023-11-30T23:12:52.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7f53967fc700 1 --2- 172.21.15.73:0/953420353 >> [v2:172.21.15.156:6816/36910,v1:172.21.15.156:6817/36910] conn(0x7f539814b400 0x7f5398070480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7f1b88ff9700 1 --2- 172.21.15.73:0/3387489994 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f1b74065d30 0x7f1b740681f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7f1b8bfff700 1 --2- 172.21.15.73:0/3387489994 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f1b74065d30 0x7f1b740681f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7f537f7fe700 1 -- 172.21.15.73:0/953420353 <== osd.6 v2:172.21.15.156:6816/36910 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f538c009dc0 con 0x7f539814b400 2023-11-30T23:12:52.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7f1b88ff9700 1 -- 172.21.15.73:0/3387489994 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b84083820 con 0x7f1b8c14a420 2023-11-30T23:12:52.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7f1b8bfff700 1 --2- 172.21.15.73:0/3387489994 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f1b74065d30 0x7f1b740681f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c000c00 tx=0x7f1b7c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7f1b88ff9700 1 --2- 172.21.15.73:0/3387489994 >> [v2:172.21.15.73:6824/36688,v1:172.21.15.73:6825/36688] conn(0x7f1b7406df50 0x7f1b74070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7f1b88ff9700 1 -- 172.21.15.73:0/3387489994 --> [v2:172.21.15.73:6824/36688,v1:172.21.15.73:6825/36688] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b74070a20 con 0x7f1b7406df50 2023-11-30T23:12:52.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7f1b8b7fe700 1 --2- 172.21.15.73:0/3387489994 >> [v2:172.21.15.73:6824/36688,v1:172.21.15.73:6825/36688] conn(0x7f1b7406df50 0x7f1b74070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7fa919ffb700 1 -- 172.21.15.73:0/1446511619 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa91c00abc0 con 0x7fa9241437e0 2023-11-30T23:12:52.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7fa919ffb700 1 --2- 172.21.15.73:0/1446511619 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa908065ba0 0x7fa908068060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7fa919ffb700 1 -- 172.21.15.73:0/1446511619 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa91c083230 con 0x7fa9241437e0 2023-11-30T23:12:52.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7fa919ffb700 1 --2- 172.21.15.73:0/1446511619 >> [v2:172.21.15.156:6824/36911,v1:172.21.15.156:6825/36911] conn(0x7fa90806ddc0 0x7fa9080701e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7fa919ffb700 1 -- 172.21.15.73:0/1446511619 --> [v2:172.21.15.156:6824/36911,v1:172.21.15.156:6825/36911] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa908070890 con 0x7fa90806ddc0 2023-11-30T23:12:52.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7fa919ffb700 1 -- 172.21.15.73:0/1446511619 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa91c0835e0 con 0x7fa9241437e0 2023-11-30T23:12:52.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7fa929176700 1 --2- 172.21.15.73:0/1446511619 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa908065ba0 0x7fa908068060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7f1b88ff9700 1 -- 172.21.15.73:0/3387489994 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b84085e40 con 0x7f1b8c14a420 2023-11-30T23:12:52.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.703+0000 7f1b8b7fe700 1 --2- 172.21.15.73:0/3387489994 >> [v2:172.21.15.73:6824/36688,v1:172.21.15.73:6825/36688] conn(0x7f1b7406df50 0x7f1b74070370 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.707+0000 7fa928975700 1 --2- 172.21.15.73:0/1446511619 >> [v2:172.21.15.156:6824/36911,v1:172.21.15.156:6825/36911] conn(0x7fa90806ddc0 0x7fa9080701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.707+0000 7f1b88ff9700 1 -- 172.21.15.73:0/3387489994 <== osd.2 v2:172.21.15.73:6824/36688 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1b74070a20 con 0x7f1b7406df50 2023-11-30T23:12:52.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.711+0000 7f71357e6700 1 -- 172.21.15.73:0/3532949696 --> [v2:172.21.15.73:6800/36685,v1:172.21.15.73:6801/36685] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f71301d15f0 con 0x7f711c06dca0 2023-11-30T23:12:52.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.711+0000 7f015d2ab700 1 -- 172.21.15.73:0/1452596537 --> [v2:172.21.15.156:6800/36908,v1:172.21.15.156:6801/36908] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f01580b1800 con 0x7f014406dd70 2023-11-30T23:12:52.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.711+0000 7f712cff9700 1 -- 172.21.15.73:0/3532949696 <== osd.3 v2:172.21.15.73:6800/36685 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f71301d15f0 con 0x7f711c06dca0 2023-11-30T23:12:52.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.711+0000 7fa928975700 1 --2- 172.21.15.73:0/1446511619 >> [v2:172.21.15.156:6824/36911,v1:172.21.15.156:6825/36911] conn(0x7fa90806ddc0 0x7fa9080701e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.711+0000 7fa929176700 1 --2- 172.21.15.73:0/1446511619 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa908065ba0 0x7fa908068060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa92000af30 tx=0x7fa920008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.711+0000 7f0154ff9700 1 -- 172.21.15.73:0/1452596537 <== osd.4 v2:172.21.15.156:6800/36908 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f01500099b0 con 0x7f014406dd70 2023-11-30T23:12:52.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.711+0000 7f71357e6700 1 -- 172.21.15.73:0/3532949696 >> [v2:172.21.15.73:6800/36685,v1:172.21.15.73:6801/36685] conn(0x7f711c06dca0 msgr2=0x7f711c0700c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.711+0000 7f71357e6700 1 --2- 172.21.15.73:0/3532949696 >> [v2:172.21.15.73:6800/36685,v1:172.21.15.73:6801/36685] conn(0x7f711c06dca0 0x7f711c0700c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.711+0000 7f71357e6700 1 -- 172.21.15.73:0/3532949696 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f711c065b00 msgr2=0x7f711c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.711+0000 7f71357e6700 1 --2- 172.21.15.73:0/3532949696 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f711c065b00 0x7f711c067fc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7120000f60 tx=0x7f7120007a60 comp rx=0 tx=0).stop 2023-11-30T23:12:52.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.711+0000 7f71357e6700 1 -- 172.21.15.73:0/3532949696 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71300b0e80 msgr2=0x7f71301ec370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.711+0000 7f71357e6700 1 --2- 172.21.15.73:0/3532949696 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f71300b0e80 0x7f71301ec370 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f712400c570 tx=0x7f712400c880 comp rx=0 tx=0).stop 2023-11-30T23:12:52.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.711+0000 7f7134fe5700 1 -- 172.21.15.73:0/3532949696 reap_dead start 2023-11-30T23:12:52.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.711+0000 7fa919ffb700 1 -- 172.21.15.73:0/1446511619 <== osd.7 v2:172.21.15.156:6824/36911 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa908070890 con 0x7fa90806ddc0 2023-11-30T23:12:52.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.715+0000 7f71357e6700 1 -- 172.21.15.73:0/3532949696 shutdown_connections 2023-11-30T23:12:52.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.715+0000 7f71357e6700 1 -- 172.21.15.73:0/3532949696 >> 172.21.15.73:0/3532949696 conn(0x7f713006ab90 msgr2=0x7f71301d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.715+0000 7f71357e6700 1 -- 172.21.15.73:0/3532949696 shutdown_connections 2023-11-30T23:12:52.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.715+0000 7f71357e6700 1 -- 172.21.15.73:0/3532949696 wait complete. 2023-11-30T23:12:52.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.715+0000 7f015d2ab700 1 -- 172.21.15.73:0/1452596537 >> [v2:172.21.15.156:6800/36908,v1:172.21.15.156:6801/36908] conn(0x7f014406dd70 msgr2=0x7f0144070190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.715+0000 7f015d2ab700 1 --2- 172.21.15.73:0/1452596537 >> [v2:172.21.15.156:6800/36908,v1:172.21.15.156:6801/36908] conn(0x7f014406dd70 0x7f0144070190 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.715+0000 7f015d2ab700 1 -- 172.21.15.73:0/1452596537 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0144065b50 msgr2=0x7f0144068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.715+0000 7f015d2ab700 1 --2- 172.21.15.73:0/1452596537 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0144065b50 0x7f0144068010 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f014c006b40 tx=0x7f014c006ad0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.715+0000 7f015d2ab700 1 -- 172.21.15.73:0/1452596537 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01580b1420 msgr2=0x7f01580b0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.715+0000 7f015d2ab700 1 --2- 172.21.15.73:0/1452596537 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f01580b1420 0x7f01580b0a90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f014800c4e0 tx=0x7f014800c7f0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.715+0000 7f015caaa700 1 -- 172.21.15.73:0/1452596537 reap_dead start 2023-11-30T23:12:52.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.715+0000 7f015d2ab700 1 -- 172.21.15.73:0/1452596537 shutdown_connections 2023-11-30T23:12:52.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.715+0000 7f015d2ab700 1 -- 172.21.15.73:0/1452596537 >> 172.21.15.73:0/1452596537 conn(0x7f015806ab90 msgr2=0x7f015813b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.715+0000 7f015d2ab700 1 -- 172.21.15.73:0/1452596537 shutdown_connections 2023-11-30T23:12:52.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.715+0000 7f015d2ab700 1 -- 172.21.15.73:0/1452596537 wait complete. 2023-11-30T23:12:52.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.715+0000 7f943a59f700 1 -- 172.21.15.73:0/1643845405 --> [v2:172.21.15.156:6808/36909,v1:172.21.15.156:6809/36909] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f943414b960 con 0x7f941806dc70 2023-11-30T23:12:52.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.719+0000 7f9429ffb700 1 -- 172.21.15.73:0/1643845405 <== osd.5 v2:172.21.15.156:6808/36909 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f942c001ea0 con 0x7f941806dc70 2023-11-30T23:12:52.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.719+0000 7f943a59f700 1 -- 172.21.15.73:0/1643845405 >> [v2:172.21.15.156:6808/36909,v1:172.21.15.156:6809/36909] conn(0x7f941806dc70 msgr2=0x7f9418070090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.719+0000 7f943a59f700 1 --2- 172.21.15.73:0/1643845405 >> [v2:172.21.15.156:6808/36909,v1:172.21.15.156:6809/36909] conn(0x7f941806dc70 0x7f9418070090 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.719+0000 7f943a59f700 1 -- 172.21.15.73:0/1643845405 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9418065ad0 msgr2=0x7f9418067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.719+0000 7f943a59f700 1 --2- 172.21.15.73:0/1643845405 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9418065ad0 0x7f9418067f90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f94340b28c0 tx=0x7f942401d040 comp rx=0 tx=0).stop 2023-11-30T23:12:52.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.719+0000 7f943a59f700 1 -- 172.21.15.73:0/1643845405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94340b0bb0 msgr2=0x7f94341455f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.719+0000 7f943a59f700 1 --2- 172.21.15.73:0/1643845405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94340b0bb0 0x7f94341455f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f943000ec10 tx=0x7f943000ef20 comp rx=0 tx=0).stop 2023-11-30T23:12:52.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.719+0000 7f9439d9e700 1 -- 172.21.15.73:0/1643845405 reap_dead start 2023-11-30T23:12:52.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.719+0000 7f943a59f700 1 -- 172.21.15.73:0/1643845405 shutdown_connections 2023-11-30T23:12:52.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.719+0000 7f943a59f700 1 -- 172.21.15.73:0/1643845405 >> 172.21.15.73:0/1643845405 conn(0x7f943406ab90 msgr2=0x7f9434143510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.719+0000 7f943a59f700 1 -- 172.21.15.73:0/1643845405 shutdown_connections 2023-11-30T23:12:52.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.719+0000 7f943a59f700 1 -- 172.21.15.73:0/1643845405 wait complete. 2023-11-30T23:12:52.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.723+0000 7fbe4a455700 1 -- 172.21.15.73:0/2953654540 --> [v2:172.21.15.73:6816/36686,v1:172.21.15.73:6817/36686] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe4413eda0 con 0x7fbe2806dcf0 2023-11-30T23:12:52.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.727+0000 7fbe39ffb700 1 -- 172.21.15.73:0/2953654540 <== osd.0 v2:172.21.15.73:6816/36686 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbe4413eda0 con 0x7fbe2806dcf0 2023-11-30T23:12:52.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.719+0000 7fb7a7fff700 1 -- 172.21.15.73:0/2874831595 --> [v2:172.21.15.73:6808/36687,v1:172.21.15.73:6809/36687] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb788002d60 con 0x7fb79406dcf0 2023-11-30T23:12:52.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.723+0000 7fb78f7fe700 1 -- 172.21.15.73:0/2874831595 <== osd.1 v2:172.21.15.73:6808/36687 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb788002d60 con 0x7fb79406dcf0 2023-11-30T23:12:52.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.723+0000 7fb7a7fff700 1 -- 172.21.15.73:0/2874831595 >> [v2:172.21.15.73:6808/36687,v1:172.21.15.73:6809/36687] conn(0x7fb79406dcf0 msgr2=0x7fb794070110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.723+0000 7fb7a7fff700 1 --2- 172.21.15.73:0/2874831595 >> [v2:172.21.15.73:6808/36687,v1:172.21.15.73:6809/36687] conn(0x7fb79406dcf0 0x7fb794070110 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.723+0000 7fb7a7fff700 1 -- 172.21.15.73:0/2874831595 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb794065ad0 msgr2=0x7fb794067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.723+0000 7fb7a7fff700 1 --2- 172.21.15.73:0/2874831595 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb794065ad0 0x7fb794067f90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb798007fd0 tx=0x7fb798009040 comp rx=0 tx=0).stop 2023-11-30T23:12:52.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.723+0000 7fb7a7fff700 1 -- 172.21.15.73:0/2874831595 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7a8145c10 msgr2=0x7fb7a81d78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.723+0000 7fb7a7fff700 1 --2- 172.21.15.73:0/2874831595 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb7a8145c10 0x7fb7a81d78e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0010c00 tx=0x7fb7a0004af0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.723+0000 7fb7a77fe700 1 -- 172.21.15.73:0/2874831595 reap_dead start 2023-11-30T23:12:52.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.723+0000 7fb7a7fff700 1 -- 172.21.15.73:0/2874831595 shutdown_connections 2023-11-30T23:12:52.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.723+0000 7fb7a7fff700 1 -- 172.21.15.73:0/2874831595 >> 172.21.15.73:0/2874831595 conn(0x7fb7a80b45a0 msgr2=0x7fb7a80b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.723+0000 7fb7a7fff700 1 -- 172.21.15.73:0/2874831595 shutdown_connections 2023-11-30T23:12:52.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.723+0000 7fb7a7fff700 1 -- 172.21.15.73:0/2874831595 wait complete. 2023-11-30T23:12:52.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.727+0000 7f5397fff700 1 -- 172.21.15.73:0/953420353 --> [v2:172.21.15.156:6816/36910,v1:172.21.15.156:6817/36910] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f53980ae9d0 con 0x7f539814b400 2023-11-30T23:12:52.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.727+0000 7f537f7fe700 1 -- 172.21.15.73:0/953420353 <== osd.6 v2:172.21.15.156:6816/36910 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f538c004040 con 0x7f539814b400 2023-11-30T23:12:52.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.727+0000 7f5397fff700 1 -- 172.21.15.73:0/953420353 >> [v2:172.21.15.156:6816/36910,v1:172.21.15.156:6817/36910] conn(0x7f539814b400 msgr2=0x7f5398070480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.727+0000 7f5397fff700 1 --2- 172.21.15.73:0/953420353 >> [v2:172.21.15.156:6816/36910,v1:172.21.15.156:6817/36910] conn(0x7f539814b400 0x7f5398070480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.727+0000 7f5397fff700 1 -- 172.21.15.73:0/953420353 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f5384065ad0 msgr2=0x7f5384067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.727+0000 7f5397fff700 1 --2- 172.21.15.73:0/953420353 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f5384065ad0 0x7f5384067f90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5390014040 tx=0x7f5390011000 comp rx=0 tx=0).stop 2023-11-30T23:12:52.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.727+0000 7f5397fff700 1 -- 172.21.15.73:0/953420353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53981403b0 msgr2=0x7f53981e3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.727+0000 7f5397fff700 1 --2- 172.21.15.73:0/953420353 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f53981403b0 0x7f53981e3700 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f538800d560 tx=0x7f538800d870 comp rx=0 tx=0).stop 2023-11-30T23:12:52.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.727+0000 7f53977fe700 1 -- 172.21.15.73:0/953420353 reap_dead start 2023-11-30T23:12:52.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.727+0000 7f5397fff700 1 -- 172.21.15.73:0/953420353 shutdown_connections 2023-11-30T23:12:52.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.727+0000 7f5397fff700 1 -- 172.21.15.73:0/953420353 >> 172.21.15.73:0/953420353 conn(0x7f53980b45a0 msgr2=0x7f5398141c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.727+0000 7f5397fff700 1 -- 172.21.15.73:0/953420353 shutdown_connections 2023-11-30T23:12:52.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.727+0000 7f5397fff700 1 -- 172.21.15.73:0/953420353 wait complete. 2023-11-30T23:12:52.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.731+0000 7fbe4a455700 1 -- 172.21.15.73:0/2953654540 >> [v2:172.21.15.73:6816/36686,v1:172.21.15.73:6817/36686] conn(0x7fbe2806dcf0 msgr2=0x7fbe28070110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.731+0000 7fbe4a455700 1 --2- 172.21.15.73:0/2953654540 >> [v2:172.21.15.73:6816/36686,v1:172.21.15.73:6817/36686] conn(0x7fbe2806dcf0 0x7fbe28070110 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.731+0000 7fbe4a455700 1 -- 172.21.15.73:0/2953654540 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbe28065b50 msgr2=0x7fbe28068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.731+0000 7fbe4a455700 1 --2- 172.21.15.73:0/2953654540 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbe28065b50 0x7fbe28068010 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400d370 tx=0x7fbe34014000 comp rx=0 tx=0).stop 2023-11-30T23:12:52.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.731+0000 7fbe4a455700 1 -- 172.21.15.73:0/2953654540 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe440b0e80 msgr2=0x7fbe440aa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.731+0000 7fbe4a455700 1 --2- 172.21.15.73:0/2953654540 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe440b0e80 0x7fbe440aa310 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00cb90 tx=0x7fbe3c00cea0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.731+0000 7fbe49c54700 1 -- 172.21.15.73:0/2953654540 reap_dead start 2023-11-30T23:12:52.770 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-11-30T23:12:52.770 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-30T23:12:52.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.735+0000 7fbe4a455700 1 -- 172.21.15.73:0/2953654540 shutdown_connections 2023-11-30T23:12:52.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.735+0000 7fbe4a455700 1 -- 172.21.15.73:0/2953654540 >> 172.21.15.73:0/2953654540 conn(0x7fbe4406ab90 msgr2=0x7fbe44141fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.771 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2023-11-30T23:12:52.771 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-30T23:12:52.772 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2023-11-30T23:12:52.773 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-30T23:12:52.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7fbe4a455700 1 -- 172.21.15.73:0/2953654540 shutdown_connections 2023-11-30T23:12:52.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7fbe4a455700 1 -- 172.21.15.73:0/2953654540 wait complete. 2023-11-30T23:12:52.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7f1b91663700 1 -- 172.21.15.73:0/3387489994 --> [v2:172.21.15.73:6824/36688,v1:172.21.15.73:6825/36688] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1b78002d60 con 0x7f1b7406df50 2023-11-30T23:12:52.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7f1b88ff9700 1 -- 172.21.15.73:0/3387489994 <== osd.2 v2:172.21.15.73:6824/36688 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1b78002d60 con 0x7f1b7406df50 2023-11-30T23:12:52.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7f1b91663700 1 -- 172.21.15.73:0/3387489994 >> [v2:172.21.15.73:6824/36688,v1:172.21.15.73:6825/36688] conn(0x7f1b7406df50 msgr2=0x7f1b74070370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7f1b91663700 1 --2- 172.21.15.73:0/3387489994 >> [v2:172.21.15.73:6824/36688,v1:172.21.15.73:6825/36688] conn(0x7f1b7406df50 0x7f1b74070370 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7f1b91663700 1 -- 172.21.15.73:0/3387489994 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f1b74065d30 msgr2=0x7f1b740681f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7f1b91663700 1 --2- 172.21.15.73:0/3387489994 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f1b74065d30 0x7f1b740681f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c000c00 tx=0x7f1b7c008030 comp rx=0 tx=0).stop 2023-11-30T23:12:52.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7f1b91663700 1 -- 172.21.15.73:0/3387489994 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b8c14a420 msgr2=0x7f1b8c1df600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7f1b91663700 1 --2- 172.21.15.73:0/3387489994 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1b8c14a420 0x7f1b8c1df600 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1b84007e90 tx=0x7f1b8400e3c0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7fa92a178700 1 -- 172.21.15.73:0/1446511619 --> [v2:172.21.15.156:6824/36911,v1:172.21.15.156:6825/36911] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa9241407a0 con 0x7fa90806ddc0 2023-11-30T23:12:52.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7f1b90e62700 1 -- 172.21.15.73:0/3387489994 reap_dead start 2023-11-30T23:12:52.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7f1b91663700 1 -- 172.21.15.73:0/3387489994 shutdown_connections 2023-11-30T23:12:52.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7f1b91663700 1 -- 172.21.15.73:0/3387489994 >> 172.21.15.73:0/3387489994 conn(0x7f1b8c06ab90 msgr2=0x7f1b8c0adf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7f1b91663700 1 -- 172.21.15.73:0/3387489994 shutdown_connections 2023-11-30T23:12:52.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7f1b91663700 1 -- 172.21.15.73:0/3387489994 wait complete. 2023-11-30T23:12:52.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7fa919ffb700 1 -- 172.21.15.73:0/1446511619 <== osd.7 v2:172.21.15.156:6824/36911 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa9241407a0 con 0x7fa90806ddc0 2023-11-30T23:12:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7fa92a178700 1 -- 172.21.15.73:0/1446511619 >> [v2:172.21.15.156:6824/36911,v1:172.21.15.156:6825/36911] conn(0x7fa90806ddc0 msgr2=0x7fa9080701e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7fa92a178700 1 --2- 172.21.15.73:0/1446511619 >> [v2:172.21.15.156:6824/36911,v1:172.21.15.156:6825/36911] conn(0x7fa90806ddc0 0x7fa9080701e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7fa92a178700 1 -- 172.21.15.73:0/1446511619 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa908065ba0 msgr2=0x7fa908068060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7fa92a178700 1 --2- 172.21.15.73:0/1446511619 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa908065ba0 0x7fa908068060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa92000af30 tx=0x7fa920008040 comp rx=0 tx=0).stop 2023-11-30T23:12:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7fa92a178700 1 -- 172.21.15.73:0/1446511619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9241437e0 msgr2=0x7fa9241e3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7fa92a178700 1 --2- 172.21.15.73:0/1446511619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9241437e0 0x7fa9241e3aa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00cb90 tx=0x7fa91c00cea0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.739+0000 7fa929977700 1 -- 172.21.15.73:0/1446511619 reap_dead start 2023-11-30T23:12:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.743+0000 7fa92a178700 1 -- 172.21.15.73:0/1446511619 shutdown_connections 2023-11-30T23:12:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.743+0000 7fa92a178700 1 -- 172.21.15.73:0/1446511619 >> 172.21.15.73:0/1446511619 conn(0x7fa9240b4fe0 msgr2=0x7fa9240b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.743+0000 7fa92a178700 1 -- 172.21.15.73:0/1446511619 shutdown_connections 2023-11-30T23:12:52.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.743+0000 7fa92a178700 1 -- 172.21.15.73:0/1446511619 wait complete. 2023-11-30T23:12:52.778 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2023-11-30T23:12:52.779 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-30T23:12:52.779 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2023-11-30T23:12:52.779 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-30T23:12:52.780 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2023-11-30T23:12:52.780 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-30T23:12:52.781 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2023-11-30T23:12:52.781 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-30T23:12:52.782 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2023-11-30T23:12:52.782 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-30T23:12:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.959+0000 7fc35b59e700 1 Processor -- start 2023-11-30T23:12:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.959+0000 7fc35b59e700 1 -- start start 2023-11-30T23:12:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.959+0000 7fc35b59e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc35c0b3ab0 0x7fc35c1568f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.959+0000 7fc35b59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc35c072340 0x7fc35c15dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.959+0000 7fc35b59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c0b04f0 con 0x7fc35c156e30 2023-11-30T23:12:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.959+0000 7fc35b59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c157780 con 0x7fc35c072340 2023-11-30T23:12:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.959+0000 7fc35b59e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c0727b0 con 0x7fc35c0b3ab0 2023-11-30T23:12:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.959+0000 7fc359d9b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc35c156e30 0x7fc35c071c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38146/0 (socket says 172.21.15.73:38146) 2023-11-30T23:12:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.959+0000 7fc35ad9d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc35c072340 0x7fc35c15dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.959+0000 7fc359d9b700 1 -- 172.21.15.73:0/2074114543 learned_addr learned my addr 172.21.15.73:0/2074114543 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:52.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35a59c700 1 --2- 172.21.15.73:0/2074114543 >> v2:172.21.15.156:3300/0 conn(0x7fc35c0b3ab0 0x7fc35c1568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe16608700 1 Processor -- start 2023-11-30T23:12:52.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35959a700 1 -- 172.21.15.73:0/2074114543 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136348733 0 0) 0x7fc35c0b04f0 con 0x7fc35c156e30 2023-11-30T23:12:52.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35959a700 1 -- 172.21.15.73:0/2074114543 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3440035d0 con 0x7fc35c156e30 2023-11-30T23:12:52.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35ad9d700 1 -- 172.21.15.73:0/2074114543 >> v2:172.21.15.156:3300/0 conn(0x7fc35c0b3ab0 msgr2=0x7fc35c1568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:52.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35ad9d700 1 --2- 172.21.15.73:0/2074114543 >> v2:172.21.15.156:3300/0 conn(0x7fc35c0b3ab0 0x7fc35c1568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35ad9d700 1 -- 172.21.15.73:0/2074114543 >> v1:172.21.15.73:6789/0 conn(0x7fc35c156e30 legacy=0x7fc35c071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35ad9d700 1 -- 172.21.15.73:0/2074114543 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c0af290 con 0x7fc35c072340 2023-11-30T23:12:52.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe16608700 1 -- start start 2023-11-30T23:12:52.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35ad9d700 1 --2- 172.21.15.73:0/2074114543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc35c072340 0x7fc35c15dc20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0b4110 tx=0x7fc35400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8512d8b49c5955b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35959a700 1 -- 172.21.15.73:0/2074114543 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35400e070 con 0x7fc35c072340 2023-11-30T23:12:52.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35959a700 1 -- 172.21.15.73:0/2074114543 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35400bb20 con 0x7fc35c072340 2023-11-30T23:12:52.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35959a700 1 -- 172.21.15.73:0/2074114543 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354012430 con 0x7fc35c072340 2023-11-30T23:12:52.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe16608700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbe100b1fc0 0x7fbe100b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe16608700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe100b5400 0x7fbe1014ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe16608700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe100b0cd0 con 0x7fbe100b5880 2023-11-30T23:12:52.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe16608700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe100b0fb0 con 0x7fbe100b1fc0 2023-11-30T23:12:52.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe16608700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe100b1290 con 0x7fbe100b5400 2023-11-30T23:12:52.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe15e07700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbe100b5880 0x7fbe1014e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38160/0 (socket says 172.21.15.73:38160) 2023-11-30T23:12:52.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe15e07700 1 -- 172.21.15.73:0/2817049159 learned_addr learned my addr 172.21.15.73:0/2817049159 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:52.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe15606700 1 --2- 172.21.15.73:0/2817049159 >> v2:172.21.15.156:3300/0 conn(0x7fbe100b1fc0 0x7fbe100b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7f099e4ae700 1 Processor -- start 2023-11-30T23:12:52.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7f099e4ae700 1 -- start start 2023-11-30T23:12:52.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe07fff700 1 -- 172.21.15.73:0/2817049159 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261153095 0 0) 0x7fbe100b0cd0 con 0x7fbe100b5880 2023-11-30T23:12:52.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe07fff700 1 -- 172.21.15.73:0/2817049159 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdfc0035d0 con 0x7fbe100b5880 2023-11-30T23:12:52.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe14e05700 1 --2- 172.21.15.73:0/2817049159 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe100b5400 0x7fbe1014ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35b59e700 1 -- 172.21.15.73:0/2074114543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc35c072340 msgr2=0x7fc35c15dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35b59e700 1 --2- 172.21.15.73:0/2074114543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc35c072340 0x7fc35c15dc20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0b4110 tx=0x7fc35400b330 comp rx=0 tx=0).stop 2023-11-30T23:12:52.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35b59e700 1 -- 172.21.15.73:0/2074114543 shutdown_connections 2023-11-30T23:12:52.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35b59e700 1 --2- 172.21.15.73:0/2074114543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc35c072340 0x7fc35c15dc20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35b59e700 1 --2- 172.21.15.73:0/2074114543 >> v2:172.21.15.156:3300/0 conn(0x7fc35c0b3ab0 0x7fc35c1568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35b59e700 1 -- 172.21.15.73:0/2074114543 >> 172.21.15.73:0/2074114543 conn(0x7fc35c06ab90 msgr2=0x7fc35c0b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe07fff700 1 -- 172.21.15.73:0/2817049159 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1422124654 0 0) 0x7fbdfc0035d0 con 0x7fbe100b5880 2023-11-30T23:12:52.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe07fff700 1 -- 172.21.15.73:0/2817049159 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe100b5400 msgr2=0x7fbe1014ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:52.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe07fff700 1 --2- 172.21.15.73:0/2817049159 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe100b5400 0x7fbe1014ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe07fff700 1 -- 172.21.15.73:0/2817049159 >> v2:172.21.15.156:3300/0 conn(0x7fbe100b1fc0 msgr2=0x7fbe100b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:52.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35b59e700 1 -- 172.21.15.73:0/2074114543 shutdown_connections 2023-11-30T23:12:52.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe07fff700 1 --2- 172.21.15.73:0/2817049159 >> v2:172.21.15.156:3300/0 conn(0x7fbe100b1fc0 0x7fbe100b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe07fff700 1 -- 172.21.15.73:0/2817049159 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe100b1570 con 0x7fbe100b5880 2023-11-30T23:12:52.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7f099e4ae700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f09980ae6e0 0x7f0998146530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7f099e4ae700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0998146a70 0x7f0998150e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7f099e4ae700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0998140cf0 con 0x7f09980afb40 2023-11-30T23:12:52.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7f099e4ae700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09980b0c10 con 0x7f0998146a70 2023-11-30T23:12:52.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7f099e4ae700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09980af420 con 0x7f09980ae6e0 2023-11-30T23:12:52.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe07fff700 1 -- 172.21.15.73:0/2817049159 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3856460137 0 0) 0x7fbe080019f0 con 0x7fbe100b5880 2023-11-30T23:12:52.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe07fff700 1 -- 172.21.15.73:0/2817049159 >> v1:172.21.15.73:6789/0 conn(0x7fbe100b5880 legacy=0x7fbe1014e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fc35b59e700 1 -- 172.21.15.73:0/2074114543 wait complete. 2023-11-30T23:12:52.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe07fff700 1 --2- 172.21.15.73:0/2817049159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdfc003a20 0x7fbdfc003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7f099dcad700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0998146a70 0x7f0998150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7f099d4ac700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f09980ae6e0 0x7f0998146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7f099dcad700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0998146a70 0x7f0998150e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38114/0 (socket says 172.21.15.73:38114) 2023-11-30T23:12:52.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7f099dcad700 1 -- 172.21.15.73:0/934967176 learned_addr learned my addr 172.21.15.73:0/934967176 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe07fff700 1 --2- 172.21.15.73:0/2817049159 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe100b5400 0x7fbdfc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe07fff700 1 --2- 172.21.15.73:0/2817049159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdfc004db0 0x7fbdfc005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe07fff700 1 -- 172.21.15.73:0/2817049159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe100b0fb0 con 0x7fbdfc004db0 2023-11-30T23:12:52.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe07fff700 1 -- 172.21.15.73:0/2817049159 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe100b1290 con 0x7fbdfc003a20 2023-11-30T23:12:52.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe07fff700 1 -- 172.21.15.73:0/2817049159 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc00bb10 con 0x7fbe100b5400 2023-11-30T23:12:52.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe15606700 1 --2- 172.21.15.73:0/2817049159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdfc003a20 0x7fbdfc003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe15e07700 1 --2- 172.21.15.73:0/2817049159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdfc004db0 0x7fbdfc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe15606700 1 -- 172.21.15.73:0/2817049159 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe100b5400 msgr2=0x7fbdfc004870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-30T23:12:52.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe15606700 1 --2- 172.21.15.73:0/2817049159 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbe100b5400 0x7fbdfc004870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7f099dcad700 1 -- 172.21.15.73:0/934967176 >> v2:172.21.15.156:3300/0 conn(0x7f09980ae6e0 msgr2=0x7f0998146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:52.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7f099dcad700 1 --2- 172.21.15.73:0/934967176 >> v2:172.21.15.156:3300/0 conn(0x7f09980ae6e0 0x7f0998146530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7f099dcad700 1 -- 172.21.15.73:0/934967176 >> v1:172.21.15.156:6789/0 conn(0x7f09980afb40 legacy=0x7f09980ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7f099dcad700 1 -- 172.21.15.73:0/934967176 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09980b4320 con 0x7f0998146a70 2023-11-30T23:12:52.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe15606700 1 -- 172.21.15.73:0/2817049159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdfc004db0 msgr2=0x7fbdfc005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:52.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe15606700 1 --2- 172.21.15.73:0/2817049159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdfc004db0 0x7fbdfc005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe15606700 1 -- 172.21.15.73:0/2817049159 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc0035d0 con 0x7fbdfc003a20 2023-11-30T23:12:52.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.963+0000 7fbe15e07700 1 --2- 172.21.15.73:0/2817049159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdfc004db0 0x7fbdfc005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:52.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fbe15606700 1 --2- 172.21.15.73:0/2817049159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdfc003a20 0x7fbdfc003e40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009b70 tx=0x7fbdfc0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c485939c2928d92a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f099dcad700 1 --2- 172.21.15.73:0/934967176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0998146a70 0x7f0998150e90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f09980b8be0 tx=0x7f0994009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a15d3e015d5949 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f098ffff700 1 -- 172.21.15.73:0/934967176 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994011830 con 0x7f0998146a70 2023-11-30T23:12:52.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f098ffff700 1 -- 172.21.15.73:0/934967176 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0994011990 con 0x7f0998146a70 2023-11-30T23:12:52.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f098ffff700 1 -- 172.21.15.73:0/934967176 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994011d20 con 0x7f0998146a70 2023-11-30T23:12:52.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fbe07fff700 1 -- 172.21.15.73:0/2817049159 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c00e6c0 con 0x7fbdfc003a20 2023-11-30T23:12:52.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fbe07fff700 1 -- 172.21.15.73:0/2817049159 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c00e820 con 0x7fbdfc003a20 2023-11-30T23:12:52.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fbe07fff700 1 -- 172.21.15.73:0/2817049159 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c00eb90 con 0x7fbdfc003a20 2023-11-30T23:12:52.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc35b59e700 1 Processor -- start 2023-11-30T23:12:52.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc35b59e700 1 -- start start 2023-11-30T23:12:52.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fbe16608700 1 -- 172.21.15.73:0/2817049159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdfc003a20 msgr2=0x7fbdfc003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fbe16608700 1 --2- 172.21.15.73:0/2817049159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdfc003a20 0x7fbdfc003e40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009b70 tx=0x7fbdfc0058a0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fbe15e07700 1 -- 172.21.15.73:0/2817049159 reap_dead start 2023-11-30T23:12:52.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f099e4ae700 1 -- 172.21.15.73:0/934967176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0998146a70 msgr2=0x7f0998150e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f099e4ae700 1 --2- 172.21.15.73:0/934967176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0998146a70 0x7f0998150e90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f09980b8be0 tx=0x7f0994009bf0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f8197fff700 1 Processor -- start 2023-11-30T23:12:52.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f099e4ae700 1 -- 172.21.15.73:0/934967176 shutdown_connections 2023-11-30T23:12:52.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f099e4ae700 1 --2- 172.21.15.73:0/934967176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0998146a70 0x7f0998150e90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f099e4ae700 1 --2- 172.21.15.73:0/934967176 >> v2:172.21.15.156:3300/0 conn(0x7f09980ae6e0 0x7f0998146530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f099e4ae700 1 -- 172.21.15.73:0/934967176 >> 172.21.15.73:0/934967176 conn(0x7f09980b45a0 msgr2=0x7f09980b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fbe16608700 1 -- 172.21.15.73:0/2817049159 shutdown_connections 2023-11-30T23:12:52.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fbe16608700 1 -- 172.21.15.73:0/2817049159 >> 172.21.15.73:0/2817049159 conn(0x7fbe100b8a10 msgr2=0x7fbe100b8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:52.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f099e4ae700 1 -- 172.21.15.73:0/934967176 shutdown_connections 2023-11-30T23:12:52.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f8197fff700 1 -- start start 2023-11-30T23:12:52.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc35b59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc35c072340 0x7fc35c088c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc35b59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc35c0b3ab0 0x7fc35c0a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc35b59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc35c156e30 0x7fc35c161ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fbe16608700 1 -- 172.21.15.73:0/2817049159 shutdown_connections 2023-11-30T23:12:52.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc35b59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0ace80 con 0x7fc35c156e30 2023-11-30T23:12:52.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc35b59e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c089150 con 0x7fc35c072340 2023-11-30T23:12:52.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc35b59e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0acae0 con 0x7fc35c0b3ab0 2023-11-30T23:12:52.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc359d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc35c0b3ab0 0x7fc35c0a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc35a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc35c072340 0x7fc35c088c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc359d9b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc35c0b3ab0 0x7fc35c0a84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:43000/0 (socket says 172.21.15.73:43000) 2023-11-30T23:12:52.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc35a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc35c072340 0x7fc35c088c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59378/0 (socket says 172.21.15.73:59378) 2023-11-30T23:12:52.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc359d9b700 1 -- 172.21.15.73:0/2574487722 learned_addr learned my addr 172.21.15.73:0/2574487722 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f8197fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f81980afcc0 0x7f8198144e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc359d9b700 1 -- 172.21.15.73:0/2574487722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc35c072340 msgr2=0x7fc35c088c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc359d9b700 1 --2- 172.21.15.73:0/2574487722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc35c072340 0x7fc35c088c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc359d9b700 1 -- 172.21.15.73:0/2574487722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc35c156e30 msgr2=0x7fc35c161ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc359d9b700 1 --2- 172.21.15.73:0/2574487722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc35c156e30 0x7fc35c161ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc359d9b700 1 -- 172.21.15.73:0/2574487722 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc354009a70 con 0x7fc35c0b3ab0 2023-11-30T23:12:52.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc35a59c700 1 --2- 172.21.15.73:0/2574487722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc35c072340 0x7fc35c088c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:52.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f8197fff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81980b0fb0 con 0x7f81980b24a0 2023-11-30T23:12:52.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f8197fff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81980b1c80 con 0x7f819814e1f0 2023-11-30T23:12:52.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f8197fff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81980af5e0 con 0x7f81980afcc0 2023-11-30T23:12:52.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f8196ffd700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f819814e1f0 0x7f8198144700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.73:48512/0 (socket says 172.21.15.73:48512) 2023-11-30T23:12:52.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f8196ffd700 1 -- 172.21.15.73:0/800903984 learned_addr learned my addr 172.21.15.73:0/800903984 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:52.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc359d9b700 1 --2- 172.21.15.73:0/2574487722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc35c0b3ab0 0x7fc35c0a84c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc34c001200 tx=0x7fc34c00c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc34affd700 1 -- 172.21.15.73:0/2574487722 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c005d90 con 0x7fc35c0b3ab0 2023-11-30T23:12:52.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f099e4ae700 1 -- 172.21.15.73:0/934967176 wait complete. 2023-11-30T23:12:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc35b59e700 1 -- 172.21.15.73:0/2574487722 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c0ac5c0 con 0x7fc35c0b3ab0 2023-11-30T23:12:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f099e4ae700 1 Processor -- start 2023-11-30T23:12:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc35b59e700 1 -- 172.21.15.73:0/2574487722 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c0a8a00 con 0x7fc35c0b3ab0 2023-11-30T23:12:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc34affd700 1 -- 172.21.15.73:0/2574487722 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c0070d0 con 0x7fc35c0b3ab0 2023-11-30T23:12:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7fc34affd700 1 -- 172.21.15.73:0/2574487722 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c007460 con 0x7fc35c0b3ab0 2023-11-30T23:12:52.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.967+0000 7f099e4ae700 1 -- start start 2023-11-30T23:12:52.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f81967fc700 1 --2- 172.21.15.73:0/800903984 >> v2:172.21.15.73:3300/0 conn(0x7f81980afcc0 0x7f8198144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f8195ffb700 1 -- 172.21.15.73:0/800903984 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043500335 0 0) 0x7f81980b1c80 con 0x7f819814e1f0 2023-11-30T23:12:52.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f099e4ae700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09980ae6e0 0x7f09981dc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff8190ee700 1 Processor -- start 2023-11-30T23:12:52.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f099e4ae700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09980afb40 0x7f09981e8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f099e4ae700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0998146a70 0x7f09981ebe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f099e4ae700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09981419f0 con 0x7f0998146a70 2023-11-30T23:12:52.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f099e4ae700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099814a6d0 con 0x7f09980afb40 2023-11-30T23:12:52.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f099e4ae700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0998149b40 con 0x7f09980ae6e0 2023-11-30T23:12:52.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff8190ee700 1 -- start start 2023-11-30T23:12:52.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f099dcad700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0998146a70 0x7f09981ebe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f099dcad700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0998146a70 0x7f09981ebe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38138/0 (socket says 172.21.15.73:38138) 2023-11-30T23:12:52.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f099dcad700 1 -- 172.21.15.73:0/3237664498 learned_addr learned my addr 172.21.15.73:0/3237664498 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f8195ffb700 1 -- 172.21.15.73:0/800903984 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81800035d0 con 0x7f819814e1f0 2023-11-30T23:12:52.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f8195ffb700 1 -- 172.21.15.73:0/800903984 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352147786 0 0) 0x7f81980b0fb0 con 0x7f81980b24a0 2023-11-30T23:12:52.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f8195ffb700 1 -- 172.21.15.73:0/800903984 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81980b1c80 con 0x7f81980b24a0 2023-11-30T23:12:52.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f81967fc700 1 -- 172.21.15.73:0/800903984 >> v1:172.21.15.156:6789/0 conn(0x7f819814e1f0 legacy=0x7f8198144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f81967fc700 1 -- 172.21.15.73:0/800903984 >> v1:172.21.15.73:6789/0 conn(0x7f81980b24a0 legacy=0x7f81981552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f81967fc700 1 -- 172.21.15.73:0/800903984 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819814e5d0 con 0x7f81980afcc0 2023-11-30T23:12:52.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f81967fc700 1 --2- 172.21.15.73:0/800903984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81980afcc0 0x7f8198144e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f818c009850 tx=0x7f818c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bc534d0912394 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f099ccab700 1 --2- 172.21.15.73:0/3237664498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09980afb40 0x7f09981e8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f099d4ac700 1 --2- 172.21.15.73:0/3237664498 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09980ae6e0 0x7f09981dc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f6f756af700 1 Processor -- start 2023-11-30T23:12:52.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fbe16608700 1 -- 172.21.15.73:0/2817049159 wait complete. 2023-11-30T23:12:52.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fc35b59e700 1 -- 172.21.15.73:0/2574487722 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc340005310 con 0x7fc35c0b3ab0 2023-11-30T23:12:52.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f6f756af700 1 -- start start 2023-11-30T23:12:52.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f099dcad700 1 -- 172.21.15.73:0/3237664498 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09980ae6e0 msgr2=0x7f09981dc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f099dcad700 1 --2- 172.21.15.73:0/3237664498 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09980ae6e0 0x7f09981dc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f099dcad700 1 -- 172.21.15.73:0/3237664498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09980afb40 msgr2=0x7f09981e8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:52.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f099dcad700 1 --2- 172.21.15.73:0/3237664498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09980afb40 0x7f09981e8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:52.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f099dcad700 1 -- 172.21.15.73:0/3237664498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0994009570 con 0x7f0998146a70 2023-11-30T23:12:52.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f099dcad700 1 --2- 172.21.15.73:0/3237664498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0998146a70 0x7f09981ebe90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f099806c950 tx=0x7f0994004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:52.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff8190ee700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8140afd70 0x7ff814149d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff8190ee700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff8140adf40 0x7ff81414a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:52.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff8190ee700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8140af9d0 con 0x7ff8140adb60 2023-11-30T23:12:52.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff8190ee700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8140b43d0 con 0x7ff8140adf40 2023-11-30T23:12:52.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff8190ee700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8140b0d00 con 0x7ff8140afd70 2023-11-30T23:12:52.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fbe16608700 1 Processor -- start 2023-11-30T23:12:52.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f8195ffb700 1 -- 172.21.15.73:0/800903984 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c004230 con 0x7f81980afcc0 2023-11-30T23:12:52.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f8195ffb700 1 -- 172.21.15.73:0/800903984 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c004390 con 0x7f81980afcc0 2023-11-30T23:12:52.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f8195ffb700 1 -- 172.21.15.73:0/800903984 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c0036c0 con 0x7f81980afcc0 2023-11-30T23:12:52.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff8188ed700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff8140adf40 0x7ff81414a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:52.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff8188ed700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff8140adf40 0x7ff81414a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38154/0 (socket says 172.21.15.73:38154) 2023-11-30T23:12:52.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff8188ed700 1 -- 172.21.15.73:0/3560872780 learned_addr learned my addr 172.21.15.73:0/3560872780 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:52.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fc34affd700 1 -- 172.21.15.73:0/2574487722 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc34c0075c0 con 0x7fc35c0b3ab0 2023-11-30T23:12:52.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff8137fe700 1 --2- 172.21.15.73:0/3560872780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8140afd70 0x7ff814149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff8188ed700 1 -- 172.21.15.73:0/3560872780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8140afd70 msgr2=0x7ff814149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:53.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff8188ed700 1 --2- 172.21.15.73:0/3560872780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8140afd70 0x7ff814149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f098dffb700 1 -- 172.21.15.73:0/3237664498 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994004450 con 0x7f0998146a70 2023-11-30T23:12:53.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff8188ed700 1 -- 172.21.15.73:0/3560872780 >> v1:172.21.15.156:6789/0 conn(0x7ff8140adb60 legacy=0x7ff8140b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:53.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff8188ed700 1 -- 172.21.15.73:0/3560872780 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8140af380 con 0x7ff8140adf40 2023-11-30T23:12:53.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fc34affd700 1 --2- 172.21.15.73:0/2574487722 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc33c065b00 0x7fc33c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f098dffb700 1 -- 172.21.15.73:0/3237664498 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099401f070 con 0x7f0998146a70 2023-11-30T23:12:53.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f099e4ae700 1 -- 172.21.15.73:0/3237664498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09981426b0 con 0x7f0998146a70 2023-11-30T23:12:53.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fbe16608700 1 -- start start 2023-11-30T23:12:53.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fbe16608700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdfc003a20 0x7fbe1014b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fbe16608700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe101e3360 0x7fbe1006f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fbe16608700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe100708f0 0x7fbe10142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fbe16608700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe101e42d0 con 0x7fbe100708f0 2023-11-30T23:12:53.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fbe16608700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe101e37f0 con 0x7fbe101e3360 2023-11-30T23:12:53.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fbe16608700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe101e3ad0 con 0x7fbdfc003a20 2023-11-30T23:12:53.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fc34affd700 1 -- 172.21.15.73:0/2574487722 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc34c082540 con 0x7fc35c0b3ab0 2023-11-30T23:12:53.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff8188ed700 1 --2- 172.21.15.73:0/3560872780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8140adf40 0x7ff81414a250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff804009910 tx=0x7ff804009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0cd829c25667ce server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:53.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f8197fff700 1 -- 172.21.15.73:0/800903984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81980afcc0 msgr2=0x7f8198144e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f8197fff700 1 --2- 172.21.15.73:0/800903984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81980afcc0 0x7f8198144e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f818c009850 tx=0x7f818c009b60 comp rx=0 tx=0).stop 2023-11-30T23:12:53.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f6f756af700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f70073380 0x7f6f7014dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f6f756af700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6f7006b2f0 0x7f6f70155230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f6f756af700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f701450d0 con 0x7f6f7014b4a0 2023-11-30T23:12:53.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f6f756af700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7014b900 con 0x7f6f7006b2f0 2023-11-30T23:12:53.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f6f756af700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7014b010 con 0x7f6f70073380 2023-11-30T23:12:53.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f6f6ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f70073380 0x7f6f7014dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fc35a59c700 1 --2- 172.21.15.73:0/2574487722 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc33c065b00 0x7fc33c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff812ffd700 1 -- 172.21.15.73:0/3560872780 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804004230 con 0x7ff8140adf40 2023-11-30T23:12:53.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff812ffd700 1 -- 172.21.15.73:0/3560872780 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff804004390 con 0x7ff8140adf40 2023-11-30T23:12:53.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7ff812ffd700 1 -- 172.21.15.73:0/3560872780 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804009e60 con 0x7ff8140adf40 2023-11-30T23:12:53.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f6f74eae700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6f7006b2f0 0x7f6f70155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f6f6f7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6f7014b4a0 0x7f6f701449c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.73:48530/0 (socket says 172.21.15.73:48530) 2023-11-30T23:12:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7f6f6f7fe700 1 -- 172.21.15.73:0/1319000783 learned_addr learned my addr 172.21.15.73:0/1319000783 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8197fff700 1 -- 172.21.15.73:0/800903984 shutdown_connections 2023-11-30T23:12:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8197fff700 1 --2- 172.21.15.73:0/800903984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81980afcc0 0x7f8198144e10 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f818c009850 tx=0x7f818c009b60 comp rx=0 tx=0).stop 2023-11-30T23:12:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8197fff700 1 -- 172.21.15.73:0/800903984 >> 172.21.15.73:0/800903984 conn(0x7f81980b45a0 msgr2=0x7f81980b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fbe14e05700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe101e3360 0x7fbe1006f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fbe15606700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdfc003a20 0x7fbe1014b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fbe14e05700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe101e3360 0x7fbe1006f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59404/0 (socket says 172.21.15.73:59404) 2023-11-30T23:12:53.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fbe15606700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdfc003a20 0x7fbe1014b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:43034/0 (socket says 172.21.15.73:43034) 2023-11-30T23:12:53.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fbe14e05700 1 -- 172.21.15.73:0/2488131300 learned_addr learned my addr 172.21.15.73:0/2488131300 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:53.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.971+0000 7fbe15e07700 1 --2- 172.21.15.73:0/2488131300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe100708f0 0x7fbe10142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8197fff700 1 -- 172.21.15.73:0/800903984 shutdown_connections 2023-11-30T23:12:53.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f098dffb700 1 -- 172.21.15.73:0/3237664498 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994003900 con 0x7f0998146a70 2023-11-30T23:12:53.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f099e4ae700 1 -- 172.21.15.73:0/3237664498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09981497d0 con 0x7f0998146a70 2023-11-30T23:12:53.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7fbe15606700 1 -- 172.21.15.73:0/2488131300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe101e3360 msgr2=0x7fbe1006f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7fbe15606700 1 --2- 172.21.15.73:0/2488131300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe101e3360 0x7fbe1006f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7fbe15606700 1 -- 172.21.15.73:0/2488131300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe100708f0 msgr2=0x7fbe10142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7fbe15606700 1 --2- 172.21.15.73:0/2488131300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe100708f0 0x7fbe10142310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7fbe15606700 1 -- 172.21.15.73:0/2488131300 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe101e3db0 con 0x7fbdfc003a20 2023-11-30T23:12:53.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7fc35a59c700 1 --2- 172.21.15.73:0/2574487722 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc33c065b00 0x7fc33c067fc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc3500112c0 tx=0x7fc350009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:53.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7ff8190ee700 1 -- 172.21.15.73:0/3560872780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8140adf40 msgr2=0x7ff81414a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7ff8190ee700 1 --2- 172.21.15.73:0/3560872780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8140adf40 0x7ff81414a250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff804009910 tx=0x7ff804009c20 comp rx=0 tx=0).stop 2023-11-30T23:12:53.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f6f6ffff700 1 -- 172.21.15.73:0/1319000783 >> v2:172.21.15.156:3300/0 conn(0x7f6f7006b2f0 msgr2=0x7f6f70155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:53.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f6f6ffff700 1 --2- 172.21.15.73:0/1319000783 >> v2:172.21.15.156:3300/0 conn(0x7f6f7006b2f0 0x7f6f70155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f6f6ffff700 1 -- 172.21.15.73:0/1319000783 >> v1:172.21.15.156:6789/0 conn(0x7f6f7014b4a0 legacy=0x7f6f701449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f6f6ffff700 1 -- 172.21.15.73:0/1319000783 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7014ee10 con 0x7f6f70073380 2023-11-30T23:12:53.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f6f6ffff700 1 --2- 172.21.15.73:0/1319000783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f70073380 0x7f6f7014dea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6f60009850 tx=0x7f6f60009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2e53f29c59a28f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:53.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8197fff700 1 -- 172.21.15.73:0/800903984 wait complete. 2023-11-30T23:12:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7fbe15606700 1 --2- 172.21.15.73:0/2488131300 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdfc003a20 0x7fbe1014b440 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c019000 tx=0x7fbe0c0047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7ff8190ee700 1 -- 172.21.15.73:0/3560872780 shutdown_connections 2023-11-30T23:12:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7ff8190ee700 1 --2- 172.21.15.73:0/3560872780 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8140afd70 0x7ff814149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7ff8190ee700 1 --2- 172.21.15.73:0/3560872780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8140adf40 0x7ff81414a250 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7ff8190ee700 1 -- 172.21.15.73:0/3560872780 >> 172.21.15.73:0/3560872780 conn(0x7ff81406ab90 msgr2=0x7ff8140b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7ff8190ee700 1 -- 172.21.15.73:0/3560872780 shutdown_connections 2023-11-30T23:12:53.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7faf9d612700 1 Processor -- start 2023-11-30T23:12:53.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7ff8190ee700 1 -- 172.21.15.73:0/3560872780 wait complete. 2023-11-30T23:12:53.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7faf9d612700 1 -- start start 2023-11-30T23:12:53.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f098dffb700 1 -- 172.21.15.73:0/3237664498 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0994003a60 con 0x7f0998146a70 2023-11-30T23:12:53.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8197fff700 1 Processor -- start 2023-11-30T23:12:53.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f098dffb700 1 --2- 172.21.15.73:0/3237664498 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f097c065b20 0x7f097c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8197fff700 1 -- start start 2023-11-30T23:12:53.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f098dffb700 1 -- 172.21.15.73:0/3237664498 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0994021070 con 0x7f0998146a70 2023-11-30T23:12:53.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f099d4ac700 1 --2- 172.21.15.73:0/3237664498 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f097c065b20 0x7f097c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7faf9d612700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faf900c48c0 0x7faf90029b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7faf9d612700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faf900ca3a0 0x7faf90039ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7faf9d612700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf90039a60 con 0x7faf90037370 2023-11-30T23:12:53.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7faf9d612700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf900ca850 con 0x7faf900ca3a0 2023-11-30T23:12:53.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7faf9d612700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9002bb30 con 0x7faf900c48c0 2023-11-30T23:12:53.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7faf96ffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7faf90037370 0x7faf900c41b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38172/0 (socket says 172.21.15.73:38172) 2023-11-30T23:12:53.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7faf96ffd700 1 -- 172.21.15.73:0/113012066 learned_addr learned my addr 172.21.15.73:0/113012066 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:53.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f099e4ae700 1 -- 172.21.15.73:0/3237664498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099804ed80 con 0x7f0998146a70 2023-11-30T23:12:53.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7faf967fc700 1 --2- 172.21.15.73:0/113012066 >> v2:172.21.15.156:3300/0 conn(0x7faf900c48c0 0x7faf90029b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f099d4ac700 1 --2- 172.21.15.73:0/3237664498 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f097c065b20 0x7f097c067fe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0988009bf0 tx=0x7f0988009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:53.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8197fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81980b24a0 0x7f819814a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8197fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f819814e1f0 0x7f81981e0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7ff8190ee700 1 Processor -- start 2023-11-30T23:12:53.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8197fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81981e0890 0x7f819813cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8197fff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81981e0d20 con 0x7f81980b24a0 2023-11-30T23:12:53.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8197fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819813e6c0 con 0x7f81981e0890 2023-11-30T23:12:53.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8197fff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8198147120 con 0x7f819814e1f0 2023-11-30T23:12:53.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8196ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81980b24a0 0x7f819814a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8196ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81980b24a0 0x7f819814a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38186/0 (socket says 172.21.15.73:38186) 2023-11-30T23:12:53.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8196ffd700 1 -- 172.21.15.73:0/2934311127 learned_addr learned my addr 172.21.15.73:0/2934311127 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:53.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7faf977fe700 1 --2- 172.21.15.73:0/113012066 >> v2:172.21.15.73:3300/0 conn(0x7faf900ca3a0 0x7faf90039ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7fa5c665e700 1 Processor -- start 2023-11-30T23:12:53.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f81967fc700 1 --2- 172.21.15.73:0/2934311127 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f819814e1f0 0x7f81981e0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f81977fe700 1 --2- 172.21.15.73:0/2934311127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81981e0890 0x7f819813cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7fa5c665e700 1 -- start start 2023-11-30T23:12:53.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8196ffd700 1 -- 172.21.15.73:0/2934311127 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f819814e1f0 msgr2=0x7f81981e0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8196ffd700 1 --2- 172.21.15.73:0/2934311127 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f819814e1f0 0x7f81981e0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8196ffd700 1 -- 172.21.15.73:0/2934311127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81981e0890 msgr2=0x7f819813cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8196ffd700 1 --2- 172.21.15.73:0/2934311127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81981e0890 0x7f819813cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8196ffd700 1 -- 172.21.15.73:0/2934311127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c0094b0 con 0x7f81980b24a0 2023-11-30T23:12:53.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7f8196ffd700 1 --2- 172.21.15.73:0/2934311127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81980b24a0 0x7f819814a9e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f819000cc10 tx=0x7f819000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:53.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7faf967fc700 1 -- 172.21.15.73:0/113012066 >> v2:172.21.15.73:3300/0 conn(0x7faf900ca3a0 msgr2=0x7faf90039ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:53.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7faf967fc700 1 --2- 172.21.15.73:0/113012066 >> v2:172.21.15.73:3300/0 conn(0x7faf900ca3a0 0x7faf90039ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7faf967fc700 1 -- 172.21.15.73:0/113012066 >> v1:172.21.15.73:6789/0 conn(0x7faf90037370 legacy=0x7faf900c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7faf967fc700 1 -- 172.21.15.73:0/113012066 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf90037750 con 0x7faf900c48c0 2023-11-30T23:12:53.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.975+0000 7faf967fc700 1 --2- 172.21.15.73:0/113012066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf900c48c0 0x7faf90029b60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faf900070f0 tx=0x7faf8c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37fd33e7c0c175cb server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:53.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7ff8190ee700 1 -- start start 2023-11-30T23:12:53.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf95ffb700 1 -- 172.21.15.73:0/113012066 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c011830 con 0x7faf900c48c0 2023-11-30T23:12:53.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf95ffb700 1 -- 172.21.15.73:0/113012066 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c011990 con 0x7faf900c48c0 2023-11-30T23:12:53.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf95ffb700 1 -- 172.21.15.73:0/113012066 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c011d20 con 0x7faf900c48c0 2023-11-30T23:12:53.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7fa5c665e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa5c00aefa0 0x7fa5c00b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7fa5c665e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa5c0143250 0x7fa5c01436e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7fa5c665e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c0146cc0 con 0x7fa5c00b2710 2023-11-30T23:12:53.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7fa5c665e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c00b1dc0 con 0x7fa5c00aefa0 2023-11-30T23:12:53.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7fa5c665e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c00b1fe0 con 0x7fa5c0143250 2023-11-30T23:12:53.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7fa5c4e5b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa5c00aefa0 0x7fa5c00b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7fa5c4e5b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa5c00aefa0 0x7fa5c00b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38206/0 (socket says 172.21.15.73:38206) 2023-11-30T23:12:53.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7fa5c4e5b700 1 -- 172.21.15.73:0/2738356153 learned_addr learned my addr 172.21.15.73:0/2738356153 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:53.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7fa5c4e5b700 1 -- 172.21.15.73:0/2738356153 >> v2:172.21.15.156:3300/0 conn(0x7fa5c0143250 msgr2=0x7fa5c01436e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-30T23:12:53.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7fa5c4e5b700 1 --2- 172.21.15.73:0/2738356153 >> v2:172.21.15.156:3300/0 conn(0x7fa5c0143250 0x7fa5c01436e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7fa5c4e5b700 1 -- 172.21.15.73:0/2738356153 >> v1:172.21.15.73:6789/0 conn(0x7fa5c00b2710 legacy=0x7fa5c0147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7fa5c4e5b700 1 -- 172.21.15.73:0/2738356153 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c006f280 con 0x7fa5c00aefa0 2023-11-30T23:12:53.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7ff8190ee700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8140adb60 0x7ff8141435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7ff8190ee700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8140adf40 0x7ff814143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7ff8190ee700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8140afd70 0x7ff8141db640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7ff8190ee700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8140a8eb0 con 0x7ff8140afd70 2023-11-30T23:12:53.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7ff8190ee700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8141df830 con 0x7ff8140adf40 2023-11-30T23:12:53.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7ff8190ee700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8140b88c0 con 0x7ff8140adb60 2023-11-30T23:12:53.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7fa5c4e5b700 1 --2- 172.21.15.73:0/2738356153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c00aefa0 0x7fa5c00b1880 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0072940 tx=0x7fa5bc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b99dbdc15fc75bd server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:53.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7ff8188ed700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8140afd70 0x7ff8141db640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf9d612700 1 -- 172.21.15.73:0/113012066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf900c48c0 msgr2=0x7faf90029b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf9d612700 1 --2- 172.21.15.73:0/113012066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf900c48c0 0x7faf90029b60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faf900070f0 tx=0x7faf8c009b30 comp rx=0 tx=0).stop 2023-11-30T23:12:53.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7ff8188ed700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8140afd70 0x7ff8141db640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38208/0 (socket says 172.21.15.73:38208) 2023-11-30T23:12:53.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7ff8188ed700 1 -- 172.21.15.73:0/1918441283 learned_addr learned my addr 172.21.15.73:0/1918441283 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:53.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7ff8137fe700 1 --2- 172.21.15.73:0/1918441283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8140adf40 0x7ff814143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7ff813fff700 1 --2- 172.21.15.73:0/1918441283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8140adb60 0x7ff8141435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf9d612700 1 -- 172.21.15.73:0/113012066 shutdown_connections 2023-11-30T23:12:53.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf9d612700 1 --2- 172.21.15.73:0/113012066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf900c48c0 0x7faf90029b60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf9d612700 1 --2- 172.21.15.73:0/113012066 >> v2:172.21.15.73:3300/0 conn(0x7faf900ca3a0 0x7faf90039ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf9d612700 1 -- 172.21.15.73:0/113012066 >> 172.21.15.73:0/113012066 conn(0x7faf9003a990 msgr2=0x7faf9003ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:53.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf9d612700 1 -- 172.21.15.73:0/113012066 shutdown_connections 2023-11-30T23:12:53.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf9d612700 1 -- 172.21.15.73:0/113012066 wait complete. 2023-11-30T23:12:53.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7ff8188ed700 1 -- 172.21.15.73:0/1918441283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8140adb60 msgr2=0x7ff8141435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7ff8188ed700 1 --2- 172.21.15.73:0/1918441283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8140adb60 0x7ff8141435e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7ff8188ed700 1 -- 172.21.15.73:0/1918441283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8140adf40 msgr2=0x7ff814143b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7ff8188ed700 1 --2- 172.21.15.73:0/1918441283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8140adf40 0x7ff814143b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7ff8188ed700 1 -- 172.21.15.73:0/1918441283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff804009570 con 0x7ff8140afd70 2023-11-30T23:12:53.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7ff8188ed700 1 --2- 172.21.15.73:0/1918441283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8140afd70 0x7ff8141db640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff804004000 tx=0x7ff804004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:53.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf9d612700 1 Processor -- start 2023-11-30T23:12:53.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf9d612700 1 -- start start 2023-11-30T23:12:53.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf9d612700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf90037370 0x7faf9003d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf9d612700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf900c48c0 0x7faf9015f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf9d612700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf900ca3a0 0x7faf900c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf9d612700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf900c70f0 con 0x7faf900c48c0 2023-11-30T23:12:53.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf9d612700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf900c6bc0 con 0x7faf900ca3a0 2023-11-30T23:12:53.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf9d612700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf900c6e10 con 0x7faf90037370 2023-11-30T23:12:53.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf967fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf900c48c0 0x7faf9015f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf967fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf900c48c0 0x7faf9015f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38216/0 (socket says 172.21.15.73:38216) 2023-11-30T23:12:53.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf967fc700 1 -- 172.21.15.73:0/1866999455 learned_addr learned my addr 172.21.15.73:0/1866999455 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:53.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf977fe700 1 --2- 172.21.15.73:0/1866999455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf900ca3a0 0x7faf900c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf96ffd700 1 --2- 172.21.15.73:0/1866999455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf90037370 0x7faf9003d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf967fc700 1 -- 172.21.15.73:0/1866999455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf90037370 msgr2=0x7faf9003d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf967fc700 1 --2- 172.21.15.73:0/1866999455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf90037370 0x7faf9003d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf967fc700 1 -- 172.21.15.73:0/1866999455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf900ca3a0 msgr2=0x7faf900c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf967fc700 1 --2- 172.21.15.73:0/1866999455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf900ca3a0 0x7faf900c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf967fc700 1 -- 172.21.15.73:0/1866999455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c0094b0 con 0x7faf900c48c0 2023-11-30T23:12:53.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7fbe05ffb700 1 -- 172.21.15.73:0/2488131300 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c021070 con 0x7fbdfc003a20 2023-11-30T23:12:53.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7fbe16608700 1 -- 172.21.15.73:0/2488131300 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe10071460 con 0x7fbdfc003a20 2023-11-30T23:12:53.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7f6f6effd700 1 -- 172.21.15.73:0/1319000783 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f60011830 con 0x7f6f70073380 2023-11-30T23:12:53.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7faf967fc700 1 --2- 172.21.15.73:0/1866999455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf900c48c0 0x7faf9015f210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf8c000c00 tx=0x7faf8c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:53.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7fbe05ffb700 1 -- 172.21.15.73:0/2488131300 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c004240 con 0x7fbdfc003a20 2023-11-30T23:12:53.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7fbe16608700 1 -- 172.21.15.73:0/2488131300 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1006fc50 con 0x7fbdfc003a20 2023-11-30T23:12:53.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7fc34affd700 1 -- 172.21.15.73:0/2574487722 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fc34c04ff90 con 0x7fc35c0b3ab0 2023-11-30T23:12:53.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7fa5b7fff700 1 -- 172.21.15.73:0/2738356153 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc00b8a0 con 0x7fa5c00aefa0 2023-11-30T23:12:53.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7fa5b7fff700 1 -- 172.21.15.73:0/2738356153 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc00ba00 con 0x7fa5c00aefa0 2023-11-30T23:12:53.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7ff810ff9700 1 -- 172.21.15.73:0/1918441283 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80400bd60 con 0x7ff8140afd70 2023-11-30T23:12:53.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7ff8190ee700 1 -- 172.21.15.73:0/1918441283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8141df1e0 con 0x7ff8140afd70 2023-11-30T23:12:53.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7ff8190ee700 1 -- 172.21.15.73:0/1918441283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8140ad3e0 con 0x7ff8140afd70 2023-11-30T23:12:53.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7f098dffb700 1 -- 172.21.15.73:0/3237664498 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f0994051f90 con 0x7f0998146a70 2023-11-30T23:12:53.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7f817f7fe700 1 -- 172.21.15.73:0/2934311127 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819000abb0 con 0x7f81980b24a0 2023-11-30T23:12:53.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7f817f7fe700 1 -- 172.21.15.73:0/2934311127 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819000ad10 con 0x7f81980b24a0 2023-11-30T23:12:53.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7f817f7fe700 1 -- 172.21.15.73:0/2934311127 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81900072d0 con 0x7f81980b24a0 2023-11-30T23:12:53.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7f8197fff700 1 -- 172.21.15.73:0/2934311127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819813e3e0 con 0x7f81980b24a0 2023-11-30T23:12:53.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7f8197fff700 1 -- 172.21.15.73:0/2934311127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81981dfe30 con 0x7f81980b24a0 2023-11-30T23:12:53.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7fa5c665e700 1 -- 172.21.15.73:0/2738356153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c00aefa0 msgr2=0x7fa5c00b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7fa5c665e700 1 --2- 172.21.15.73:0/2738356153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c00aefa0 0x7fa5c00b1880 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0072940 tx=0x7fa5bc009bf0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7fbe05ffb700 1 -- 172.21.15.73:0/2488131300 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c00e6c0 con 0x7fbdfc003a20 2023-11-30T23:12:53.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7ff810ff9700 1 -- 172.21.15.73:0/1918441283 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80400bec0 con 0x7ff8140afd70 2023-11-30T23:12:53.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7ff810ff9700 1 -- 172.21.15.73:0/1918441283 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8040038c0 con 0x7ff8140afd70 2023-11-30T23:12:53.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7faf7f7fe700 1 -- 172.21.15.73:0/1866999455 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c006ea0 con 0x7faf900c48c0 2023-11-30T23:12:53.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7faf7f7fe700 1 -- 172.21.15.73:0/1866999455 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c01f070 con 0x7faf900c48c0 2023-11-30T23:12:53.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7faf9d612700 1 -- 172.21.15.73:0/1866999455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf900cbb20 con 0x7faf900c48c0 2023-11-30T23:12:53.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7faf9d612700 1 -- 172.21.15.73:0/1866999455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf900c7ba0 con 0x7faf900c48c0 2023-11-30T23:12:53.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7faf7f7fe700 1 -- 172.21.15.73:0/1866999455 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c003900 con 0x7faf900c48c0 2023-11-30T23:12:53.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7faf7f7fe700 1 -- 172.21.15.73:0/1866999455 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faf8c021030 con 0x7faf900c48c0 2023-11-30T23:12:53.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.979+0000 7f6f6effd700 1 -- 172.21.15.73:0/1319000783 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f60011990 con 0x7f6f70073380 2023-11-30T23:12:53.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7f6f6effd700 1 -- 172.21.15.73:0/1319000783 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f60011d00 con 0x7f6f70073380 2023-11-30T23:12:53.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7f6f756af700 1 -- 172.21.15.73:0/1319000783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f70073380 msgr2=0x7f6f7014dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7f6f756af700 1 --2- 172.21.15.73:0/1319000783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f70073380 0x7f6f7014dea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6f60009850 tx=0x7f6f60009b60 comp rx=0 tx=0).stop 2023-11-30T23:12:53.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7f6f756af700 1 -- 172.21.15.73:0/1319000783 shutdown_connections 2023-11-30T23:12:53.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7f6f756af700 1 --2- 172.21.15.73:0/1319000783 >> v2:172.21.15.156:3300/0 conn(0x7f6f7006b2f0 0x7f6f70155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7f6f756af700 1 --2- 172.21.15.73:0/1319000783 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f70073380 0x7f6f7014dea0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7f6f756af700 1 -- 172.21.15.73:0/1319000783 >> 172.21.15.73:0/1319000783 conn(0x7f6f7006a180 msgr2=0x7f6f7006a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:53.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7f6f756af700 1 -- 172.21.15.73:0/1319000783 shutdown_connections 2023-11-30T23:12:53.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7ff8190ee700 1 -- 172.21.15.73:0/1918441283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f4005310 con 0x7ff8140afd70 2023-11-30T23:12:53.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7fa5c665e700 1 -- 172.21.15.73:0/2738356153 shutdown_connections 2023-11-30T23:12:53.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7fa5c665e700 1 --2- 172.21.15.73:0/2738356153 >> v2:172.21.15.156:3300/0 conn(0x7fa5c0143250 0x7fa5c01436e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7fa5c665e700 1 --2- 172.21.15.73:0/2738356153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c00aefa0 0x7fa5c00b1880 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7fa5c665e700 1 -- 172.21.15.73:0/2738356153 >> 172.21.15.73:0/2738356153 conn(0x7fa5c006ab90 msgr2=0x7fa5c00b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:53.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7fa5c665e700 1 -- 172.21.15.73:0/2738356153 shutdown_connections 2023-11-30T23:12:53.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7fbe16608700 1 -- 172.21.15.73:0/2488131300 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf0005310 con 0x7fbdfc003a20 2023-11-30T23:12:53.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7faf7f7fe700 1 --2- 172.21.15.73:0/1866999455 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7faf8406e2e0 0x7faf840707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7faf7f7fe700 1 -- 172.21.15.73:0/1866999455 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf8c0844d0 con 0x7faf900c48c0 2023-11-30T23:12:53.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7faf96ffd700 1 --2- 172.21.15.73:0/1866999455 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7faf8406e2e0 0x7faf840707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7faf9d612700 1 -- 172.21.15.73:0/1866999455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf78005310 con 0x7faf900c48c0 2023-11-30T23:12:53.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7faf96ffd700 1 --2- 172.21.15.73:0/1866999455 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7faf8406e2e0 0x7faf840707a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faf88005930 tx=0x7faf88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:53.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7fbe05ffb700 1 -- 172.21.15.73:0/2488131300 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbe0c013820 con 0x7fbdfc003a20 2023-11-30T23:12:53.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7fbe05ffb700 1 --2- 172.21.15.73:0/2488131300 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbdf4065b00 0x7fbdf4067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7fbe14e05700 1 --2- 172.21.15.73:0/2488131300 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbdf4065b00 0x7fbdf4067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7fbe05ffb700 1 -- 172.21.15.73:0/2488131300 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe0c083f40 con 0x7fbdfc003a20 2023-11-30T23:12:53.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.983+0000 7f6f756af700 1 -- 172.21.15.73:0/1319000783 wait complete. 2023-11-30T23:12:53.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f756af700 1 Processor -- start 2023-11-30T23:12:53.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f756af700 1 -- start start 2023-11-30T23:12:53.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f756af700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f7006b2f0 0x7f6f70071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f756af700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f70073380 0x7f6f701470e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f756af700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f7014b4a0 0x7f6f700a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f756af700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f70143bc0 con 0x7f6f7006b2f0 2023-11-30T23:12:53.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f756af700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f700b13b0 con 0x7f6f70073380 2023-11-30T23:12:53.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f756af700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f70146c50 con 0x7f6f7014b4a0 2023-11-30T23:12:53.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f6ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f7006b2f0 0x7f6f70071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f6ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f7006b2f0 0x7f6f70071210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38224/0 (socket says 172.21.15.73:38224) 2023-11-30T23:12:53.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f6ffff700 1 -- 172.21.15.73:0/173053202 learned_addr learned my addr 172.21.15.73:0/173053202 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:53.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f74eae700 1 --2- 172.21.15.73:0/173053202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f7014b4a0 0x7f6f700a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f6f7fe700 1 --2- 172.21.15.73:0/173053202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f70073380 0x7f6f701470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7fa5c665e700 1 -- 172.21.15.73:0/2738356153 wait complete. 2023-11-30T23:12:53.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7fbe14e05700 1 --2- 172.21.15.73:0/2488131300 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbdf4065b00 0x7fbdf4067fc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbe1006e6b0 tx=0x7fbe00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:53.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7fa5c665e700 1 Processor -- start 2023-11-30T23:12:53.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f6ffff700 1 -- 172.21.15.73:0/173053202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f7014b4a0 msgr2=0x7f6f700a8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f6ffff700 1 --2- 172.21.15.73:0/173053202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f7014b4a0 0x7f6f700a8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f6ffff700 1 -- 172.21.15.73:0/173053202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f70073380 msgr2=0x7f6f701470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f6ffff700 1 --2- 172.21.15.73:0/173053202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f70073380 0x7f6f701470e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f6ffff700 1 -- 172.21.15.73:0/173053202 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f600094b0 con 0x7f6f7006b2f0 2023-11-30T23:12:53.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7f6f6ffff700 1 --2- 172.21.15.73:0/173053202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f7006b2f0 0x7f6f70071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6f7014ba40 tx=0x7f6f60004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:53.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.987+0000 7fa5c665e700 1 -- start start 2023-11-30T23:12:53.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5c665e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c00aefa0 0x7fa5c0071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5c665e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5c00b2710 0x7fa5c00b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5c665e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5c0143250 0x7fa5c01dbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5c665e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c0071da0 con 0x7fa5c00aefa0 2023-11-30T23:12:53.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5c665e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c01db780 con 0x7fa5c0143250 2023-11-30T23:12:53.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5c665e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c0134ea0 con 0x7fa5c00b2710 2023-11-30T23:12:53.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5c565c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c00aefa0 0x7fa5c0071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5c565c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c00aefa0 0x7fa5c0071860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38232/0 (socket says 172.21.15.73:38232) 2023-11-30T23:12:53.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5c565c700 1 -- 172.21.15.73:0/4258630693 learned_addr learned my addr 172.21.15.73:0/4258630693 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:53.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5c5e5d700 1 --2- 172.21.15.73:0/4258630693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5c0143250 0x7fa5c01dbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5c4e5b700 1 --2- 172.21.15.73:0/4258630693 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5c00b2710 0x7fa5c00b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7f8197fff700 1 -- 172.21.15.73:0/2934311127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819813e160 con 0x7f81980b24a0 2023-11-30T23:12:53.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5c4e5b700 1 -- 172.21.15.73:0/4258630693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5c0143250 msgr2=0x7fa5c01dbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5c4e5b700 1 --2- 172.21.15.73:0/4258630693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5c0143250 0x7fa5c01dbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5c4e5b700 1 -- 172.21.15.73:0/4258630693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c00aefa0 msgr2=0x7fa5c0071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5c4e5b700 1 --2- 172.21.15.73:0/4258630693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c00aefa0 0x7fa5c0071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5c4e5b700 1 -- 172.21.15.73:0/4258630693 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc009570 con 0x7fa5c00b2710 2023-11-30T23:12:53.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5c4e5b700 1 --2- 172.21.15.73:0/4258630693 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5c00b2710 0x7fa5c00b3010 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00b00d0 tx=0x7fa5bc004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:53.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fbe05ffb700 1 -- 172.21.15.73:0/2488131300 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fbe0c0518f0 con 0x7fbdfc003a20 2023-11-30T23:12:53.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5b5ffb700 1 -- 172.21.15.73:0/4258630693 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc01a620 con 0x7fa5c00b2710 2023-11-30T23:12:53.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7ff810ff9700 1 -- 172.21.15.73:0/1918441283 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff804022070 con 0x7ff8140afd70 2023-11-30T23:12:53.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5b5ffb700 1 -- 172.21.15.73:0/4258630693 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc01e070 con 0x7fa5c00b2710 2023-11-30T23:12:53.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7fa5b5ffb700 1 -- 172.21.15.73:0/4258630693 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc01a9e0 con 0x7fa5c00b2710 2023-11-30T23:12:53.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7ff810ff9700 1 --2- 172.21.15.73:0/1918441283 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff800065ad0 0x7ff800067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7ff813fff700 1 --2- 172.21.15.73:0/1918441283 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff800065ad0 0x7ff800067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.991+0000 7ff813fff700 1 --2- 172.21.15.73:0/1918441283 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff800065ad0 0x7ff800067f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff80c001fa0 tx=0x7ff80c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:53.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.995+0000 7fa5c665e700 1 -- 172.21.15.73:0/4258630693 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c0070d40 con 0x7fa5c00b2710 2023-11-30T23:12:53.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.995+0000 7fa5c665e700 1 -- 172.21.15.73:0/4258630693 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c0134bc0 con 0x7fa5c00b2710 2023-11-30T23:12:53.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.995+0000 7fa5b5ffb700 1 -- 172.21.15.73:0/4258630693 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa5bc01ab40 con 0x7fa5c00b2710 2023-11-30T23:12:53.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.995+0000 7f6f6cff9700 1 -- 172.21.15.73:0/173053202 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600038c0 con 0x7f6f7006b2f0 2023-11-30T23:12:53.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.995+0000 7fa5b5ffb700 1 --2- 172.21.15.73:0/4258630693 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa5a4065ad0 0x7fa5a4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.995+0000 7fa5b5ffb700 1 -- 172.21.15.73:0/4258630693 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5bc0843d0 con 0x7fa5c00b2710 2023-11-30T23:12:53.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.995+0000 7faf7f7fe700 1 -- 172.21.15.73:0/1866999455 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7faf8c051ea0 con 0x7faf900c48c0 2023-11-30T23:12:53.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.995+0000 7f6f756af700 1 -- 172.21.15.73:0/173053202 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f70147620 con 0x7f6f7006b2f0 2023-11-30T23:12:53.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.995+0000 7f6f756af700 1 -- 172.21.15.73:0/173053202 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f700a9e20 con 0x7f6f7006b2f0 2023-11-30T23:12:53.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.995+0000 7fa5c565c700 1 --2- 172.21.15.73:0/4258630693 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa5a4065ad0 0x7fa5a4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.999+0000 7f6f6cff9700 1 -- 172.21.15.73:0/173053202 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f60004580 con 0x7f6f7006b2f0 2023-11-30T23:12:53.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.999+0000 7f6f6cff9700 1 -- 172.21.15.73:0/173053202 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f60003c20 con 0x7f6f7006b2f0 2023-11-30T23:12:53.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.999+0000 7f817f7fe700 1 -- 172.21.15.73:0/2934311127 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8190007430 con 0x7f81980b24a0 2023-11-30T23:12:53.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.999+0000 7f817f7fe700 1 --2- 172.21.15.73:0/2934311127 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8184065ad0 0x7f8184067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.999+0000 7f817f7fe700 1 -- 172.21.15.73:0/2934311127 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8190082f60 con 0x7f81980b24a0 2023-11-30T23:12:53.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.999+0000 7f81967fc700 1 --2- 172.21.15.73:0/2934311127 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8184065ad0 0x7f8184067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.999+0000 7f81967fc700 1 --2- 172.21.15.73:0/2934311127 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8184065ad0 0x7f8184067f90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8198145350 tx=0x7f818c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:53.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.003+0000 7f6f6cff9700 1 -- 172.21.15.73:0/173053202 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6f6001a430 con 0x7f6f7006b2f0 2023-11-30T23:12:53.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.007+0000 7ff810ff9700 1 -- 172.21.15.73:0/1918441283 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff804056c20 con 0x7ff8140afd70 2023-11-30T23:12:53.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.007+0000 7f6f6cff9700 1 --2- 172.21.15.73:0/173053202 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6f5c065ad0 0x7f6f5c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:53.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:52.999+0000 7fa5c565c700 1 --2- 172.21.15.73:0/4258630693 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa5a4065ad0 0x7fa5a4067f90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800f3b0 tx=0x7fa5b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:53.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.003+0000 7fa5c665e700 1 -- 172.21.15.73:0/4258630693 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c00b2d30 con 0x7fa5c00b2710 2023-11-30T23:12:53.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.007+0000 7ff810ff9700 1 -- 172.21.15.73:0/1918441283 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7ff804052860 con 0x7ff8140afd70 2023-11-30T23:12:53.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.007+0000 7f6f6f7fe700 1 --2- 172.21.15.73:0/173053202 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6f5c065ad0 0x7f6f5c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:53.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.007+0000 7f6f6cff9700 1 -- 172.21.15.73:0/173053202 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f60021030 con 0x7f6f7006b2f0 2023-11-30T23:12:53.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.007+0000 7f817f7fe700 1 -- 172.21.15.73:0/2934311127 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f8190050990 con 0x7f81980b24a0 2023-11-30T23:12:53.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.007+0000 7fa5b5ffb700 1 -- 172.21.15.73:0/4258630693 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fa5c00b2d30 con 0x7fa5c00b2710 2023-11-30T23:12:53.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.011+0000 7f6f6f7fe700 1 --2- 172.21.15.73:0/173053202 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6f5c065ad0 0x7f6f5c067f90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6f700b3ee0 tx=0x7f6f64009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:53.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.015+0000 7f6f756af700 1 -- 172.21.15.73:0/173053202 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f50005310 con 0x7f6f7006b2f0 2023-11-30T23:12:53.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.023+0000 7f6f6cff9700 1 -- 172.21.15.73:0/173053202 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f6f60052390 con 0x7f6f7006b2f0 2023-11-30T23:12:53.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.283+0000 7f099e4ae700 1 -- 172.21.15.73:0/3237664498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f09980b1a10 con 0x7f0998146a70 2023-11-30T23:12:53.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.283+0000 7f098dffb700 1 -- 172.21.15.73:0/3237664498 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0994015030 con 0x7f0998146a70 2023-11-30T23:12:53.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.287+0000 7fc35b59e700 1 -- 172.21.15.73:0/2574487722 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc340005890 con 0x7fc35c0b3ab0 2023-11-30T23:12:53.292 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2023-11-30T23:12:53.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.287+0000 7fc34affd700 1 -- 172.21.15.73:0/2574487722 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc34c017020 con 0x7fc35c0b3ab0 2023-11-30T23:12:53.292 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-11-30T23:12:53.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.291+0000 7fc348ff9700 1 -- 172.21.15.73:0/2574487722 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc33c065b00 msgr2=0x7fc33c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.291+0000 7fc348ff9700 1 --2- 172.21.15.73:0/2574487722 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc33c065b00 0x7fc33c067fc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc3500112c0 tx=0x7fc350009240 comp rx=0 tx=0).stop 2023-11-30T23:12:53.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.291+0000 7fc348ff9700 1 -- 172.21.15.73:0/2574487722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc35c0b3ab0 msgr2=0x7fc35c0a84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.291+0000 7fc348ff9700 1 --2- 172.21.15.73:0/2574487722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc35c0b3ab0 0x7fc35c0a84c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc34c001200 tx=0x7fc34c00c7d0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.291+0000 7fc348ff9700 1 -- 172.21.15.73:0/2574487722 shutdown_connections 2023-11-30T23:12:53.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.291+0000 7fc348ff9700 1 --2- 172.21.15.73:0/2574487722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc35c156e30 0x7fc35c161ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.291+0000 7fc348ff9700 1 --2- 172.21.15.73:0/2574487722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc35c0b3ab0 0x7fc35c0a84c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.291+0000 7fc348ff9700 1 --2- 172.21.15.73:0/2574487722 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc33c065b00 0x7fc33c067fc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.291+0000 7fc348ff9700 1 --2- 172.21.15.73:0/2574487722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc35c072340 0x7fc35c088c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.291+0000 7fc348ff9700 1 -- 172.21.15.73:0/2574487722 >> 172.21.15.73:0/2574487722 conn(0x7fc35c06ab90 msgr2=0x7fc35c1565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:53.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.291+0000 7fc348ff9700 1 -- 172.21.15.73:0/2574487722 shutdown_connections 2023-11-30T23:12:53.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.291+0000 7fc348ff9700 1 -- 172.21.15.73:0/2574487722 wait complete. 2023-11-30T23:12:53.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.295+0000 7f09837fe700 1 -- 172.21.15.73:0/3237664498 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f097c065b20 msgr2=0x7f097c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.295+0000 7f09837fe700 1 --2- 172.21.15.73:0/3237664498 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f097c065b20 0x7f097c067fe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0988009bf0 tx=0x7f0988009240 comp rx=0 tx=0).stop 2023-11-30T23:12:53.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.295+0000 7f09837fe700 1 -- 172.21.15.73:0/3237664498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0998146a70 msgr2=0x7f09981ebe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.295+0000 7f09837fe700 1 --2- 172.21.15.73:0/3237664498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0998146a70 0x7f09981ebe90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f099806c950 tx=0x7f0994004770 comp rx=0 tx=0).stop 2023-11-30T23:12:53.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.295+0000 7f09837fe700 1 -- 172.21.15.73:0/3237664498 shutdown_connections 2023-11-30T23:12:53.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.295+0000 7f09837fe700 1 --2- 172.21.15.73:0/3237664498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0998146a70 0x7f09981ebe90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.295+0000 7f09837fe700 1 --2- 172.21.15.73:0/3237664498 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f097c065b20 0x7f097c067fe0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.295+0000 7f09837fe700 1 --2- 172.21.15.73:0/3237664498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09980afb40 0x7f09981e8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.295+0000 7f09837fe700 1 --2- 172.21.15.73:0/3237664498 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f09980ae6e0 0x7f09981dc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.295+0000 7f09837fe700 1 -- 172.21.15.73:0/3237664498 >> 172.21.15.73:0/3237664498 conn(0x7f09980b45a0 msgr2=0x7f0998145540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:53.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.295+0000 7f09837fe700 1 -- 172.21.15.73:0/3237664498 shutdown_connections 2023-11-30T23:12:53.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.295+0000 7f09837fe700 1 -- 172.21.15.73:0/3237664498 wait complete. 2023-11-30T23:12:53.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-11-30T23:12:53.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.311+0000 7fbe16608700 1 -- 172.21.15.73:0/2488131300 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fbdf00055c0 con 0x7fbdfc003a20 2023-11-30T23:12:53.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-11-30T23:12:53.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.311+0000 7fbe05ffb700 1 -- 172.21.15.73:0/2488131300 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe0c054f10 con 0x7fbdfc003a20 2023-11-30T23:12:53.316 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2023-11-30T23:12:53.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.315+0000 7fbe16608700 1 -- 172.21.15.73:0/2488131300 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbdf4065b00 msgr2=0x7fbdf4067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.315+0000 7fbe16608700 1 --2- 172.21.15.73:0/2488131300 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbdf4065b00 0x7fbdf4067fc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbe1006e6b0 tx=0x7fbe00008040 comp rx=0 tx=0).stop 2023-11-30T23:12:53.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.315+0000 7fbe16608700 1 -- 172.21.15.73:0/2488131300 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdfc003a20 msgr2=0x7fbe1014b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.315+0000 7fbe16608700 1 --2- 172.21.15.73:0/2488131300 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdfc003a20 0x7fbe1014b440 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c019000 tx=0x7fbe0c0047e0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.315+0000 7fbe16608700 1 -- 172.21.15.73:0/2488131300 shutdown_connections 2023-11-30T23:12:53.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.315+0000 7fbe16608700 1 --2- 172.21.15.73:0/2488131300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe100708f0 0x7fbe10142310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.315+0000 7fbe16608700 1 --2- 172.21.15.73:0/2488131300 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbdf4065b00 0x7fbdf4067fc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.315+0000 7fbe16608700 1 --2- 172.21.15.73:0/2488131300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbe101e3360 0x7fbe1006f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.315+0000 7fbe16608700 1 --2- 172.21.15.73:0/2488131300 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbdfc003a20 0x7fbe1014b440 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.315+0000 7fbe16608700 1 -- 172.21.15.73:0/2488131300 >> 172.21.15.73:0/2488131300 conn(0x7fbe100b8a10 msgr2=0x7fbe100ba7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:53.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.315+0000 7fbe16608700 1 -- 172.21.15.73:0/2488131300 shutdown_connections 2023-11-30T23:12:53.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.315+0000 7fbe16608700 1 -- 172.21.15.73:0/2488131300 wait complete. 2023-11-30T23:12:53.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.315+0000 7faf9d612700 1 -- 172.21.15.73:0/1866999455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faf78005890 con 0x7faf900c48c0 2023-11-30T23:12:53.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.315+0000 7faf7f7fe700 1 -- 172.21.15.73:0/1866999455 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf8c015020 con 0x7faf900c48c0 2023-11-30T23:12:53.321 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-11-30T23:12:53.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.315+0000 7ff8190ee700 1 -- 172.21.15.73:0/1918441283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff7f4005890 con 0x7ff8140afd70 2023-11-30T23:12:53.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7ff810ff9700 1 -- 172.21.15.73:0/1918441283 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff804006da0 con 0x7ff8140afd70 2023-11-30T23:12:53.322 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-11-30T23:12:53.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7faf9d612700 1 -- 172.21.15.73:0/1866999455 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7faf8406e2e0 msgr2=0x7faf840707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7faf9d612700 1 --2- 172.21.15.73:0/1866999455 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7faf8406e2e0 0x7faf840707a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faf88005930 tx=0x7faf88009040 comp rx=0 tx=0).stop 2023-11-30T23:12:53.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7faf9d612700 1 -- 172.21.15.73:0/1866999455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf900c48c0 msgr2=0x7faf9015f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7faf9d612700 1 --2- 172.21.15.73:0/1866999455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf900c48c0 0x7faf9015f210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf8c000c00 tx=0x7faf8c004770 comp rx=0 tx=0).stop 2023-11-30T23:12:53.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7faf9d612700 1 -- 172.21.15.73:0/1866999455 shutdown_connections 2023-11-30T23:12:53.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7faf9d612700 1 --2- 172.21.15.73:0/1866999455 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7faf8406e2e0 0x7faf840707a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7faf9d612700 1 --2- 172.21.15.73:0/1866999455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf900ca3a0 0x7faf900c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7faf9d612700 1 --2- 172.21.15.73:0/1866999455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf900c48c0 0x7faf9015f210 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7faf9d612700 1 --2- 172.21.15.73:0/1866999455 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7faf90037370 0x7faf9003d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7faf9d612700 1 -- 172.21.15.73:0/1866999455 >> 172.21.15.73:0/1866999455 conn(0x7faf9003a990 msgr2=0x7faf90005600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:53.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7faf9d612700 1 -- 172.21.15.73:0/1866999455 shutdown_connections 2023-11-30T23:12:53.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7faf9d612700 1 -- 172.21.15.73:0/1866999455 wait complete. 2023-11-30T23:12:53.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7ff8190ee700 1 -- 172.21.15.73:0/1918441283 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff800065ad0 msgr2=0x7ff800067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7ff8190ee700 1 --2- 172.21.15.73:0/1918441283 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff800065ad0 0x7ff800067f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff80c001fa0 tx=0x7ff80c009040 comp rx=0 tx=0).stop 2023-11-30T23:12:53.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7ff8190ee700 1 -- 172.21.15.73:0/1918441283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8140afd70 msgr2=0x7ff8141db640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7ff8190ee700 1 --2- 172.21.15.73:0/1918441283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8140afd70 0x7ff8141db640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff804004000 tx=0x7ff804004770 comp rx=0 tx=0).stop 2023-11-30T23:12:53.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7ff8190ee700 1 -- 172.21.15.73:0/1918441283 shutdown_connections 2023-11-30T23:12:53.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7ff8190ee700 1 --2- 172.21.15.73:0/1918441283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8140afd70 0x7ff8141db640 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7ff8190ee700 1 --2- 172.21.15.73:0/1918441283 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff800065ad0 0x7ff800067f90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7ff8190ee700 1 --2- 172.21.15.73:0/1918441283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8140adf40 0x7ff814143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7ff8190ee700 1 --2- 172.21.15.73:0/1918441283 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff8140adb60 0x7ff8141435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7ff8190ee700 1 -- 172.21.15.73:0/1918441283 >> 172.21.15.73:0/1918441283 conn(0x7ff81406ab90 msgr2=0x7ff8140b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:53.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7ff8190ee700 1 -- 172.21.15.73:0/1918441283 shutdown_connections 2023-11-30T23:12:53.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.319+0000 7ff8190ee700 1 -- 172.21.15.73:0/1918441283 wait complete. 2023-11-30T23:12:53.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f8197fff700 1 -- 172.21.15.73:0/2934311127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f81980af1d0 con 0x7f81980b24a0 2023-11-30T23:12:53.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f6f756af700 1 -- 172.21.15.73:0/173053202 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6f50005890 con 0x7f6f7006b2f0 2023-11-30T23:12:53.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f817f7fe700 1 -- 172.21.15.73:0/2934311127 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8190018020 con 0x7f81980b24a0 2023-11-30T23:12:53.330 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-11-30T23:12:53.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f6f6cff9700 1 -- 172.21.15.73:0/173053202 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f6002b070 con 0x7f6f7006b2f0 2023-11-30T23:12:53.331 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-11-30T23:12:53.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7fa5c665e700 1 -- 172.21.15.73:0/4258630693 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa5c00b2d30 con 0x7fa5c00b2710 2023-11-30T23:12:53.332 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2023-11-30T23:12:53.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7fa5b5ffb700 1 -- 172.21.15.73:0/4258630693 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5c00b2d30 con 0x7fa5c00b2710 2023-11-30T23:12:53.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f6f756af700 1 -- 172.21.15.73:0/173053202 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6f5c065ad0 msgr2=0x7f6f5c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f6f756af700 1 --2- 172.21.15.73:0/173053202 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6f5c065ad0 0x7f6f5c067f90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6f700b3ee0 tx=0x7f6f64009040 comp rx=0 tx=0).stop 2023-11-30T23:12:53.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f6f756af700 1 -- 172.21.15.73:0/173053202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f7006b2f0 msgr2=0x7f6f70071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f6f756af700 1 --2- 172.21.15.73:0/173053202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f7006b2f0 0x7f6f70071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6f7014ba40 tx=0x7f6f60004770 comp rx=0 tx=0).stop 2023-11-30T23:12:53.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f6f756af700 1 -- 172.21.15.73:0/173053202 shutdown_connections 2023-11-30T23:12:53.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f6f756af700 1 --2- 172.21.15.73:0/173053202 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f7014b4a0 0x7f6f700a8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f6f756af700 1 --2- 172.21.15.73:0/173053202 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6f5c065ad0 0x7f6f5c067f90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f6f756af700 1 --2- 172.21.15.73:0/173053202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f70073380 0x7f6f701470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f6f756af700 1 --2- 172.21.15.73:0/173053202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f7006b2f0 0x7f6f70071210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f6f756af700 1 -- 172.21.15.73:0/173053202 >> 172.21.15.73:0/173053202 conn(0x7f6f7006a180 msgr2=0x7f6f700b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:53.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f6f756af700 1 -- 172.21.15.73:0/173053202 shutdown_connections 2023-11-30T23:12:53.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f6f756af700 1 -- 172.21.15.73:0/173053202 wait complete. 2023-11-30T23:12:53.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f8197fff700 1 -- 172.21.15.73:0/2934311127 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8184065ad0 msgr2=0x7f8184067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f8197fff700 1 --2- 172.21.15.73:0/2934311127 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8184065ad0 0x7f8184067f90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8198145350 tx=0x7f818c01c040 comp rx=0 tx=0).stop 2023-11-30T23:12:53.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f8197fff700 1 -- 172.21.15.73:0/2934311127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81980b24a0 msgr2=0x7f819814a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.327+0000 7f8197fff700 1 --2- 172.21.15.73:0/2934311127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81980b24a0 0x7f819814a9e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f819000cc10 tx=0x7f819000a060 comp rx=0 tx=0).stop 2023-11-30T23:12:53.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7f8197fff700 1 -- 172.21.15.73:0/2934311127 shutdown_connections 2023-11-30T23:12:53.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7f8197fff700 1 --2- 172.21.15.73:0/2934311127 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8184065ad0 0x7f8184067f90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7f8197fff700 1 --2- 172.21.15.73:0/2934311127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81981e0890 0x7f819813cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7f8197fff700 1 --2- 172.21.15.73:0/2934311127 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f819814e1f0 0x7f81981e0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7f8197fff700 1 --2- 172.21.15.73:0/2934311127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81980b24a0 0x7f819814a9e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7f8197fff700 1 -- 172.21.15.73:0/2934311127 >> 172.21.15.73:0/2934311127 conn(0x7f81980b45a0 msgr2=0x7f81980b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:53.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7f8197fff700 1 -- 172.21.15.73:0/2934311127 shutdown_connections 2023-11-30T23:12:53.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7f8197fff700 1 -- 172.21.15.73:0/2934311127 wait complete. 2023-11-30T23:12:53.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7fa5c665e700 1 -- 172.21.15.73:0/4258630693 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa5a4065ad0 msgr2=0x7fa5a4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7fa5c665e700 1 --2- 172.21.15.73:0/4258630693 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa5a4065ad0 0x7fa5a4067f90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800f3b0 tx=0x7fa5b8009040 comp rx=0 tx=0).stop 2023-11-30T23:12:53.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7fa5c665e700 1 -- 172.21.15.73:0/4258630693 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5c00b2710 msgr2=0x7fa5c00b3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:53.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7fa5c665e700 1 --2- 172.21.15.73:0/4258630693 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5c00b2710 0x7fa5c00b3010 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00b00d0 tx=0x7fa5bc004770 comp rx=0 tx=0).stop 2023-11-30T23:12:53.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7fa5c665e700 1 -- 172.21.15.73:0/4258630693 shutdown_connections 2023-11-30T23:12:53.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7fa5c665e700 1 --2- 172.21.15.73:0/4258630693 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa5a4065ad0 0x7fa5a4067f90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7fa5c665e700 1 --2- 172.21.15.73:0/4258630693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5c0143250 0x7fa5c01dbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7fa5c665e700 1 --2- 172.21.15.73:0/4258630693 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa5c00b2710 0x7fa5c00b3010 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7fa5c665e700 1 --2- 172.21.15.73:0/4258630693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c00aefa0 0x7fa5c0071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:53.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7fa5c665e700 1 -- 172.21.15.73:0/4258630693 >> 172.21.15.73:0/4258630693 conn(0x7fa5c006ab90 msgr2=0x7fa5c01436c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:53.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7fa5c665e700 1 -- 172.21.15.73:0/4258630693 shutdown_connections 2023-11-30T23:12:53.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-11-30T23:12:53.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:53.331+0000 7fa5c665e700 1 -- 172.21.15.73:0/4258630693 wait complete. 2023-11-30T23:12:53.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-11-30T23:12:53.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-11-30T23:12:53.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-11-30T23:12:53.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-11-30T23:12:53.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-11-30T23:12:54.311 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-30T23:12:54.316 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-30T23:12:54.339 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-30T23:12:54.339 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-30T23:12:54.342 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-30T23:12:54.348 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-30T23:12:54.349 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-30T23:12:54.351 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-30T23:12:54.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e9ea34700 1 Processor -- start 2023-11-30T23:12:54.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e9ea34700 1 -- start start 2023-11-30T23:12:54.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e9ea34700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e980b0e80 0x7f8e98142b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e9ea34700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e980afab0 0x7f8e980afee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e9ea34700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e980b0420 con 0x7f8e980b1260 2023-11-30T23:12:54.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e9ea34700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e980af660 con 0x7f8e980b0e80 2023-11-30T23:12:54.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e9ea34700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9806e280 con 0x7f8e980afab0 2023-11-30T23:12:54.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e977fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8e980b1260 0x7f8e98071f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38182/0 (socket says 172.21.15.73:38182) 2023-11-30T23:12:54.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e977fe700 1 -- 172.21.15.73:0/3413424818 learned_addr learned my addr 172.21.15.73:0/3413424818 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:54.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e9cfd1700 1 --2- 172.21.15.73:0/3413424818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e980afab0 0x7f8e980afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e97fff700 1 --2- 172.21.15.73:0/3413424818 >> v2:172.21.15.73:3300/0 conn(0x7f8e980b0e80 0x7f8e98142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e9cfd1700 1 -- 172.21.15.73:0/3413424818 >> v2:172.21.15.73:3300/0 conn(0x7f8e980b0e80 msgr2=0x7f8e98142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:54.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e9cfd1700 1 --2- 172.21.15.73:0/3413424818 >> v2:172.21.15.73:3300/0 conn(0x7f8e980b0e80 0x7f8e98142b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e9cfd1700 1 -- 172.21.15.73:0/3413424818 >> v1:172.21.15.73:6789/0 conn(0x7f8e980b1260 legacy=0x7f8e98071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e9cfd1700 1 -- 172.21.15.73:0/3413424818 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e981430f0 con 0x7f8e980afab0 2023-11-30T23:12:54.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e97fff700 1 --2- 172.21.15.73:0/3413424818 >> v2:172.21.15.73:3300/0 conn(0x7f8e980b0e80 0x7f8e98142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:12:54.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e9cfd1700 1 --2- 172.21.15.73:0/3413424818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e980afab0 0x7f8e980afee0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009850 tx=0x7f8e88009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e5a017eb4c98108 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e96ffd700 1 -- 172.21.15.73:0/3413424818 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e88004230 con 0x7f8e980afab0 2023-11-30T23:12:54.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.455+0000 7f8e96ffd700 1 -- 172.21.15.73:0/3413424818 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e88004390 con 0x7f8e980afab0 2023-11-30T23:12:54.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.459+0000 7f8e9ea34700 1 -- 172.21.15.73:0/3413424818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e980afab0 msgr2=0x7f8e980afee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.459+0000 7f8e9ea34700 1 --2- 172.21.15.73:0/3413424818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e980afab0 0x7f8e980afee0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009850 tx=0x7f8e88009b60 comp rx=0 tx=0).stop 2023-11-30T23:12:54.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.459+0000 7f8e9ea34700 1 -- 172.21.15.73:0/3413424818 shutdown_connections 2023-11-30T23:12:54.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.459+0000 7f8e9ea34700 1 --2- 172.21.15.73:0/3413424818 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e980afab0 0x7f8e980afee0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.459+0000 7f8e9ea34700 1 --2- 172.21.15.73:0/3413424818 >> v2:172.21.15.73:3300/0 conn(0x7f8e980b0e80 0x7f8e98142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.459+0000 7f8e9ea34700 1 -- 172.21.15.73:0/3413424818 >> 172.21.15.73:0/3413424818 conn(0x7f8e9806ab90 msgr2=0x7f8e980b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:54.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.459+0000 7f8e9ea34700 1 -- 172.21.15.73:0/3413424818 shutdown_connections 2023-11-30T23:12:54.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.459+0000 7f8e9ea34700 1 -- 172.21.15.73:0/3413424818 wait complete. 2023-11-30T23:12:54.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.459+0000 7f8e9ea34700 1 Processor -- start 2023-11-30T23:12:54.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.459+0000 7f8e9ea34700 1 -- start start 2023-11-30T23:12:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e9ea34700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e980b0e80 0x7f8e980713a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e9ea34700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e980b1260 0x7f8e9813d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e9ea34700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e981e8280 0x7f8e9813e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e9ea34700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98070ec0 con 0x7f8e980b1260 2023-11-30T23:12:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e9ea34700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980718e0 con 0x7f8e981e8280 2023-11-30T23:12:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e9ea34700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9813ed70 con 0x7f8e980b0e80 2023-11-30T23:12:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e977fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e980b1260 0x7f8e9813d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e977fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e980b1260 0x7f8e9813d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38256/0 (socket says 172.21.15.73:38256) 2023-11-30T23:12:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e977fe700 1 -- 172.21.15.73:0/223714970 learned_addr learned my addr 172.21.15.73:0/223714970 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e97fff700 1 --2- 172.21.15.73:0/223714970 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e980b0e80 0x7f8e980713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e977fe700 1 -- 172.21.15.73:0/223714970 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e980b0e80 msgr2=0x7f8e980713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e9cfd1700 1 --2- 172.21.15.73:0/223714970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e981e8280 0x7f8e9813e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e977fe700 1 --2- 172.21.15.73:0/223714970 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e980b0e80 0x7f8e980713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e977fe700 1 -- 172.21.15.73:0/223714970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e981e8280 msgr2=0x7f8e9813e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e977fe700 1 --2- 172.21.15.73:0/223714970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e981e8280 0x7f8e9813e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e977fe700 1 -- 172.21.15.73:0/223714970 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e880094b0 con 0x7f8e980b1260 2023-11-30T23:12:54.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e9cfd1700 1 --2- 172.21.15.73:0/223714970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e981e8280 0x7f8e9813e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-30T23:12:54.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e977fe700 1 --2- 172.21.15.73:0/223714970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e980b1260 0x7f8e9813d850 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000cc20 tx=0x7f8e9000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e94ff9700 1 -- 172.21.15.73:0/223714970 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000ac20 con 0x7f8e980b1260 2023-11-30T23:12:54.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e9ea34700 1 -- 172.21.15.73:0/223714970 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9813fd60 con 0x7f8e980b1260 2023-11-30T23:12:54.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.463+0000 7f8e9ea34700 1 -- 172.21.15.73:0/223714970 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9813d490 con 0x7f8e980b1260 2023-11-30T23:12:54.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.467+0000 7f8e94ff9700 1 -- 172.21.15.73:0/223714970 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9000ada0 con 0x7f8e980b1260 2023-11-30T23:12:54.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.467+0000 7f8e94ff9700 1 -- 172.21.15.73:0/223714970 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e900115a0 con 0x7f8e980b1260 2023-11-30T23:12:54.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.467+0000 7f8e94ff9700 1 -- 172.21.15.73:0/223714970 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8e90011780 con 0x7f8e980b1260 2023-11-30T23:12:54.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.471+0000 7f8e9ea34700 1 -- 172.21.15.73:0/223714970 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e84005310 con 0x7f8e980b1260 2023-11-30T23:12:54.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.471+0000 7f8e94ff9700 1 --2- 172.21.15.73:0/223714970 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8e80065e00 0x7f8e800682c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.471+0000 7f8e94ff9700 1 -- 172.21.15.73:0/223714970 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e900830c0 con 0x7f8e980b1260 2023-11-30T23:12:54.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.471+0000 7f8e97fff700 1 --2- 172.21.15.73:0/223714970 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8e80065e00 0x7f8e800682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.475+0000 7f8e97fff700 1 --2- 172.21.15.73:0/223714970 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8e80065e00 0x7f8e800682c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c003910 tx=0x7f8e8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.479+0000 7f8e94ff9700 1 -- 172.21.15.73:0/223714970 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f8e900b4070 con 0x7f8e980b1260 2023-11-30T23:12:54.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.503+0000 7f664ffff700 1 Processor -- start 2023-11-30T23:12:54.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.503+0000 7f664ffff700 1 -- start start 2023-11-30T23:12:54.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.503+0000 7fd064ecc700 1 Processor -- start 2023-11-30T23:12:54.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.503+0000 7fe77bfff700 1 Processor -- start 2023-11-30T23:12:54.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.503+0000 7fe77bfff700 1 -- start start 2023-11-30T23:12:54.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.503+0000 7fd064ecc700 1 -- start start 2023-11-30T23:12:54.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.503+0000 7eff0afff700 1 Processor -- start 2023-11-30T23:12:54.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.503+0000 7eff0afff700 1 -- start start 2023-11-30T23:12:54.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f66500b2fa0 0x7f66500b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66500b15a0 0x7f66500af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664ffff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66500b3380 con 0x7f66500b10f0 2023-11-30T23:12:54.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664ffff700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66500ae730 con 0x7f66500b2fa0 2023-11-30T23:12:54.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664ffff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66500b1a30 con 0x7f66500b15a0 2023-11-30T23:12:54.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d7454700 1 Processor -- start 2023-11-30T23:12:54.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d7454700 1 -- start start 2023-11-30T23:12:54.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66500b15a0 0x7f66500af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664f7fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66500b15a0 0x7f66500af6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:43100/0 (socket says 172.21.15.73:43100) 2023-11-30T23:12:54.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664f7fe700 1 -- 172.21.15.73:0/3889929253 learned_addr learned my addr 172.21.15.73:0/3889929253 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:54.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd064ecc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd0600b1420 0x7fd06013e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd064ecc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd06013e980 0x7fd060147970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd064ecc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0600700c0 con 0x7fd060147eb0 2023-11-30T23:12:54.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd064ecc700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0600b3b40 con 0x7fd06013e980 2023-11-30T23:12:54.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd064ecc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0600b1800 con 0x7fd0600b1420 2023-11-30T23:12:54.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd05effd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd06013e980 0x7fd060147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7eff0afff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7eff040b0cb0 0x7eff040afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd05effd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd06013e980 0x7fd060147970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38270/0 (socket says 172.21.15.73:38270) 2023-11-30T23:12:54.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd05effd700 1 -- 172.21.15.73:0/2274051087 learned_addr learned my addr 172.21.15.73:0/2274051087 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:54.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7eff0afff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7eff0414ae40 0x7eff0414b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7eff0afff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0414b8d0 con 0x7eff041447e0 2023-11-30T23:12:54.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7eff0afff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff040af730 con 0x7eff0414ae40 2023-11-30T23:12:54.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7eff0afff700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff040b1090 con 0x7eff040b0cb0 2023-11-30T23:12:54.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd05f7fe700 1 --2- 172.21.15.73:0/2274051087 >> v2:172.21.15.156:3300/0 conn(0x7fd0600b1420 0x7fd06013e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe77c0b0600 0x7fe77c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe77c0aefa0 0x7fe77c146630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe77c0b09e0 0x7fe77c146b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77bfff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77c0aea60 con 0x7fe77c0b09e0 2023-11-30T23:12:54.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77bfff700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77c1470b0 con 0x7fe77c0b0600 2023-11-30T23:12:54.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77bfff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c0af4c0 con 0x7fe77c0aefa0 2023-11-30T23:12:54.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77b7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe77c0b09e0 0x7fe77c146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77b7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe77c0b09e0 0x7fe77c146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38266/0 (socket says 172.21.15.73:38266) 2023-11-30T23:12:54.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77b7fe700 1 -- 172.21.15.73:0/1561574379 learned_addr learned my addr 172.21.15.73:0/1561574379 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:54.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77affd700 1 --2- 172.21.15.73:0/1561574379 >> v2:172.21.15.156:3300/0 conn(0x7fe77c0b0600 0x7fe77c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664dffb700 1 -- 172.21.15.73:0/3889929253 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 131465192 0 0) 0x7f66500b3380 con 0x7f66500b10f0 2023-11-30T23:12:54.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664dffb700 1 -- 172.21.15.73:0/3889929253 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f663c0035d0 con 0x7f66500b10f0 2023-11-30T23:12:54.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664effd700 1 --2- 172.21.15.73:0/3889929253 >> v2:172.21.15.156:3300/0 conn(0x7f66500b2fa0 0x7f66500b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77a7fc700 1 --2- 172.21.15.73:0/1561574379 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe77c0aefa0 0x7fe77c146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd05effd700 1 -- 172.21.15.73:0/2274051087 >> v2:172.21.15.156:3300/0 conn(0x7fd0600b1420 msgr2=0x7fd06013e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:54.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd05effd700 1 --2- 172.21.15.73:0/2274051087 >> v2:172.21.15.156:3300/0 conn(0x7fd0600b1420 0x7fd06013e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd05effd700 1 -- 172.21.15.73:0/2274051087 >> v1:172.21.15.156:6789/0 conn(0x7fd060147eb0 legacy=0x7fd0600b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:54.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd05effd700 1 -- 172.21.15.73:0/2274051087 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06006f390 con 0x7fd06013e980 2023-11-30T23:12:54.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d7454700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f43d00b1420 0x7f43d0147970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d7454700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f43d0147eb0 0x7f43d013e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d7454700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43d013e750 0x7f43d00b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d7454700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d00b40c0 con 0x7f43d0147eb0 2023-11-30T23:12:54.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d7454700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d013ebe0 con 0x7f43d00b1420 2023-11-30T23:12:54.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d7454700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d006ee70 con 0x7f43d013e750 2023-11-30T23:12:54.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7eff097fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7eff0414ae40 0x7eff0414b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7eff097fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7eff0414ae40 0x7eff0414b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38276/0 (socket says 172.21.15.73:38276) 2023-11-30T23:12:54.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7eff097fc700 1 -- 172.21.15.73:0/1615461865 learned_addr learned my addr 172.21.15.73:0/1615461865 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:54.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77b7fe700 1 -- 172.21.15.73:0/1561574379 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe77c0aefa0 msgr2=0x7fe77c146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:54.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77b7fe700 1 --2- 172.21.15.73:0/1561574379 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe77c0aefa0 0x7fe77c146630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77b7fe700 1 -- 172.21.15.73:0/1561574379 >> v2:172.21.15.156:3300/0 conn(0x7fe77c0b0600 msgr2=0x7fe77c0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:54.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77b7fe700 1 --2- 172.21.15.73:0/1561574379 >> v2:172.21.15.156:3300/0 conn(0x7fe77c0b0600 0x7fe77c0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77b7fe700 1 -- 172.21.15.73:0/1561574379 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c0ae680 con 0x7fe77c0b09e0 2023-11-30T23:12:54.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d5c51700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f43d0147eb0 0x7f43d013e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d6c53700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43d013e750 0x7f43d00b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664f7fe700 1 -- 172.21.15.73:0/3889929253 >> v2:172.21.15.156:3300/0 conn(0x7f66500b2fa0 msgr2=0x7f66500b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:54.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664f7fe700 1 --2- 172.21.15.73:0/3889929253 >> v2:172.21.15.156:3300/0 conn(0x7f66500b2fa0 0x7f66500b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664f7fe700 1 -- 172.21.15.73:0/3889929253 >> v1:172.21.15.156:6789/0 conn(0x7f66500b10f0 legacy=0x7f66500aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664f7fe700 1 -- 172.21.15.73:0/3889929253 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665006e6b0 con 0x7f66500b15a0 2023-11-30T23:12:54.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd05effd700 1 --2- 172.21.15.73:0/2274051087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd06013e980 0x7fd060147970 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd0600b50d0 tx=0x7fd05800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146e5f4762a977c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d6c53700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43d013e750 0x7f43d00b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:43132/0 (socket says 172.21.15.73:43132) 2023-11-30T23:12:54.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d6c53700 1 -- 172.21.15.73:0/2005441815 learned_addr learned my addr 172.21.15.73:0/2005441815 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:54.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7eff097fc700 1 -- 172.21.15.73:0/1615461865 >> v2:172.21.15.156:3300/0 conn(0x7eff040b0cb0 msgr2=0x7eff040afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:54.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7eff097fc700 1 --2- 172.21.15.73:0/1615461865 >> v2:172.21.15.156:3300/0 conn(0x7eff040b0cb0 0x7eff040afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7eff097fc700 1 -- 172.21.15.73:0/1615461865 >> v1:172.21.15.73:6789/0 conn(0x7eff041447e0 legacy=0x7eff0414df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7eff097fc700 1 -- 172.21.15.73:0/1615461865 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff040af3c0 con 0x7eff0414ae40 2023-11-30T23:12:54.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664f7fe700 1 --2- 172.21.15.73:0/3889929253 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66500b15a0 0x7f66500af6b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6638009910 tx=0x7f6638009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87a3f3261ad311a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77b7fe700 1 --2- 172.21.15.73:0/1561574379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe77c0b09e0 0x7fe77c146b70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe77c0b8b70 tx=0x7fe770009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3419e194cdeb2cd0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d6452700 1 --2- 172.21.15.73:0/2005441815 >> v2:172.21.15.156:3300/0 conn(0x7f43d00b1420 0x7f43d0147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7eff097fc700 1 --2- 172.21.15.73:0/1615461865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff0414ae40 0x7eff0414b2c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7eff040b4cd0 tx=0x7eff00009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7728539e151492 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d5c51700 1 -- 172.21.15.73:0/2005441815 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43d013e750 msgr2=0x7f43d00b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:54.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d5c51700 1 --2- 172.21.15.73:0/2005441815 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43d013e750 0x7f43d00b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d5c51700 1 -- 172.21.15.73:0/2005441815 >> v2:172.21.15.156:3300/0 conn(0x7f43d00b1420 msgr2=0x7f43d0147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:54.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d5c51700 1 --2- 172.21.15.73:0/2005441815 >> v2:172.21.15.156:3300/0 conn(0x7f43d00b1420 0x7f43d0147970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d5c51700 1 -- 172.21.15.73:0/2005441815 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d0070050 con 0x7f43d0147eb0 2023-11-30T23:12:54.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe779ffb700 1 -- 172.21.15.73:0/1561574379 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe770011830 con 0x7fe77c0b09e0 2023-11-30T23:12:54.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664dffb700 1 -- 172.21.15.73:0/3889929253 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6638011830 con 0x7f66500b15a0 2023-11-30T23:12:54.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664dffb700 1 -- 172.21.15.73:0/3889929253 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6638011990 con 0x7f66500b15a0 2023-11-30T23:12:54.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664dffb700 1 -- 172.21.15.73:0/3889929253 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6638011d40 con 0x7f66500b15a0 2023-11-30T23:12:54.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7eff08ffb700 1 -- 172.21.15.73:0/1615461865 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0000b8a0 con 0x7eff0414ae40 2023-11-30T23:12:54.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd05e7fc700 1 -- 172.21.15.73:0/2274051087 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05800e070 con 0x7fd06013e980 2023-11-30T23:12:54.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f43d5c51700 1 --2- 172.21.15.73:0/2005441815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d0147eb0 0x7f43d013e210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f43d00b5540 tx=0x7f43c0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5cc5a9fff75d01a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7eff08ffb700 1 -- 172.21.15.73:0/1615461865 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0000ba00 con 0x7eff0414ae40 2023-11-30T23:12:54.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7eff08ffb700 1 -- 172.21.15.73:0/1615461865 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0000bd70 con 0x7eff0414ae40 2023-11-30T23:12:54.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd05e7fc700 1 -- 172.21.15.73:0/2274051087 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd058003a40 con 0x7fd06013e980 2023-11-30T23:12:54.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd05e7fc700 1 -- 172.21.15.73:0/2274051087 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058003df0 con 0x7fd06013e980 2023-11-30T23:12:54.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f3b159c0700 1 Processor -- start 2023-11-30T23:12:54.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f3b159c0700 1 -- start start 2023-11-30T23:12:54.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664ffff700 1 -- 172.21.15.73:0/3889929253 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66500b15a0 msgr2=0x7f66500af6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664ffff700 1 --2- 172.21.15.73:0/3889929253 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66500b15a0 0x7f66500af6b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6638009910 tx=0x7f6638009c20 comp rx=0 tx=0).stop 2023-11-30T23:12:54.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f3b159c0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b100b7b30 0x7f3b1014e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7eff0afff700 1 -- 172.21.15.73:0/1615461865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff0414ae40 msgr2=0x7eff0414b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7eff0afff700 1 --2- 172.21.15.73:0/1615461865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff0414ae40 0x7eff0414b2c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7eff040b4cd0 tx=0x7eff00009bf0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd064ecc700 1 -- 172.21.15.73:0/2274051087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd06013e980 msgr2=0x7fd060147970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd064ecc700 1 --2- 172.21.15.73:0/2274051087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd06013e980 0x7fd060147970 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd0600b50d0 tx=0x7fd05800b330 comp rx=0 tx=0).stop 2023-11-30T23:12:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe779ffb700 1 -- 172.21.15.73:0/1561574379 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe770011990 con 0x7fe77c0b09e0 2023-11-30T23:12:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe779ffb700 1 -- 172.21.15.73:0/1561574379 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe770011d20 con 0x7fe77c0b09e0 2023-11-30T23:12:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77bfff700 1 -- 172.21.15.73:0/1561574379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe77c0b09e0 msgr2=0x7fe77c146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77bfff700 1 --2- 172.21.15.73:0/1561574379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe77c0b09e0 0x7fe77c146b70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe77c0b8b70 tx=0x7fe770009bf0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77bfff700 1 -- 172.21.15.73:0/1561574379 shutdown_connections 2023-11-30T23:12:54.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77bfff700 1 --2- 172.21.15.73:0/1561574379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe77c0b09e0 0x7fe77c146b70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77bfff700 1 --2- 172.21.15.73:0/1561574379 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe77c0aefa0 0x7fe77c146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77bfff700 1 --2- 172.21.15.73:0/1561574379 >> v2:172.21.15.156:3300/0 conn(0x7fe77c0b0600 0x7fe77c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fe77bfff700 1 -- 172.21.15.73:0/1561574379 >> 172.21.15.73:0/1561574379 conn(0x7fe77c06ab90 msgr2=0x7fe77c0b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:54.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664ffff700 1 -- 172.21.15.73:0/3889929253 shutdown_connections 2023-11-30T23:12:54.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664ffff700 1 --2- 172.21.15.73:0/3889929253 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66500b15a0 0x7f66500af6b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7f664ffff700 1 --2- 172.21.15.73:0/3889929253 >> v2:172.21.15.156:3300/0 conn(0x7f66500b2fa0 0x7f66500b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f664ffff700 1 -- 172.21.15.73:0/3889929253 >> 172.21.15.73:0/3889929253 conn(0x7f665006ab90 msgr2=0x7f66500b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:54.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd064ecc700 1 -- 172.21.15.73:0/2274051087 shutdown_connections 2023-11-30T23:12:54.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.507+0000 7fd064ecc700 1 --2- 172.21.15.73:0/2274051087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd06013e980 0x7fd060147970 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd064ecc700 1 --2- 172.21.15.73:0/2274051087 >> v2:172.21.15.156:3300/0 conn(0x7fd0600b1420 0x7fd06013e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd064ecc700 1 -- 172.21.15.73:0/2274051087 >> 172.21.15.73:0/2274051087 conn(0x7fd06006ab90 msgr2=0x7fd0600b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:54.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7eff0afff700 1 -- 172.21.15.73:0/1615461865 shutdown_connections 2023-11-30T23:12:54.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7eff0afff700 1 --2- 172.21.15.73:0/1615461865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff0414ae40 0x7eff0414b2c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7eff0afff700 1 --2- 172.21.15.73:0/1615461865 >> v2:172.21.15.156:3300/0 conn(0x7eff040b0cb0 0x7eff040afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7eff0afff700 1 -- 172.21.15.73:0/1615461865 >> 172.21.15.73:0/1615461865 conn(0x7eff0406ab90 msgr2=0x7eff040b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:54.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f43d5450700 1 -- 172.21.15.73:0/2005441815 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0011830 con 0x7f43d0147eb0 2023-11-30T23:12:54.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77bfff700 1 -- 172.21.15.73:0/1561574379 shutdown_connections 2023-11-30T23:12:54.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f3b0e7fc700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3b1014e600 0x7f3b100b3330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38200/0 (socket says 172.21.15.73:38200) 2023-11-30T23:12:54.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77bfff700 1 -- 172.21.15.73:0/1561574379 wait complete. 2023-11-30T23:12:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f664ffff700 1 -- 172.21.15.73:0/3889929253 shutdown_connections 2023-11-30T23:12:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f43d5450700 1 -- 172.21.15.73:0/2005441815 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c0011990 con 0x7f43d0147eb0 2023-11-30T23:12:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f43d5450700 1 -- 172.21.15.73:0/2005441815 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0011830 con 0x7f43d0147eb0 2023-11-30T23:12:54.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f3b0e7fc700 1 -- 172.21.15.73:0/2546459917 learned_addr learned my addr 172.21.15.73:0/2546459917 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:54.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd064ecc700 1 -- 172.21.15.73:0/2274051087 shutdown_connections 2023-11-30T23:12:54.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd064ecc700 1 -- 172.21.15.73:0/2274051087 wait complete. 2023-11-30T23:12:54.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f3b0effd700 1 --2- 172.21.15.73:0/2546459917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b100b7b30 0x7f3b1014e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7eff0afff700 1 -- 172.21.15.73:0/1615461865 shutdown_connections 2023-11-30T23:12:54.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f3b159c0700 1 --2- 172.21.15.73:0/2546459917 >> v2:172.21.15.156:3300/0 conn(0x7f3b100b3a40 0x7f3b10155600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f3b159c0700 1 -- 172.21.15.73:0/2546459917 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b100b4580 con 0x7f3b1014e600 2023-11-30T23:12:54.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f3b159c0700 1 -- 172.21.15.73:0/2546459917 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b100b4860 con 0x7f3b100b3a40 2023-11-30T23:12:54.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f3b159c0700 1 -- 172.21.15.73:0/2546459917 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b100b7f10 con 0x7f3b100b7b30 2023-11-30T23:12:54.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f3b0f7fe700 1 --2- 172.21.15.73:0/2546459917 >> v2:172.21.15.156:3300/0 conn(0x7f3b100b3a40 0x7f3b10155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f3b0effd700 1 -- 172.21.15.73:0/2546459917 >> v2:172.21.15.156:3300/0 conn(0x7f3b100b3a40 msgr2=0x7f3b10155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:54.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f3b0effd700 1 --2- 172.21.15.73:0/2546459917 >> v2:172.21.15.156:3300/0 conn(0x7f3b100b3a40 0x7f3b10155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f3b0effd700 1 -- 172.21.15.73:0/2546459917 >> v1:172.21.15.73:6789/0 conn(0x7f3b1014e600 legacy=0x7f3b100b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:54.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f3b0effd700 1 -- 172.21.15.73:0/2546459917 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1014ea40 con 0x7f3b100b7b30 2023-11-30T23:12:54.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f3b0effd700 1 --2- 172.21.15.73:0/2546459917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b100b7b30 0x7f3b1014e0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009850 tx=0x7f3b00009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93488b57b2487069 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77bfff700 1 Processor -- start 2023-11-30T23:12:54.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd064ecc700 1 Processor -- start 2023-11-30T23:12:54.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77bfff700 1 -- start start 2023-11-30T23:12:54.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd064ecc700 1 -- start start 2023-11-30T23:12:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe77c0aefa0 0x7fe77c0ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe77c0b0600 0x7fe77c0a9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe77c0b09e0 0x7fe77c0a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77bfff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c0ad880 con 0x7fe77c0b09e0 2023-11-30T23:12:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77bfff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c0ab080 con 0x7fe77c0b0600 2023-11-30T23:12:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77bfff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c070260 con 0x7fe77c0aefa0 2023-11-30T23:12:54.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f664ffff700 1 -- 172.21.15.73:0/3889929253 wait complete. 2023-11-30T23:12:54.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe77c0b09e0 0x7fe77c0a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe77c0b09e0 0x7fe77c0a99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38294/0 (socket says 172.21.15.73:38294) 2023-11-30T23:12:54.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77b7fe700 1 -- 172.21.15.73:0/948595281 learned_addr learned my addr 172.21.15.73:0/948595281 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:54.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77a7fc700 1 --2- 172.21.15.73:0/948595281 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe77c0b0600 0x7fe77c0a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7eff0afff700 1 -- 172.21.15.73:0/1615461865 wait complete. 2023-11-30T23:12:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77b7fe700 1 -- 172.21.15.73:0/948595281 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe77c0aefa0 msgr2=0x7fe77c0ab4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-30T23:12:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77b7fe700 1 --2- 172.21.15.73:0/948595281 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe77c0aefa0 0x7fe77c0ab4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77b7fe700 1 -- 172.21.15.73:0/948595281 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe77c0b0600 msgr2=0x7fe77c0a9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77b7fe700 1 --2- 172.21.15.73:0/948595281 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe77c0b0600 0x7fe77c0a9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77b7fe700 1 -- 172.21.15.73:0/948595281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe770009570 con 0x7fe77c0b09e0 2023-11-30T23:12:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fe77b7fe700 1 --2- 172.21.15.73:0/948595281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe77c0b09e0 0x7fe77c0a99f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe770013000 tx=0x7fe770004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f43d7454700 1 -- 172.21.15.73:0/2005441815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d0147eb0 msgr2=0x7f43d013e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f43d7454700 1 --2- 172.21.15.73:0/2005441815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d0147eb0 0x7f43d013e210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f43d00b5540 tx=0x7f43c0009b60 comp rx=0 tx=0).stop 2023-11-30T23:12:54.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f664ffff700 1 Processor -- start 2023-11-30T23:12:54.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f664ffff700 1 -- start start 2023-11-30T23:12:54.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7eff0afff700 1 Processor -- start 2023-11-30T23:12:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd064ecc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0600b1420 0x7fd0600b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd064ecc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd060147eb0 0x7fd0601422e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd064ecc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd060142820 0x7fd060144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd064ecc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06013f5b0 con 0x7fd0600b1420 2023-11-30T23:12:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd064ecc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd060142ca0 con 0x7fd060142820 2023-11-30T23:12:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd064ecc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0601437a0 con 0x7fd060147eb0 2023-11-30T23:12:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd05f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0600b1420 0x7fd0600b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd05f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0600b1420 0x7fd0600b0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38296/0 (socket says 172.21.15.73:38296) 2023-11-30T23:12:54.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd05f7fe700 1 -- 172.21.15.73:0/1625277419 learned_addr learned my addr 172.21.15.73:0/1625277419 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:54.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd05effd700 1 --2- 172.21.15.73:0/1625277419 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd060147eb0 0x7fd0601422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd05ffff700 1 --2- 172.21.15.73:0/1625277419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd060142820 0x7fd060144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd05f7fe700 1 -- 172.21.15.73:0/1625277419 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd060147eb0 msgr2=0x7fd0601422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd05f7fe700 1 --2- 172.21.15.73:0/1625277419 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd060147eb0 0x7fd0601422e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd05f7fe700 1 -- 172.21.15.73:0/1625277419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd060142820 msgr2=0x7fd060144310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd05f7fe700 1 --2- 172.21.15.73:0/1625277419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd060142820 0x7fd060144310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd05f7fe700 1 -- 172.21.15.73:0/1625277419 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd058009b30 con 0x7fd0600b1420 2023-11-30T23:12:54.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7fd05f7fe700 1 --2- 172.21.15.73:0/1625277419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0600b1420 0x7fd0600b0160 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd05000d800 tx=0x7fd05000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f43d7454700 1 -- 172.21.15.73:0/2005441815 shutdown_connections 2023-11-30T23:12:54.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f43d7454700 1 --2- 172.21.15.73:0/2005441815 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43d013e750 0x7f43d00b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f43d7454700 1 --2- 172.21.15.73:0/2005441815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d0147eb0 0x7f43d013e210 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f43d00b5540 tx=0x7f43c0009b60 comp rx=0 tx=0).stop 2023-11-30T23:12:54.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f43d7454700 1 --2- 172.21.15.73:0/2005441815 >> v2:172.21.15.156:3300/0 conn(0x7f43d00b1420 0x7f43d0147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f43d7454700 1 -- 172.21.15.73:0/2005441815 >> 172.21.15.73:0/2005441815 conn(0x7f43d00b45a0 msgr2=0x7f43d00b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:54.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7eff0afff700 1 -- start start 2023-11-30T23:12:54.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.511+0000 7f43d7454700 1 -- 172.21.15.73:0/2005441815 shutdown_connections 2023-11-30T23:12:54.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7fe7637fe700 1 -- 172.21.15.73:0/948595281 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7700044d0 con 0x7fe77c0b09e0 2023-11-30T23:12:54.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7fe7637fe700 1 -- 172.21.15.73:0/948595281 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77001e070 con 0x7fe77c0b09e0 2023-11-30T23:12:54.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7fd047fff700 1 -- 172.21.15.73:0/1625277419 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0500125f0 con 0x7fd0600b1420 2023-11-30T23:12:54.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f3b0dffb700 1 -- 172.21.15.73:0/2546459917 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b00004230 con 0x7f3b100b7b30 2023-11-30T23:12:54.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f3b0dffb700 1 -- 172.21.15.73:0/2546459917 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b00004390 con 0x7f3b100b7b30 2023-11-30T23:12:54.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f3b0dffb700 1 -- 172.21.15.73:0/2546459917 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b000036c0 con 0x7f3b100b7b30 2023-11-30T23:12:54.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7fd047fff700 1 -- 172.21.15.73:0/1625277419 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd050012750 con 0x7fd0600b1420 2023-11-30T23:12:54.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7fd064ecc700 1 -- 172.21.15.73:0/1625277419 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd060143a80 con 0x7fd0600b1420 2023-11-30T23:12:54.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7fd064ecc700 1 -- 172.21.15.73:0/1625277419 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06013f820 con 0x7fd0600b1420 2023-11-30T23:12:54.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7fd047fff700 1 -- 172.21.15.73:0/1625277419 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050012ac0 con 0x7fd0600b1420 2023-11-30T23:12:54.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7fe7637fe700 1 -- 172.21.15.73:0/948595281 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7700038c0 con 0x7fe77c0b09e0 2023-11-30T23:12:54.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7fe77bfff700 1 -- 172.21.15.73:0/948595281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c070540 con 0x7fe77c0b09e0 2023-11-30T23:12:54.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d7454700 1 -- 172.21.15.73:0/2005441815 wait complete. 2023-11-30T23:12:54.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d7454700 1 Processor -- start 2023-11-30T23:12:54.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f3b159c0700 1 -- 172.21.15.73:0/2546459917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b100b7b30 msgr2=0x7f3b1014e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f3b159c0700 1 --2- 172.21.15.73:0/2546459917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b100b7b30 0x7f3b1014e0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009850 tx=0x7f3b00009b60 comp rx=0 tx=0).stop 2023-11-30T23:12:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f664ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66500b10f0 0x7f665015cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f664ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66500b15a0 0x7f66500a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f664ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66500b2fa0 0x7f66500a8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f664ffff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66500aa5c0 con 0x7f66500b10f0 2023-11-30T23:12:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f664ffff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665015fa60 con 0x7f66500b15a0 2023-11-30T23:12:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f664ffff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665015f620 con 0x7f66500b2fa0 2023-11-30T23:12:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f664effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66500b10f0 0x7f665015cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f664effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66500b10f0 0x7f665015cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38310/0 (socket says 172.21.15.73:38310) 2023-11-30T23:12:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f664effd700 1 -- 172.21.15.73:0/2710412035 learned_addr learned my addr 172.21.15.73:0/2710412035 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f664effd700 1 -- 172.21.15.73:0/2710412035 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66500b2fa0 msgr2=0x7f66500a8b10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-30T23:12:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f664effd700 1 --2- 172.21.15.73:0/2710412035 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66500b2fa0 0x7f66500a8b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f664effd700 1 -- 172.21.15.73:0/2710412035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66500b15a0 msgr2=0x7f66500a94f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T23:12:54.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f664effd700 1 --2- 172.21.15.73:0/2710412035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66500b15a0 0x7f66500a94f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f664effd700 1 -- 172.21.15.73:0/2710412035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6638009570 con 0x7f66500b10f0 2023-11-30T23:12:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f664effd700 1 --2- 172.21.15.73:0/2710412035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66500b10f0 0x7f665015cdd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6648007e70 tx=0x7f664800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7fe77bfff700 1 -- 172.21.15.73:0/948595281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c0708d0 con 0x7fe77c0b09e0 2023-11-30T23:12:54.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d7454700 1 -- start start 2023-11-30T23:12:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f66477fe700 1 -- 172.21.15.73:0/2710412035 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664800edf0 con 0x7f66500b10f0 2023-11-30T23:12:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f66477fe700 1 -- 172.21.15.73:0/2710412035 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6648014420 con 0x7f66500b10f0 2023-11-30T23:12:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f66477fe700 1 -- 172.21.15.73:0/2710412035 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66480147b0 con 0x7f66500b10f0 2023-11-30T23:12:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f664ffff700 1 -- 172.21.15.73:0/2710412035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665015e850 con 0x7f66500b10f0 2023-11-30T23:12:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f664ffff700 1 -- 172.21.15.73:0/2710412035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66500aa7c0 con 0x7f66500b10f0 2023-11-30T23:12:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f3b159c0700 1 -- 172.21.15.73:0/2546459917 shutdown_connections 2023-11-30T23:12:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f3b159c0700 1 --2- 172.21.15.73:0/2546459917 >> v2:172.21.15.156:3300/0 conn(0x7f3b100b3a40 0x7f3b10155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f3b159c0700 1 --2- 172.21.15.73:0/2546459917 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b100b7b30 0x7f3b1014e0c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f3b159c0700 1 -- 172.21.15.73:0/2546459917 >> 172.21.15.73:0/2546459917 conn(0x7f3b100b89b0 msgr2=0x7f3b100b8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d7454700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43d00b1420 0x7f43d012fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d7454700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d013e750 0x7f43d00b6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d7454700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43d00b6c40 0x7f43d00af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d7454700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00b70d0 con 0x7f43d013e750 2023-11-30T23:12:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d7454700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d0130720 con 0x7f43d00b1420 2023-11-30T23:12:54.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d7454700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00b5f90 con 0x7f43d00b6c40 2023-11-30T23:12:54.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7fe7637fe700 1 -- 172.21.15.73:0/948595281 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe770003a20 con 0x7fe77c0b09e0 2023-11-30T23:12:54.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d6452700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43d00b1420 0x7f43d012fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d6452700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43d00b1420 0x7f43d012fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59540/0 (socket says 172.21.15.73:59540) 2023-11-30T23:12:54.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d6452700 1 -- 172.21.15.73:0/451860627 learned_addr learned my addr 172.21.15.73:0/451860627 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:54.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d5c51700 1 --2- 172.21.15.73:0/451860627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d013e750 0x7f43d00b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7fe7637fe700 1 --2- 172.21.15.73:0/948595281 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fe768065b20 0x7fe768067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7eff0afff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff040b0cb0 0x7eff0413dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7fd047fff700 1 -- 172.21.15.73:0/1625277419 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd050012c20 con 0x7fd0600b1420 2023-11-30T23:12:54.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7fe7637fe700 1 -- 172.21.15.73:0/948595281 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe770083fb0 con 0x7fe77c0b09e0 2023-11-30T23:12:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7fe77affd700 1 --2- 172.21.15.73:0/948595281 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fe768065b20 0x7fe768067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d5c51700 1 -- 172.21.15.73:0/451860627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43d00b6c40 msgr2=0x7f43d00af2b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-30T23:12:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d5c51700 1 --2- 172.21.15.73:0/451860627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43d00b6c40 0x7f43d00af2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d5c51700 1 -- 172.21.15.73:0/451860627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43d00b1420 msgr2=0x7f43d012fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d5c51700 1 --2- 172.21.15.73:0/451860627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43d00b1420 0x7f43d012fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d5c51700 1 -- 172.21.15.73:0/451860627 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c00094b0 con 0x7f43d013e750 2023-11-30T23:12:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f3b159c0700 1 -- 172.21.15.73:0/2546459917 shutdown_connections 2023-11-30T23:12:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7f43d5c51700 1 --2- 172.21.15.73:0/451860627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d013e750 0x7f43d00b6700 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f43c0016000 tx=0x7f43c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.515+0000 7fd047fff700 1 --2- 172.21.15.73:0/1625277419 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd04c065b20 0x7fd04c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7fd047fff700 1 -- 172.21.15.73:0/1625277419 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0500831e0 con 0x7fd0600b1420 2023-11-30T23:12:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7fe77affd700 1 --2- 172.21.15.73:0/948595281 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fe768065b20 0x7fe768067fe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe77400e110 tx=0x7fe77400d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f43c6ffd700 1 -- 172.21.15.73:0/451860627 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0011830 con 0x7f43d013e750 2023-11-30T23:12:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b159c0700 1 -- 172.21.15.73:0/2546459917 wait complete. 2023-11-30T23:12:54.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7fd05effd700 1 --2- 172.21.15.73:0/1625277419 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd04c065b20 0x7fd04c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7eff0afff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff041447e0 0x7eff0413b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f43c6ffd700 1 -- 172.21.15.73:0/451860627 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c001f070 con 0x7f43d013e750 2023-11-30T23:12:54.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7eff0afff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff0414ae40 0x7eff0413ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7eff0afff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff041e0110 con 0x7eff040b0cb0 2023-11-30T23:12:54.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7eff0afff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0413e670 con 0x7eff041447e0 2023-11-30T23:12:54.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7eff0afff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0413e950 con 0x7eff0414ae40 2023-11-30T23:12:54.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7fd064ecc700 1 -- 172.21.15.73:0/1625277419 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd040005310 con 0x7fd0600b1420 2023-11-30T23:12:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7eff097fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff041447e0 0x7eff0413b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7eff097fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff041447e0 0x7eff0413b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59542/0 (socket says 172.21.15.73:59542) 2023-11-30T23:12:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7eff097fc700 1 -- 172.21.15.73:0/496906252 learned_addr learned my addr 172.21.15.73:0/496906252 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7eff09ffd700 1 --2- 172.21.15.73:0/496906252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff040b0cb0 0x7eff0413dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7eff0a7fe700 1 --2- 172.21.15.73:0/496906252 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff0414ae40 0x7eff0413ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7eff09ffd700 1 -- 172.21.15.73:0/496906252 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff0414ae40 msgr2=0x7eff0413ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7eff09ffd700 1 --2- 172.21.15.73:0/496906252 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff0414ae40 0x7eff0413ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7eff09ffd700 1 -- 172.21.15.73:0/496906252 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff041447e0 msgr2=0x7eff0413b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7eff09ffd700 1 --2- 172.21.15.73:0/496906252 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff041447e0 0x7eff0413b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7eff09ffd700 1 -- 172.21.15.73:0/496906252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff00009570 con 0x7eff040b0cb0 2023-11-30T23:12:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f43d7454700 1 -- 172.21.15.73:0/451860627 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d01423a0 con 0x7f43d013e750 2023-11-30T23:12:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f43c6ffd700 1 -- 172.21.15.73:0/451860627 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c001abf0 con 0x7f43d013e750 2023-11-30T23:12:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f43d7454700 1 -- 172.21.15.73:0/451860627 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d00b5b90 con 0x7f43d013e750 2023-11-30T23:12:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b159c0700 1 Processor -- start 2023-11-30T23:12:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7eff09ffd700 1 --2- 172.21.15.73:0/496906252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff040b0cb0 0x7eff0413dd90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efef400b3f0 tx=0x7efef400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7fe77bfff700 1 -- 172.21.15.73:0/948595281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77c04ed80 con 0x7fe77c0b09e0 2023-11-30T23:12:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f664ffff700 1 -- 172.21.15.73:0/2710412035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665004ed80 con 0x7f66500b10f0 2023-11-30T23:12:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f66477fe700 1 -- 172.21.15.73:0/2710412035 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6648014910 con 0x7f66500b10f0 2023-11-30T23:12:54.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b159c0700 1 -- start start 2023-11-30T23:12:54.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f66477fe700 1 --2- 172.21.15.73:0/2710412035 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6630065ba0 0x7f6630068060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f66477fe700 1 -- 172.21.15.73:0/2710412035 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6648083820 con 0x7f66500b10f0 2023-11-30T23:12:54.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f664e7fc700 1 --2- 172.21.15.73:0/2710412035 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6630065ba0 0x7f6630068060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b159c0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b100b3a40 0x7f3b1006f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b159c0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b100b7b30 0x7f3b101dfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b159c0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b1014e600 0x7f3b101e00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b159c0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1006f7d0 con 0x7f3b1014e600 2023-11-30T23:12:54.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b159c0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b10070250 con 0x7f3b100b3a40 2023-11-30T23:12:54.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b159c0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1006fd30 con 0x7f3b100b7b30 2023-11-30T23:12:54.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f778f59e700 1 Processor -- start 2023-11-30T23:12:54.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f778f59e700 1 -- start start 2023-11-30T23:12:54.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7fd05effd700 1 --2- 172.21.15.73:0/1625277419 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd04c065b20 0x7fd04c067fe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd058000f80 tx=0x7fd058009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f43d7454700 1 -- 172.21.15.73:0/451860627 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d006f580 con 0x7f43d013e750 2023-11-30T23:12:54.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b0f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b1014e600 0x7f3b101e00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b0f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b1014e600 0x7f3b101e00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38352/0 (socket says 172.21.15.73:38352) 2023-11-30T23:12:54.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b0f7fe700 1 -- 172.21.15.73:0/1519221722 learned_addr learned my addr 172.21.15.73:0/1519221722 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b0effd700 1 --2- 172.21.15.73:0/1519221722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b100b3a40 0x7f3b1006f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f664e7fc700 1 --2- 172.21.15.73:0/2710412035 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6630065ba0 0x7f6630068060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f66500b8050 tx=0x7f66400078f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b0f7fe700 1 -- 172.21.15.73:0/1519221722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b100b7b30 msgr2=0x7f3b101dfb80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-30T23:12:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b0f7fe700 1 --2- 172.21.15.73:0/1519221722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b100b7b30 0x7f3b101dfb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b0f7fe700 1 -- 172.21.15.73:0/1519221722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b100b3a40 msgr2=0x7f3b1006f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b0f7fe700 1 --2- 172.21.15.73:0/1519221722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b100b3a40 0x7f3b1006f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b0f7fe700 1 -- 172.21.15.73:0/1519221722 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000094b0 con 0x7f3b1014e600 2023-11-30T23:12:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b0effd700 1 --2- 172.21.15.73:0/1519221722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b100b3a40 0x7f3b1006f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:12:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f3b0f7fe700 1 --2- 172.21.15.73:0/1519221722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b1014e600 0x7f3b101e00c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800efc0 tx=0x7f3b0800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f778f59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77900b09e0 0x7f7790151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f778f59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77900af4c0 con 0x7f77900aefa0 2023-11-30T23:12:54.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f778f59e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77900ae680 con 0x7f77900b0600 2023-11-30T23:12:54.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f778f59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77900aea60 con 0x7f77900b09e0 2023-11-30T23:12:54.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f778dd9b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f77900aefa0 0x7f7790146630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38208/0 (socket says 172.21.15.73:38208) 2023-11-30T23:12:54.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f778dd9b700 1 -- 172.21.15.73:0/1331453387 learned_addr learned my addr 172.21.15.73:0/1331453387 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:54.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f778ed9d700 1 --2- 172.21.15.73:0/1331453387 >> v2:172.21.15.73:3300/0 conn(0x7f77900b09e0 0x7f7790151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f778ed9d700 1 -- 172.21.15.73:0/1331453387 >> v1:172.21.15.156:6789/0 conn(0x7f77900b0600 legacy=0x7f77900ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f778ed9d700 1 -- 172.21.15.73:0/1331453387 >> v1:172.21.15.73:6789/0 conn(0x7f77900aefa0 legacy=0x7f7790146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.519+0000 7f778ed9d700 1 -- 172.21.15.73:0/1331453387 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77900b4350 con 0x7f77900b09e0 2023-11-30T23:12:54.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.523+0000 7f778ed9d700 1 --2- 172.21.15.73:0/1331453387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77900b09e0 0x7f7790151ee0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7780009850 tx=0x7f7780009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d2f925c27cefb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.527+0000 7fd047fff700 1 -- 172.21.15.73:0/1625277419 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fd050050c10 con 0x7fd0600b1420 2023-11-30T23:12:54.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.527+0000 7efefa7fc700 1 -- 172.21.15.73:0/496906252 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef4011630 con 0x7eff040b0cb0 2023-11-30T23:12:54.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.527+0000 7f778d59a700 1 -- 172.21.15.73:0/1331453387 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780011830 con 0x7f77900b09e0 2023-11-30T23:12:54.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.527+0000 7eff0afff700 1 -- 172.21.15.73:0/496906252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0413c170 con 0x7eff040b0cb0 2023-11-30T23:12:54.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.527+0000 7eff0afff700 1 -- 172.21.15.73:0/496906252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0413ef60 con 0x7eff040b0cb0 2023-11-30T23:12:54.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.527+0000 7f3af7fff700 1 -- 172.21.15.73:0/1519221722 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0800cd40 con 0x7f3b1014e600 2023-11-30T23:12:54.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.527+0000 7f3b159c0700 1 -- 172.21.15.73:0/1519221722 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b10070450 con 0x7f3b1014e600 2023-11-30T23:12:54.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.527+0000 7f3b159c0700 1 -- 172.21.15.73:0/1519221722 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b10071c40 con 0x7f3b1014e600 2023-11-30T23:12:54.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.527+0000 7f43c6ffd700 1 -- 172.21.15.73:0/451860627 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f43c001ad50 con 0x7f43d013e750 2023-11-30T23:12:54.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.527+0000 7f43c6ffd700 1 --2- 172.21.15.73:0/451860627 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f43b4065ad0 0x7f43b4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.527+0000 7f43d6452700 1 --2- 172.21.15.73:0/451860627 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f43b4065ad0 0x7f43b4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.527+0000 7f3b159c0700 1 -- 172.21.15.73:0/1519221722 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1014c5f0 con 0x7f3b1014e600 2023-11-30T23:12:54.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.527+0000 7eff0afff700 1 -- 172.21.15.73:0/496906252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff040af050 con 0x7eff040b0cb0 2023-11-30T23:12:54.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.527+0000 7f43d6452700 1 --2- 172.21.15.73:0/451860627 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f43b4065ad0 0x7f43b4067f90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f43c8003c70 tx=0x7f43c8009970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.535+0000 7fe7637fe700 1 -- 172.21.15.73:0/948595281 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fe770051ba0 con 0x7fe77c0b09e0 2023-11-30T23:12:54.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.543+0000 7f43c6ffd700 1 -- 172.21.15.73:0/451860627 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43c0006ce0 con 0x7f43d013e750 2023-11-30T23:12:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.543+0000 7f3af7fff700 1 -- 172.21.15.73:0/1519221722 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0800f040 con 0x7f3b1014e600 2023-11-30T23:12:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.543+0000 7f3af7fff700 1 -- 172.21.15.73:0/1519221722 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08014680 con 0x7f3b1014e600 2023-11-30T23:12:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.543+0000 7f778d59a700 1 -- 172.21.15.73:0/1331453387 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7780011990 con 0x7f77900b09e0 2023-11-30T23:12:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.543+0000 7f778d59a700 1 -- 172.21.15.73:0/1331453387 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780011d20 con 0x7f77900b09e0 2023-11-30T23:12:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.543+0000 7f778f59e700 1 -- 172.21.15.73:0/1331453387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77900b09e0 msgr2=0x7f7790151ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.543+0000 7f778f59e700 1 --2- 172.21.15.73:0/1331453387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77900b09e0 0x7f7790151ee0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7780009850 tx=0x7f7780009b60 comp rx=0 tx=0).stop 2023-11-30T23:12:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.543+0000 7f66477fe700 1 -- 172.21.15.73:0/2710412035 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f6648051250 con 0x7f66500b10f0 2023-11-30T23:12:54.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.543+0000 7efefa7fc700 1 -- 172.21.15.73:0/496906252 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef4009200 con 0x7eff040b0cb0 2023-11-30T23:12:54.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.543+0000 7efefa7fc700 1 -- 172.21.15.73:0/496906252 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef40119b0 con 0x7eff040b0cb0 2023-11-30T23:12:54.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.543+0000 7f778f59e700 1 -- 172.21.15.73:0/1331453387 shutdown_connections 2023-11-30T23:12:54.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.543+0000 7f778f59e700 1 --2- 172.21.15.73:0/1331453387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77900b09e0 0x7f7790151ee0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.543+0000 7f778f59e700 1 -- 172.21.15.73:0/1331453387 >> 172.21.15.73:0/1331453387 conn(0x7f779006ab90 msgr2=0x7f77900b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:54.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.543+0000 7f778f59e700 1 -- 172.21.15.73:0/1331453387 shutdown_connections 2023-11-30T23:12:54.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.543+0000 7f778f59e700 1 -- 172.21.15.73:0/1331453387 wait complete. 2023-11-30T23:12:54.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778f59e700 1 Processor -- start 2023-11-30T23:12:54.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778f59e700 1 -- start start 2023-11-30T23:12:54.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778f59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77900aefa0 0x7f7790148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778f59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77900b0600 0x7f77901db8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778f59e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77900b09e0 0x7f77901dbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778f59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7790147820 con 0x7f77900b0600 2023-11-30T23:12:54.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778f59e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77901491e0 con 0x7f77900aefa0 2023-11-30T23:12:54.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778f59e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7790149430 con 0x7f77900b09e0 2023-11-30T23:12:54.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77900b0600 0x7f77901db8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77900b0600 0x7f77901db8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38372/0 (socket says 172.21.15.73:38372) 2023-11-30T23:12:54.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778dd9b700 1 -- 172.21.15.73:0/3589208323 learned_addr learned my addr 172.21.15.73:0/3589208323 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:54.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778e59c700 1 --2- 172.21.15.73:0/3589208323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77900aefa0 0x7f7790148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778ed9d700 1 --2- 172.21.15.73:0/3589208323 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77900b09e0 0x7f77901dbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778dd9b700 1 -- 172.21.15.73:0/3589208323 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77900b09e0 msgr2=0x7f77901dbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778dd9b700 1 --2- 172.21.15.73:0/3589208323 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77900b09e0 0x7f77901dbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778dd9b700 1 -- 172.21.15.73:0/3589208323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77900aefa0 msgr2=0x7f7790148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778dd9b700 1 --2- 172.21.15.73:0/3589208323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77900aefa0 0x7f7790148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778dd9b700 1 -- 172.21.15.73:0/3589208323 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77800094b0 con 0x7f77900b0600 2023-11-30T23:12:54.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.547+0000 7f778dd9b700 1 --2- 172.21.15.73:0/3589208323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77900b0600 0x7f77901db8c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f778800cbf0 tx=0x7f778800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.551+0000 7f43c6ffd700 1 -- 172.21.15.73:0/451860627 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f43c0051d00 con 0x7f43d013e750 2023-11-30T23:12:54.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.551+0000 7efefa7fc700 1 -- 172.21.15.73:0/496906252 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efef4011b10 con 0x7eff040b0cb0 2023-11-30T23:12:54.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.551+0000 7efefa7fc700 1 --2- 172.21.15.73:0/496906252 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7efee8065ad0 0x7efee8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.551+0000 7efefa7fc700 1 -- 172.21.15.73:0/496906252 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efef4083460 con 0x7eff040b0cb0 2023-11-30T23:12:54.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.551+0000 7f3af7fff700 1 -- 172.21.15.73:0/1519221722 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3b080147e0 con 0x7f3b1014e600 2023-11-30T23:12:54.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.551+0000 7f3af7fff700 1 --2- 172.21.15.73:0/1519221722 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3afc065ad0 0x7f3afc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.551+0000 7f3af7fff700 1 -- 172.21.15.73:0/1519221722 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b08084550 con 0x7f3b1014e600 2023-11-30T23:12:54.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.559+0000 7eff097fc700 1 --2- 172.21.15.73:0/496906252 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7efee8065ad0 0x7efee8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.559+0000 7f3b0effd700 1 --2- 172.21.15.73:0/1519221722 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3afc065ad0 0x7f3afc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.559+0000 7f777effd700 1 -- 172.21.15.73:0/3589208323 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788007480 con 0x7f77900b0600 2023-11-30T23:12:54.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.559+0000 7eff097fc700 1 --2- 172.21.15.73:0/496906252 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7efee8065ad0 0x7efee8067f90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff0414e650 tx=0x7eff00008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.559+0000 7f778f59e700 1 -- 172.21.15.73:0/3589208323 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77900ae240 con 0x7f77900b0600 2023-11-30T23:12:54.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.559+0000 7f778f59e700 1 -- 172.21.15.73:0/3589208323 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77901496d0 con 0x7f77900b0600 2023-11-30T23:12:54.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.559+0000 7f3b0effd700 1 --2- 172.21.15.73:0/1519221722 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3afc065ad0 0x7f3afc067f90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009850 tx=0x7f3b0001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.559+0000 7f777effd700 1 -- 172.21.15.73:0/3589208323 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77880075e0 con 0x7f77900b0600 2023-11-30T23:12:54.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.559+0000 7f777effd700 1 -- 172.21.15.73:0/3589208323 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788007950 con 0x7f77900b0600 2023-11-30T23:12:54.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.559+0000 7f778f59e700 1 -- 172.21.15.73:0/3589208323 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7774005310 con 0x7f77900b0600 2023-11-30T23:12:54.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.559+0000 7efefa7fc700 1 -- 172.21.15.73:0/496906252 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7efef4050eb0 con 0x7eff040b0cb0 2023-11-30T23:12:54.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.567+0000 7f3af7fff700 1 -- 172.21.15.73:0/1519221722 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f3b08051f80 con 0x7f3b1014e600 2023-11-30T23:12:54.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.571+0000 7f777effd700 1 -- 172.21.15.73:0/3589208323 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f778801b3b0 con 0x7f77900b0600 2023-11-30T23:12:54.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.571+0000 7f777effd700 1 --2- 172.21.15.73:0/3589208323 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7770065ba0 0x7f7770068060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:54.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.571+0000 7f777effd700 1 -- 172.21.15.73:0/3589208323 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7788082e20 con 0x7f77900b0600 2023-11-30T23:12:54.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.571+0000 7f778e59c700 1 --2- 172.21.15.73:0/3589208323 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7770065ba0 0x7f7770068060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:54.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.571+0000 7f778e59c700 1 --2- 172.21.15.73:0/3589208323 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7770065ba0 0x7f7770068060 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f77840018a0 tx=0x7f7784009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:54.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.575+0000 7f777effd700 1 -- 172.21.15.73:0/3589208323 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f7788050900 con 0x7f77900b0600 2023-11-30T23:12:54.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.787+0000 7f8e9ea34700 1 -- 172.21.15.73:0/223714970 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e840055c0 con 0x7f8e980b1260 2023-11-30T23:12:54.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.787+0000 7f8e94ff9700 1 -- 172.21.15.73:0/223714970 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8e90018070 con 0x7f8e980b1260 2023-11-30T23:12:54.793 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-11-30T23:12:54.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.791+0000 7f8e7e7fc700 1 -- 172.21.15.73:0/223714970 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8e80065e00 msgr2=0x7f8e800682c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.791+0000 7f8e7e7fc700 1 --2- 172.21.15.73:0/223714970 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8e80065e00 0x7f8e800682c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c003910 tx=0x7f8e8c008040 comp rx=0 tx=0).stop 2023-11-30T23:12:54.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.791+0000 7f8e7e7fc700 1 -- 172.21.15.73:0/223714970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e980b1260 msgr2=0x7f8e9813d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.791+0000 7f8e7e7fc700 1 --2- 172.21.15.73:0/223714970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e980b1260 0x7f8e9813d850 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000cc20 tx=0x7f8e9000a060 comp rx=0 tx=0).stop 2023-11-30T23:12:54.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.791+0000 7f8e7e7fc700 1 -- 172.21.15.73:0/223714970 shutdown_connections 2023-11-30T23:12:54.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.791+0000 7f8e7e7fc700 1 --2- 172.21.15.73:0/223714970 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8e80065e00 0x7f8e800682c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.791+0000 7f8e7e7fc700 1 --2- 172.21.15.73:0/223714970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e981e8280 0x7f8e9813e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.791+0000 7f8e7e7fc700 1 --2- 172.21.15.73:0/223714970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e980b1260 0x7f8e9813d850 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.791+0000 7f8e7e7fc700 1 --2- 172.21.15.73:0/223714970 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f8e980b0e80 0x7f8e980713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.791+0000 7f8e7e7fc700 1 -- 172.21.15.73:0/223714970 >> 172.21.15.73:0/223714970 conn(0x7f8e9806ab90 msgr2=0x7f8e980acc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:54.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.791+0000 7f8e7e7fc700 1 -- 172.21.15.73:0/223714970 shutdown_connections 2023-11-30T23:12:54.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.791+0000 7f8e7e7fc700 1 -- 172.21.15.73:0/223714970 wait complete. 2023-11-30T23:12:54.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-11-30T23:12:54.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.815+0000 7fd064ecc700 1 -- 172.21.15.73:0/1625277419 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd0400055c0 con 0x7fd0600b1420 2023-11-30T23:12:54.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.815+0000 7fd047fff700 1 -- 172.21.15.73:0/1625277419 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd050054230 con 0x7fd0600b1420 2023-11-30T23:12:54.819 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2023-11-30T23:12:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.819+0000 7fd064ecc700 1 -- 172.21.15.73:0/1625277419 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd04c065b20 msgr2=0x7fd04c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.819+0000 7fd064ecc700 1 --2- 172.21.15.73:0/1625277419 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd04c065b20 0x7fd04c067fe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd058000f80 tx=0x7fd058009000 comp rx=0 tx=0).stop 2023-11-30T23:12:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.819+0000 7fd064ecc700 1 -- 172.21.15.73:0/1625277419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0600b1420 msgr2=0x7fd0600b0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.819+0000 7fd064ecc700 1 --2- 172.21.15.73:0/1625277419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0600b1420 0x7fd0600b0160 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd05000d800 tx=0x7fd05000db10 comp rx=0 tx=0).stop 2023-11-30T23:12:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.819+0000 7fd064ecc700 1 -- 172.21.15.73:0/1625277419 shutdown_connections 2023-11-30T23:12:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.819+0000 7fd064ecc700 1 --2- 172.21.15.73:0/1625277419 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd04c065b20 0x7fd04c067fe0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.819+0000 7fd064ecc700 1 --2- 172.21.15.73:0/1625277419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd060142820 0x7fd060144310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.819+0000 7fd064ecc700 1 --2- 172.21.15.73:0/1625277419 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd060147eb0 0x7fd0601422e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.819+0000 7fd064ecc700 1 --2- 172.21.15.73:0/1625277419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0600b1420 0x7fd0600b0160 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.819+0000 7fd064ecc700 1 -- 172.21.15.73:0/1625277419 >> 172.21.15.73:0/1625277419 conn(0x7fd06006ab90 msgr2=0x7fd06013be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.819+0000 7fd064ecc700 1 -- 172.21.15.73:0/1625277419 shutdown_connections 2023-11-30T23:12:54.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.819+0000 7fd064ecc700 1 -- 172.21.15.73:0/1625277419 wait complete. 2023-11-30T23:12:54.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-11-30T23:12:54.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.839+0000 7fe77bfff700 1 -- 172.21.15.73:0/948595281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe77c0b3910 con 0x7fe77c0b09e0 2023-11-30T23:12:54.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.839+0000 7fe7637fe700 1 -- 172.21.15.73:0/948595281 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe770020030 con 0x7fe77c0b09e0 2023-11-30T23:12:54.843 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2023-11-30T23:12:54.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.843+0000 7fe77bfff700 1 -- 172.21.15.73:0/948595281 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fe768065b20 msgr2=0x7fe768067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.843+0000 7fe77bfff700 1 --2- 172.21.15.73:0/948595281 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fe768065b20 0x7fe768067fe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe77400e110 tx=0x7fe77400d040 comp rx=0 tx=0).stop 2023-11-30T23:12:54.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.843+0000 7fe77bfff700 1 -- 172.21.15.73:0/948595281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe77c0b09e0 msgr2=0x7fe77c0a99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.843+0000 7fe77bfff700 1 --2- 172.21.15.73:0/948595281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe77c0b09e0 0x7fe77c0a99f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe770013000 tx=0x7fe770004770 comp rx=0 tx=0).stop 2023-11-30T23:12:54.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.843+0000 7fe77bfff700 1 -- 172.21.15.73:0/948595281 shutdown_connections 2023-11-30T23:12:54.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.843+0000 7fe77bfff700 1 --2- 172.21.15.73:0/948595281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe77c0b09e0 0x7fe77c0a99f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.843+0000 7fe77bfff700 1 --2- 172.21.15.73:0/948595281 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fe768065b20 0x7fe768067fe0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.843+0000 7fe77bfff700 1 --2- 172.21.15.73:0/948595281 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe77c0b0600 0x7fe77c0a9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.843+0000 7fe77bfff700 1 --2- 172.21.15.73:0/948595281 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe77c0aefa0 0x7fe77c0ab4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.843+0000 7fe77bfff700 1 -- 172.21.15.73:0/948595281 >> 172.21.15.73:0/948595281 conn(0x7fe77c06ab90 msgr2=0x7fe77c13fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:54.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.843+0000 7fe77bfff700 1 -- 172.21.15.73:0/948595281 shutdown_connections 2023-11-30T23:12:54.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.843+0000 7fe77bfff700 1 -- 172.21.15.73:0/948595281 wait complete. 2023-11-30T23:12:54.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.847+0000 7f664ffff700 1 -- 172.21.15.73:0/2710412035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f66500b5b10 con 0x7f66500b10f0 2023-11-30T23:12:54.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.847+0000 7f66477fe700 1 -- 172.21.15.73:0/2710412035 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6648054870 con 0x7f66500b10f0 2023-11-30T23:12:54.852 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-11-30T23:12:54.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.847+0000 7f778f59e700 1 -- 172.21.15.73:0/3589208323 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7774005890 con 0x7f77900b0600 2023-11-30T23:12:54.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.847+0000 7f777effd700 1 -- 172.21.15.73:0/3589208323 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7788053f20 con 0x7f77900b0600 2023-11-30T23:12:54.853 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-11-30T23:12:54.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f664ffff700 1 -- 172.21.15.73:0/2710412035 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6630065ba0 msgr2=0x7f6630068060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f664ffff700 1 --2- 172.21.15.73:0/2710412035 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6630065ba0 0x7f6630068060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f66500b8050 tx=0x7f66400078f0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f664ffff700 1 -- 172.21.15.73:0/2710412035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66500b10f0 msgr2=0x7f665015cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f664ffff700 1 --2- 172.21.15.73:0/2710412035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66500b10f0 0x7f665015cdd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6648007e70 tx=0x7f664800e3c0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f664ffff700 1 -- 172.21.15.73:0/2710412035 shutdown_connections 2023-11-30T23:12:54.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f664ffff700 1 --2- 172.21.15.73:0/2710412035 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f66500b2fa0 0x7f66500a8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f664ffff700 1 --2- 172.21.15.73:0/2710412035 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6630065ba0 0x7f6630068060 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f664ffff700 1 --2- 172.21.15.73:0/2710412035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66500b15a0 0x7f66500a94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f664ffff700 1 --2- 172.21.15.73:0/2710412035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66500b10f0 0x7f665015cdd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f664ffff700 1 -- 172.21.15.73:0/2710412035 >> 172.21.15.73:0/2710412035 conn(0x7f665006ab90 msgr2=0x7f66500704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:54.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f664ffff700 1 -- 172.21.15.73:0/2710412035 shutdown_connections 2023-11-30T23:12:54.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f664ffff700 1 -- 172.21.15.73:0/2710412035 wait complete. 2023-11-30T23:12:54.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f778f59e700 1 -- 172.21.15.73:0/3589208323 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7770065ba0 msgr2=0x7f7770068060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f778f59e700 1 --2- 172.21.15.73:0/3589208323 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7770065ba0 0x7f7770068060 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f77840018a0 tx=0x7f7784009040 comp rx=0 tx=0).stop 2023-11-30T23:12:54.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f778f59e700 1 -- 172.21.15.73:0/3589208323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77900b0600 msgr2=0x7f77901db8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f778f59e700 1 --2- 172.21.15.73:0/3589208323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77900b0600 0x7f77901db8c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f778800cbf0 tx=0x7f778800cc20 comp rx=0 tx=0).stop 2023-11-30T23:12:54.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f778f59e700 1 -- 172.21.15.73:0/3589208323 shutdown_connections 2023-11-30T23:12:54.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f778f59e700 1 --2- 172.21.15.73:0/3589208323 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77900b09e0 0x7f77901dbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f778f59e700 1 --2- 172.21.15.73:0/3589208323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77900b0600 0x7f77901db8c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f778f59e700 1 --2- 172.21.15.73:0/3589208323 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7770065ba0 0x7f7770068060 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f778f59e700 1 --2- 172.21.15.73:0/3589208323 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77900aefa0 0x7f7790148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f778f59e700 1 -- 172.21.15.73:0/3589208323 >> 172.21.15.73:0/3589208323 conn(0x7f779006ab90 msgr2=0x7f77900b5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:54.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f778f59e700 1 -- 172.21.15.73:0/3589208323 shutdown_connections 2023-11-30T23:12:54.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.851+0000 7f778f59e700 1 -- 172.21.15.73:0/3589208323 wait complete. 2023-11-30T23:12:54.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.855+0000 7f3b159c0700 1 -- 172.21.15.73:0/1519221722 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3b1004ed80 con 0x7f3b1014e600 2023-11-30T23:12:54.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.855+0000 7f43d7454700 1 -- 172.21.15.73:0/451860627 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f43d0130890 con 0x7f43d013e750 2023-11-30T23:12:54.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.855+0000 7f43c6ffd700 1 -- 172.21.15.73:0/451860627 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f43c0015090 con 0x7f43d013e750 2023-11-30T23:12:54.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-11-30T23:12:54.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.855+0000 7f3af7fff700 1 -- 172.21.15.73:0/1519221722 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b08018090 con 0x7f3b1014e600 2023-11-30T23:12:54.861 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-11-30T23:12:54.862 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-11-30T23:12:54.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f43d7454700 1 -- 172.21.15.73:0/451860627 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f43b4065ad0 msgr2=0x7f43b4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f43d7454700 1 --2- 172.21.15.73:0/451860627 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f43b4065ad0 0x7f43b4067f90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f43c8003c70 tx=0x7f43c8009970 comp rx=0 tx=0).stop 2023-11-30T23:12:54.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f43d7454700 1 -- 172.21.15.73:0/451860627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d013e750 msgr2=0x7f43d00b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f43d7454700 1 --2- 172.21.15.73:0/451860627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d013e750 0x7f43d00b6700 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f43c0016000 tx=0x7f43c0004770 comp rx=0 tx=0).stop 2023-11-30T23:12:54.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f43d7454700 1 -- 172.21.15.73:0/451860627 shutdown_connections 2023-11-30T23:12:54.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f43d7454700 1 --2- 172.21.15.73:0/451860627 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f43d00b6c40 0x7f43d00af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f43d7454700 1 --2- 172.21.15.73:0/451860627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43d013e750 0x7f43d00b6700 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f43d7454700 1 --2- 172.21.15.73:0/451860627 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f43b4065ad0 0x7f43b4067f90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f43d7454700 1 --2- 172.21.15.73:0/451860627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43d00b1420 0x7f43d012fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f43d7454700 1 -- 172.21.15.73:0/451860627 >> 172.21.15.73:0/451860627 conn(0x7f43d00b45a0 msgr2=0x7f43d00b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:54.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f43d7454700 1 -- 172.21.15.73:0/451860627 shutdown_connections 2023-11-30T23:12:54.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f3b159c0700 1 -- 172.21.15.73:0/1519221722 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3afc065ad0 msgr2=0x7f3afc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f3b159c0700 1 --2- 172.21.15.73:0/1519221722 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3afc065ad0 0x7f3afc067f90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009850 tx=0x7f3b0001c040 comp rx=0 tx=0).stop 2023-11-30T23:12:54.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f3b159c0700 1 -- 172.21.15.73:0/1519221722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b1014e600 msgr2=0x7f3b101e00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f43d7454700 1 -- 172.21.15.73:0/451860627 wait complete. 2023-11-30T23:12:54.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f3b159c0700 1 --2- 172.21.15.73:0/1519221722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b1014e600 0x7f3b101e00c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800efc0 tx=0x7f3b0800c3a0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f3b159c0700 1 -- 172.21.15.73:0/1519221722 shutdown_connections 2023-11-30T23:12:54.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f3b159c0700 1 --2- 172.21.15.73:0/1519221722 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b1014e600 0x7f3b101e00c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f3b159c0700 1 --2- 172.21.15.73:0/1519221722 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3b100b7b30 0x7f3b101dfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f3b159c0700 1 --2- 172.21.15.73:0/1519221722 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3afc065ad0 0x7f3afc067f90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f3b159c0700 1 --2- 172.21.15.73:0/1519221722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b100b3a40 0x7f3b1006f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f3b159c0700 1 -- 172.21.15.73:0/1519221722 >> 172.21.15.73:0/1519221722 conn(0x7f3b100b89b0 msgr2=0x7f3b10143e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:54.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f3b159c0700 1 -- 172.21.15.73:0/1519221722 shutdown_connections 2023-11-30T23:12:54.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.859+0000 7f3b159c0700 1 -- 172.21.15.73:0/1519221722 wait complete. 2023-11-30T23:12:54.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.863+0000 7eff0afff700 1 -- 172.21.15.73:0/496906252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7eff040b2190 con 0x7eff040b0cb0 2023-11-30T23:12:54.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.863+0000 7efefa7fc700 1 -- 172.21.15.73:0/496906252 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efef40544d0 con 0x7eff040b0cb0 2023-11-30T23:12:54.869 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2023-11-30T23:12:54.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.867+0000 7eff0afff700 1 -- 172.21.15.73:0/496906252 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7efee8065ad0 msgr2=0x7efee8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.867+0000 7eff0afff700 1 --2- 172.21.15.73:0/496906252 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7efee8065ad0 0x7efee8067f90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff0414e650 tx=0x7eff00008030 comp rx=0 tx=0).stop 2023-11-30T23:12:54.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.867+0000 7eff0afff700 1 -- 172.21.15.73:0/496906252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff040b0cb0 msgr2=0x7eff0413dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:54.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.867+0000 7eff0afff700 1 --2- 172.21.15.73:0/496906252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff040b0cb0 0x7eff0413dd90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efef400b3f0 tx=0x7efef400b700 comp rx=0 tx=0).stop 2023-11-30T23:12:54.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.867+0000 7eff0afff700 1 -- 172.21.15.73:0/496906252 shutdown_connections 2023-11-30T23:12:54.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.867+0000 7eff0afff700 1 --2- 172.21.15.73:0/496906252 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff0414ae40 0x7eff0413ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.867+0000 7eff0afff700 1 --2- 172.21.15.73:0/496906252 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7efee8065ad0 0x7efee8067f90 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff0414e650 tx=0x7eff00008030 comp rx=0 tx=0).stop 2023-11-30T23:12:54.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.867+0000 7eff0afff700 1 --2- 172.21.15.73:0/496906252 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff041447e0 0x7eff0413b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.867+0000 7eff0afff700 1 --2- 172.21.15.73:0/496906252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff040b0cb0 0x7eff0413dd90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:54.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.867+0000 7eff0afff700 1 -- 172.21.15.73:0/496906252 >> 172.21.15.73:0/496906252 conn(0x7eff0406ab90 msgr2=0x7eff040b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:54.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-11-30T23:12:54.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.867+0000 7eff0afff700 1 -- 172.21.15.73:0/496906252 shutdown_connections 2023-11-30T23:12:54.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-11-30T23:12:54.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:54.867+0000 7eff0afff700 1 -- 172.21.15.73:0/496906252 wait complete. 2023-11-30T23:12:54.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-11-30T23:12:54.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-11-30T23:12:54.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-11-30T23:12:55.816 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-30T23:12:55.837 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-30T23:12:55.861 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-30T23:12:55.873 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-30T23:12:55.874 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-30T23:12:55.876 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-30T23:12:55.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-30T23:12:55.882 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-30T23:12:55.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.951+0000 7f30a6782700 1 Processor -- start 2023-11-30T23:12:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.951+0000 7f30a6782700 1 -- start start 2023-11-30T23:12:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.951+0000 7f30a6782700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f30a00b0e80 0x7f30a0142b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.951+0000 7f30a6782700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f30a00b1260 0x7f30a0071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.951+0000 7f30a6782700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a0072440 0x7f30a00afab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.951+0000 7f30a6782700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a00af660 con 0x7f30a00b1260 2023-11-30T23:12:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.951+0000 7f30a6782700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a006e280 con 0x7f30a00b0e80 2023-11-30T23:12:55.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.951+0000 7f30a6782700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a01430f0 con 0x7f30a0072440 2023-11-30T23:12:55.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.951+0000 7f309f7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f30a00b1260 0x7f30a0071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:55.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.951+0000 7f30a4d1f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a0072440 0x7f30a00afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:55.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f30a4d1f700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a0072440 0x7f30a00afab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:43204/0 (socket says 172.21.15.73:43204) 2023-11-30T23:12:55.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f30a4d1f700 1 -- 172.21.15.73:0/3360848699 learned_addr learned my addr 172.21.15.73:0/3360848699 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:55.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f309ffff700 1 --2- 172.21.15.73:0/3360848699 >> v2:172.21.15.156:3300/0 conn(0x7f30a00b0e80 0x7f30a0142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:55.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f309ffff700 1 -- 172.21.15.73:0/3360848699 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a0072440 msgr2=0x7f30a00afab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:55.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f309ffff700 1 --2- 172.21.15.73:0/3360848699 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a0072440 0x7f30a00afab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:55.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f309ffff700 1 -- 172.21.15.73:0/3360848699 >> v2:172.21.15.73:3300/0 conn(0x7f30a00b1260 msgr2=0x7f30a0071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:55.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f309ffff700 1 --2- 172.21.15.73:0/3360848699 >> v2:172.21.15.73:3300/0 conn(0x7f30a00b1260 0x7f30a0071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:55.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f309ffff700 1 -- 172.21.15.73:0/3360848699 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a01433d0 con 0x7f30a00b0e80 2023-11-30T23:12:55.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f309ffff700 1 --2- 172.21.15.73:0/3360848699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a00b0e80 0x7f30a0142b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f30a00b3e20 tx=0x7f3090009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e56b6b3548ecd9c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:55.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f309effd700 1 -- 172.21.15.73:0/3360848699 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090010830 con 0x7f30a00b0e80 2023-11-30T23:12:55.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f309effd700 1 -- 172.21.15.73:0/3360848699 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3090010990 con 0x7f30a00b0e80 2023-11-30T23:12:55.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f30a6782700 1 -- 172.21.15.73:0/3360848699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a00b0e80 msgr2=0x7f30a0142b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:55.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f30a6782700 1 --2- 172.21.15.73:0/3360848699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a00b0e80 0x7f30a0142b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f30a00b3e20 tx=0x7f3090009b30 comp rx=0 tx=0).stop 2023-11-30T23:12:55.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f30a6782700 1 -- 172.21.15.73:0/3360848699 shutdown_connections 2023-11-30T23:12:55.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f30a6782700 1 --2- 172.21.15.73:0/3360848699 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a0072440 0x7f30a00afab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:55.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f30a6782700 1 --2- 172.21.15.73:0/3360848699 >> v2:172.21.15.73:3300/0 conn(0x7f30a00b1260 0x7f30a0071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:55.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f30a6782700 1 --2- 172.21.15.73:0/3360848699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a00b0e80 0x7f30a0142b10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:55.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f30a6782700 1 -- 172.21.15.73:0/3360848699 >> 172.21.15.73:0/3360848699 conn(0x7f30a006ab90 msgr2=0x7f30a00b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:55.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f30a6782700 1 -- 172.21.15.73:0/3360848699 shutdown_connections 2023-11-30T23:12:55.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.955+0000 7f30a6782700 1 -- 172.21.15.73:0/3360848699 wait complete. 2023-11-30T23:12:55.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f30a6782700 1 Processor -- start 2023-11-30T23:12:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f30a6782700 1 -- start start 2023-11-30T23:12:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f30a6782700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a0072440 0x7f30a013f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f30a6782700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a00b0e80 0x7f30a00b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f30a6782700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a00b1260 0x7f30a013aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f30a6782700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00b66c0 con 0x7f30a00b1260 2023-11-30T23:12:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f30a6782700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a013f050 con 0x7f30a0072440 2023-11-30T23:12:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f30a6782700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a006ec00 con 0x7f30a00b0e80 2023-11-30T23:12:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f30a4d1f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a00b1260 0x7f30a013aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f30a4d1f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a00b1260 0x7f30a013aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38388/0 (socket says 172.21.15.73:38388) 2023-11-30T23:12:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f30a4d1f700 1 -- 172.21.15.73:0/4272181175 learned_addr learned my addr 172.21.15.73:0/4272181175 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f309ffff700 1 --2- 172.21.15.73:0/4272181175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a0072440 0x7f30a013f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f309f7fe700 1 --2- 172.21.15.73:0/4272181175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a00b0e80 0x7f30a00b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f30a4d1f700 1 -- 172.21.15.73:0/4272181175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a00b0e80 msgr2=0x7f30a00b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f30a4d1f700 1 --2- 172.21.15.73:0/4272181175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a00b0e80 0x7f30a00b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f30a4d1f700 1 -- 172.21.15.73:0/4272181175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a0072440 msgr2=0x7f30a013f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:55.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f30a4d1f700 1 --2- 172.21.15.73:0/4272181175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a0072440 0x7f30a013f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:55.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f30a4d1f700 1 -- 172.21.15.73:0/4272181175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30900094b0 con 0x7f30a00b1260 2023-11-30T23:12:55.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f309ffff700 1 --2- 172.21.15.73:0/4272181175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a0072440 0x7f30a013f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:12:55.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.959+0000 7f30a4d1f700 1 --2- 172.21.15.73:0/4272181175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a00b1260 0x7f30a013aae0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f309800fd20 tx=0x7f309800e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.963+0000 7f309cff9700 1 -- 172.21.15.73:0/4272181175 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309800ec50 con 0x7f30a00b1260 2023-11-30T23:12:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.963+0000 7f309cff9700 1 -- 172.21.15.73:0/4272181175 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309800edd0 con 0x7f30a00b1260 2023-11-30T23:12:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.963+0000 7f309cff9700 1 -- 172.21.15.73:0/4272181175 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309801a6a0 con 0x7f30a00b1260 2023-11-30T23:12:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.963+0000 7f30a6782700 1 -- 172.21.15.73:0/4272181175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a006eee0 con 0x7f30a00b1260 2023-11-30T23:12:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.963+0000 7f30a6782700 1 -- 172.21.15.73:0/4272181175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a013e570 con 0x7f30a00b1260 2023-11-30T23:12:55.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.967+0000 7f30a6782700 1 -- 172.21.15.73:0/4272181175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3080005310 con 0x7f30a00b1260 2023-11-30T23:12:55.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.971+0000 7f309cff9700 1 -- 172.21.15.73:0/4272181175 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f309801a800 con 0x7f30a00b1260 2023-11-30T23:12:55.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.971+0000 7f309cff9700 1 --2- 172.21.15.73:0/4272181175 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3088065d40 0x7f3088068200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:55.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.971+0000 7f309ffff700 1 --2- 172.21.15.73:0/4272181175 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3088065d40 0x7f3088068200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.971+0000 7f309cff9700 1 -- 172.21.15.73:0/4272181175 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30980837e0 con 0x7f30a00b1260 2023-11-30T23:12:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.975+0000 7f309ffff700 1 --2- 172.21.15.73:0/4272181175 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3088065d40 0x7f3088068200 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3090009fd0 tx=0x7f3090008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.975+0000 7f309cff9700 1 -- 172.21.15.73:0/4272181175 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f3098051210 con 0x7f30a00b1260 2023-11-30T23:12:55.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.995+0000 7eff2d382700 1 Processor -- start 2023-11-30T23:12:56.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.995+0000 7eff2d382700 1 -- start start 2023-11-30T23:12:56.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.995+0000 7eff2d382700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff280b0e80 0x7eff28142b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.995+0000 7eff2d382700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7eff280b1260 0x7eff28071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.995+0000 7eff2d382700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2806e280 con 0x7eff28072440 2023-11-30T23:12:56.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.995+0000 7eff2d382700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff280af660 con 0x7eff280b1260 2023-11-30T23:12:56.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.995+0000 7eff2d382700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff281430f0 con 0x7eff280b0e80 2023-11-30T23:12:56.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.995+0000 7eff277fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7eff280b1260 0x7eff28071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.995+0000 7eff277fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7eff280b1260 0x7eff28071f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38400/0 (socket says 172.21.15.73:38400) 2023-11-30T23:12:56.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.995+0000 7eff277fe700 1 -- 172.21.15.73:0/2637040368 learned_addr learned my addr 172.21.15.73:0/2637040368 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:56.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.995+0000 7eff27fff700 1 --2- 172.21.15.73:0/2637040368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff280b0e80 0x7eff28142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.995+0000 7eff277fe700 1 -- 172.21.15.73:0/2637040368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff280b0e80 msgr2=0x7eff28142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:56.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.995+0000 7eff277fe700 1 --2- 172.21.15.73:0/2637040368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff280b0e80 0x7eff28142b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.995+0000 7eff277fe700 1 -- 172.21.15.73:0/2637040368 >> v1:172.21.15.156:6789/0 conn(0x7eff28072440 legacy=0x7eff280afab0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-30T23:12:56.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.995+0000 7eff277fe700 1 -- 172.21.15.73:0/2637040368 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff281433d0 con 0x7eff280b1260 2023-11-30T23:12:56.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.999+0000 7eff277fe700 1 --2- 172.21.15.73:0/2637040368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff280b1260 0x7eff28071f00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7eff2000d370 tx=0x7eff2000d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b00296f637c263 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.999+0000 7eff26ffd700 1 -- 172.21.15.73:0/2637040368 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff20010070 con 0x7eff280b1260 2023-11-30T23:12:56.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.999+0000 7eff26ffd700 1 -- 172.21.15.73:0/2637040368 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2000dcd0 con 0x7eff280b1260 2023-11-30T23:12:56.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.999+0000 7eff2d382700 1 -- 172.21.15.73:0/2637040368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff280b1260 msgr2=0x7eff28071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.999+0000 7eff2d382700 1 --2- 172.21.15.73:0/2637040368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff280b1260 0x7eff28071f00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7eff2000d370 tx=0x7eff2000d680 comp rx=0 tx=0).stop 2023-11-30T23:12:56.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.999+0000 7eff2d382700 1 -- 172.21.15.73:0/2637040368 shutdown_connections 2023-11-30T23:12:56.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.999+0000 7eff2d382700 1 --2- 172.21.15.73:0/2637040368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff280b1260 0x7eff28071f00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.999+0000 7eff2d382700 1 --2- 172.21.15.73:0/2637040368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff280b0e80 0x7eff28142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.999+0000 7eff2d382700 1 -- 172.21.15.73:0/2637040368 >> 172.21.15.73:0/2637040368 conn(0x7eff2806ab90 msgr2=0x7eff280b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:56.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.999+0000 7eff2d382700 1 -- 172.21.15.73:0/2637040368 shutdown_connections 2023-11-30T23:12:56.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.999+0000 7eff2d382700 1 -- 172.21.15.73:0/2637040368 wait complete. 2023-11-30T23:12:56.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.999+0000 7eff2d382700 1 Processor -- start 2023-11-30T23:12:56.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:55.999+0000 7eff2d382700 1 -- start start 2023-11-30T23:12:56.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff2d382700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff28072440 0x7eff281cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff2d382700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff280b0e80 0x7eff281cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff2d382700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff280b1260 0x7eff281de6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff2d382700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff28141a70 con 0x7eff280b1260 2023-11-30T23:12:56.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff2d382700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff281c8ad0 con 0x7eff280b0e80 2023-11-30T23:12:56.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff2d382700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff281c9390 con 0x7eff28072440 2023-11-30T23:12:56.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff2cb81700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff280b1260 0x7eff281de6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff2cb81700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff280b1260 0x7eff281de6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38410/0 (socket says 172.21.15.73:38410) 2023-11-30T23:12:56.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff2cb81700 1 -- 172.21.15.73:0/850495081 learned_addr learned my addr 172.21.15.73:0/850495081 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:56.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff27fff700 1 --2- 172.21.15.73:0/850495081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff28072440 0x7eff281cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff277fe700 1 --2- 172.21.15.73:0/850495081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff280b0e80 0x7eff281cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff2cb81700 1 -- 172.21.15.73:0/850495081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff28072440 msgr2=0x7eff281cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff2cb81700 1 --2- 172.21.15.73:0/850495081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff28072440 0x7eff281cffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff2cb81700 1 -- 172.21.15.73:0/850495081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff280b0e80 msgr2=0x7eff281cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff2cb81700 1 --2- 172.21.15.73:0/850495081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff280b0e80 0x7eff281cac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff2cb81700 1 -- 172.21.15.73:0/850495081 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2000d050 con 0x7eff280b1260 2023-11-30T23:12:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff27fff700 1 --2- 172.21.15.73:0/850495081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff28072440 0x7eff281cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:12:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff2cb81700 1 --2- 172.21.15.73:0/850495081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff280b1260 0x7eff281de6f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00b440 tx=0x7eff1c00b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff24ff9700 1 -- 172.21.15.73:0/850495081 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c011830 con 0x7eff280b1260 2023-11-30T23:12:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff24ff9700 1 -- 172.21.15.73:0/850495081 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c0119b0 con 0x7eff280b1260 2023-11-30T23:12:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff24ff9700 1 -- 172.21.15.73:0/850495081 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c011d60 con 0x7eff280b1260 2023-11-30T23:12:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff2d382700 1 -- 172.21.15.73:0/850495081 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff281c9060 con 0x7eff280b1260 2023-11-30T23:12:56.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff2d382700 1 -- 172.21.15.73:0/850495081 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff281ca670 con 0x7eff280b1260 2023-11-30T23:12:56.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.003+0000 7eff2d382700 1 -- 172.21.15.73:0/850495081 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff08005310 con 0x7eff280b1260 2023-11-30T23:12:56.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.007+0000 7eff24ff9700 1 -- 172.21.15.73:0/850495081 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7eff1c01a400 con 0x7eff280b1260 2023-11-30T23:12:56.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.007+0000 7eff24ff9700 1 --2- 172.21.15.73:0/850495081 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7eff14065bd0 0x7eff14068090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.007+0000 7eff24ff9700 1 -- 172.21.15.73:0/850495081 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff1c0836b0 con 0x7eff280b1260 2023-11-30T23:12:56.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.007+0000 7eff27fff700 1 --2- 172.21.15.73:0/850495081 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7eff14065bd0 0x7eff14068090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.007+0000 7eff27fff700 1 --2- 172.21.15.73:0/850495081 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7eff14065bd0 0x7eff14068090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7eff18009990 tx=0x7eff18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a34bea700 1 Processor -- start 2023-11-30T23:12:56.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a34bea700 1 -- start start 2023-11-30T23:12:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a34bea700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0a3014e1f0 0x7f0a3014e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a34bea700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a300b24a0 0x7f0a30144e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a34bea700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a300b0fb0 con 0x7f0a300afcc0 2023-11-30T23:12:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a34bea700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a300af5e0 con 0x7f0a3014e1f0 2023-11-30T23:12:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a34bea700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3014ee90 con 0x7f0a300b24a0 2023-11-30T23:12:56.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a2ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a300b24a0 0x7f0a30144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a2ed9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a300b24a0 0x7f0a30144e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:43232/0 (socket says 172.21.15.73:43232) 2023-11-30T23:12:56.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a2ed9d700 1 -- 172.21.15.73:0/3207483958 learned_addr learned my addr 172.21.15.73:0/3207483958 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:56.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a2e59c700 1 --2- 172.21.15.73:0/3207483958 >> v2:172.21.15.156:3300/0 conn(0x7f0a3014e1f0 0x7f0a3014e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a2ed9d700 1 -- 172.21.15.73:0/3207483958 >> v2:172.21.15.156:3300/0 conn(0x7f0a3014e1f0 msgr2=0x7f0a3014e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:56.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a2ed9d700 1 --2- 172.21.15.73:0/3207483958 >> v2:172.21.15.156:3300/0 conn(0x7f0a3014e1f0 0x7f0a3014e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a2ed9d700 1 -- 172.21.15.73:0/3207483958 >> v1:172.21.15.156:6789/0 conn(0x7f0a300afcc0 legacy=0x7f0a30144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a2ed9d700 1 -- 172.21.15.73:0/3207483958 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a300b1c80 con 0x7f0a300b24a0 2023-11-30T23:12:56.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a2ed9d700 1 --2- 172.21.15.73:0/3207483958 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a300b24a0 0x7f0a30144e10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009910 tx=0x7f0a20009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a12a1b1f2222608 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a2d59a700 1 -- 172.21.15.73:0/3207483958 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a20011830 con 0x7f0a300b24a0 2023-11-30T23:12:56.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a2d59a700 1 -- 172.21.15.73:0/3207483958 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a20011990 con 0x7f0a300b24a0 2023-11-30T23:12:56.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7f0a2d59a700 1 -- 172.21.15.73:0/3207483958 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a20011d40 con 0x7f0a300b24a0 2023-11-30T23:12:56.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.011+0000 7eff24ff9700 1 -- 172.21.15.73:0/850495081 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7eff1c0510e0 con 0x7eff280b1260 2023-11-30T23:12:56.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.015+0000 7f0a34bea700 1 -- 172.21.15.73:0/3207483958 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a300b24a0 msgr2=0x7f0a30144e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.015+0000 7f0a34bea700 1 --2- 172.21.15.73:0/3207483958 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a300b24a0 0x7f0a30144e10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009910 tx=0x7f0a20009c20 comp rx=0 tx=0).stop 2023-11-30T23:12:56.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.015+0000 7f0a34bea700 1 -- 172.21.15.73:0/3207483958 shutdown_connections 2023-11-30T23:12:56.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.015+0000 7f0a34bea700 1 --2- 172.21.15.73:0/3207483958 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a300b24a0 0x7f0a30144e10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.015+0000 7f0a34bea700 1 --2- 172.21.15.73:0/3207483958 >> v2:172.21.15.156:3300/0 conn(0x7f0a3014e1f0 0x7f0a3014e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.015+0000 7f0a34bea700 1 -- 172.21.15.73:0/3207483958 >> 172.21.15.73:0/3207483958 conn(0x7f0a300b45a0 msgr2=0x7f0a300b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:56.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.015+0000 7f0a34bea700 1 -- 172.21.15.73:0/3207483958 shutdown_connections 2023-11-30T23:12:56.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.015+0000 7fa68759e700 1 Processor -- start 2023-11-30T23:12:56.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.015+0000 7f0a34bea700 1 -- 172.21.15.73:0/3207483958 wait complete. 2023-11-30T23:12:56.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff855c8c700 1 Processor -- start 2023-11-30T23:12:56.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff855c8c700 1 -- start start 2023-11-30T23:12:56.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.015+0000 7fa68759e700 1 -- start start 2023-11-30T23:12:56.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7fa68759e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa6880b1260 0x7fa688142b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7fa68759e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68806e280 con 0x7fa6880afab0 2023-11-30T23:12:56.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7fa68759e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6881430f0 con 0x7fa6880b0e80 2023-11-30T23:12:56.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7fa68759e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6880af660 con 0x7fa6880b1260 2023-11-30T23:12:56.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a34bea700 1 Processor -- start 2023-11-30T23:12:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a34bea700 1 -- start start 2023-11-30T23:12:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff855c8c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff8500b24a0 0x7ff8500af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a34bea700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a300afcc0 0x7f0a301de910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a34bea700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a300b24a0 0x7f0a300b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a34bea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a3014e1f0 0x7f0a301ebc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a34bea700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a301eb840 con 0x7f0a3014e1f0 2023-11-30T23:12:56.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a34bea700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a300b7270 con 0x7f0a300afcc0 2023-11-30T23:12:56.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a34bea700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3014e950 con 0x7f0a300b24a0 2023-11-30T23:12:56.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a2ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a3014e1f0 0x7f0a301ebc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a2ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a3014e1f0 0x7f0a301ebc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38428/0 (socket says 172.21.15.73:38428) 2023-11-30T23:12:56.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a2ed9d700 1 -- 172.21.15.73:0/2643022305 learned_addr learned my addr 172.21.15.73:0/2643022305 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:56.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff855c8c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff850144800 0x7ff850144c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff855c8c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8500b1d30 con 0x7ff8500b0bb0 2023-11-30T23:12:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7fa686d9d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa6880afab0 0x7fa6880afee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38220/0 (socket says 172.21.15.73:38220) 2023-11-30T23:12:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7fa686d9d700 1 -- 172.21.15.73:0/4164023143 learned_addr learned my addr 172.21.15.73:0/4164023143 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a2e59c700 1 --2- 172.21.15.73:0/2643022305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a300afcc0 0x7f0a301de910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a2dd9b700 1 --2- 172.21.15.73:0/2643022305 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a300b24a0 0x7f0a300b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff855c8c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85014aa30 con 0x7ff850144800 2023-11-30T23:12:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff855c8c700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8500b04f0 con 0x7ff8500b24a0 2023-11-30T23:12:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7fa685d9b700 1 --2- 172.21.15.73:0/4164023143 >> v2:172.21.15.73:3300/0 conn(0x7fa6880b1260 0x7fa688142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff85548b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff850144800 0x7ff850144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff854c8a700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff8500b0bb0 0x7ff85014b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38224/0 (socket says 172.21.15.73:38224) 2023-11-30T23:12:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff85548b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff850144800 0x7ff850144c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38418/0 (socket says 172.21.15.73:38418) 2023-11-30T23:12:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff854c8a700 1 -- 172.21.15.73:0/52019064 learned_addr learned my addr 172.21.15.73:0/52019064 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff84ffff700 1 --2- 172.21.15.73:0/52019064 >> v2:172.21.15.156:3300/0 conn(0x7ff8500b24a0 0x7ff8500af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff84f7fe700 1 -- 172.21.15.73:0/52019064 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349778964 0 0) 0x7ff8500b1d30 con 0x7ff8500b0bb0 2023-11-30T23:12:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff84f7fe700 1 -- 172.21.15.73:0/52019064 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8380035d0 con 0x7ff8500b0bb0 2023-11-30T23:12:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff85548b700 1 -- 172.21.15.73:0/52019064 >> v2:172.21.15.156:3300/0 conn(0x7ff8500b24a0 msgr2=0x7ff8500af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff85548b700 1 --2- 172.21.15.73:0/52019064 >> v2:172.21.15.156:3300/0 conn(0x7ff8500b24a0 0x7ff8500af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff85548b700 1 -- 172.21.15.73:0/52019064 >> v1:172.21.15.73:6789/0 conn(0x7ff8500b0bb0 legacy=0x7ff85014b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff85548b700 1 -- 172.21.15.73:0/52019064 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8501451b0 con 0x7ff850144800 2023-11-30T23:12:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a2ed9d700 1 -- 172.21.15.73:0/2643022305 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a300b24a0 msgr2=0x7f0a300b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a2ed9d700 1 --2- 172.21.15.73:0/2643022305 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a300b24a0 0x7f0a300b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a2ed9d700 1 -- 172.21.15.73:0/2643022305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a300afcc0 msgr2=0x7f0a301de910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a2ed9d700 1 --2- 172.21.15.73:0/2643022305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a300afcc0 0x7f0a301de910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a2ed9d700 1 -- 172.21.15.73:0/2643022305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a20009570 con 0x7f0a3014e1f0 2023-11-30T23:12:56.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff85548b700 1 --2- 172.21.15.73:0/52019064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff850144800 0x7ff850144c70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff85006b160 tx=0x7ff84800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e0409349de7c34 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7fa68559a700 1 -- 172.21.15.73:0/4164023143 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530284727 0 0) 0x7fa68806e280 con 0x7fa6880afab0 2023-11-30T23:12:56.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7fa68559a700 1 -- 172.21.15.73:0/4164023143 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6700034f0 con 0x7fa6880afab0 2023-11-30T23:12:56.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a2ed9d700 1 --2- 172.21.15.73:0/2643022305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a3014e1f0 0x7f0a301ebc60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009f70 tx=0x7f0a20004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7fa68559a700 1 -- 172.21.15.73:0/4164023143 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 103646791 0 0) 0x7fa6700034f0 con 0x7fa6880afab0 2023-11-30T23:12:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7fa685d9b700 1 -- 172.21.15.73:0/4164023143 >> v1:172.21.15.156:6789/0 conn(0x7fa6880b0e80 legacy=0x7fa688071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7fa685d9b700 1 -- 172.21.15.73:0/4164023143 >> v1:172.21.15.73:6789/0 conn(0x7fa6880afab0 legacy=0x7fa6880afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7fa685d9b700 1 -- 172.21.15.73:0/4164023143 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6881433d0 con 0x7fa6880b1260 2023-11-30T23:12:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff84f7fe700 1 -- 172.21.15.73:0/52019064 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84800e070 con 0x7ff850144800 2023-11-30T23:12:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff84f7fe700 1 -- 172.21.15.73:0/52019064 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84800bb20 con 0x7ff850144800 2023-11-30T23:12:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff84f7fe700 1 -- 172.21.15.73:0/52019064 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848012430 con 0x7ff850144800 2023-11-30T23:12:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7fa685d9b700 1 --2- 172.21.15.73:0/4164023143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6880b1260 0x7fa688142b10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009ae0 tx=0x7fa67c009df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa1cc299e3ff61e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a1effd700 1 -- 172.21.15.73:0/2643022305 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2001a710 con 0x7f0a3014e1f0 2023-11-30T23:12:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a1effd700 1 -- 172.21.15.73:0/2643022305 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2001f070 con 0x7f0a3014e1f0 2023-11-30T23:12:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a34bea700 1 -- 172.21.15.73:0/2643022305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a300b7460 con 0x7f0a3014e1f0 2023-11-30T23:12:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a34bea700 1 -- 172.21.15.73:0/2643022305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a300b8670 con 0x7f0a3014e1f0 2023-11-30T23:12:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff855c8c700 1 -- 172.21.15.73:0/52019064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff850144800 msgr2=0x7ff850144c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7ff855c8c700 1 --2- 172.21.15.73:0/52019064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff850144800 0x7ff850144c70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff85006b160 tx=0x7ff84800b330 comp rx=0 tx=0).stop 2023-11-30T23:12:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.019+0000 7f0a1effd700 1 -- 172.21.15.73:0/2643022305 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2001aab0 con 0x7f0a3014e1f0 2023-11-30T23:12:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff855c8c700 1 -- 172.21.15.73:0/52019064 shutdown_connections 2023-11-30T23:12:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff855c8c700 1 --2- 172.21.15.73:0/52019064 >> v2:172.21.15.156:3300/0 conn(0x7ff8500b24a0 0x7ff8500af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff855c8c700 1 --2- 172.21.15.73:0/52019064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff850144800 0x7ff850144c70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff855c8c700 1 -- 172.21.15.73:0/52019064 >> 172.21.15.73:0/52019064 conn(0x7ff85006ab90 msgr2=0x7ff8500b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff855c8c700 1 -- 172.21.15.73:0/52019064 shutdown_connections 2023-11-30T23:12:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff855c8c700 1 -- 172.21.15.73:0/52019064 wait complete. 2023-11-30T23:12:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7fa68559a700 1 -- 172.21.15.73:0/4164023143 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c004230 con 0x7fa6880b1260 2023-11-30T23:12:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7fa68559a700 1 -- 172.21.15.73:0/4164023143 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c004390 con 0x7fa6880b1260 2023-11-30T23:12:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7fa68759e700 1 -- 172.21.15.73:0/4164023143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6880b1260 msgr2=0x7fa688142b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7fa68559a700 1 -- 172.21.15.73:0/4164023143 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c004230 con 0x7fa6880b1260 2023-11-30T23:12:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7fa68759e700 1 --2- 172.21.15.73:0/4164023143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6880b1260 0x7fa688142b10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009ae0 tx=0x7fa67c009df0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7fa68759e700 1 -- 172.21.15.73:0/4164023143 shutdown_connections 2023-11-30T23:12:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7fa68759e700 1 --2- 172.21.15.73:0/4164023143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6880b1260 0x7fa688142b10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7fa68759e700 1 -- 172.21.15.73:0/4164023143 >> 172.21.15.73:0/4164023143 conn(0x7fa68806ab90 msgr2=0x7fa6880b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7f0a1effd700 1 -- 172.21.15.73:0/2643022305 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0a20021030 con 0x7f0a3014e1f0 2023-11-30T23:12:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7f0a1effd700 1 --2- 172.21.15.73:0/2643022305 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0a10065ad0 0x7f0a10067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7f0a1effd700 1 -- 172.21.15.73:0/2643022305 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a200842e0 con 0x7f0a3014e1f0 2023-11-30T23:12:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7f0a2e59c700 1 --2- 172.21.15.73:0/2643022305 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0a10065ad0 0x7f0a10067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff855c8c700 1 Processor -- start 2023-11-30T23:12:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff855c8c700 1 -- start start 2023-11-30T23:12:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7fa68759e700 1 -- 172.21.15.73:0/4164023143 shutdown_connections 2023-11-30T23:12:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7f0a2e59c700 1 --2- 172.21.15.73:0/2643022305 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0a10065ad0 0x7f0a10067f90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0a24009b50 tx=0x7f0a24009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7f0a34bea700 1 -- 172.21.15.73:0/2643022305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a14005310 con 0x7f0a3014e1f0 2023-11-30T23:12:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff855c8c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8500b0bb0 0x7ff85014dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff855c8c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8500b24a0 0x7ff8501e3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff855c8c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff850144800 0x7ff850145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff855c8c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500ae6d0 con 0x7ff8500b0bb0 2023-11-30T23:12:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff855c8c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500ae920 con 0x7ff8500b24a0 2023-11-30T23:12:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff855c8c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff850147cc0 con 0x7ff850144800 2023-11-30T23:12:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff854c8a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8500b0bb0 0x7ff85014dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff854c8a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8500b0bb0 0x7ff85014dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38448/0 (socket says 172.21.15.73:38448) 2023-11-30T23:12:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff854c8a700 1 -- 172.21.15.73:0/172597821 learned_addr learned my addr 172.21.15.73:0/172597821 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7fa68759e700 1 -- 172.21.15.73:0/4164023143 wait complete. 2023-11-30T23:12:56.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff84ffff700 1 --2- 172.21.15.73:0/172597821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8500b24a0 0x7ff8501e3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff854c8a700 1 -- 172.21.15.73:0/172597821 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff850144800 msgr2=0x7ff850145380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T23:12:56.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff854c8a700 1 --2- 172.21.15.73:0/172597821 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff850144800 0x7ff850145380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff854c8a700 1 -- 172.21.15.73:0/172597821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8500b24a0 msgr2=0x7ff8501e3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff854c8a700 1 --2- 172.21.15.73:0/172597821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8500b24a0 0x7ff8501e3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff854c8a700 1 -- 172.21.15.73:0/172597821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff848009a70 con 0x7ff8500b0bb0 2023-11-30T23:12:56.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.023+0000 7ff854c8a700 1 --2- 172.21.15.73:0/172597821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8500b0bb0 0x7ff85014dc30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff84000c700 tx=0x7ff84000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa68759e700 1 Processor -- start 2023-11-30T23:12:56.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa68759e700 1 -- start start 2023-11-30T23:12:56.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fb4a1a66700 1 Processor -- start 2023-11-30T23:12:56.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa68759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6880afab0 0x7fa6881dba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fb4a1a66700 1 -- start start 2023-11-30T23:12:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa68759e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6880b0e80 0x7fa6881cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa68759e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa6880b1260 0x7fa6881dfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa68759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6881d03a0 con 0x7fa6880afab0 2023-11-30T23:12:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa68759e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6881df000 con 0x7fa6880b0e80 2023-11-30T23:12:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa68759e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6881df5c0 con 0x7fa6880b1260 2023-11-30T23:12:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7f48bc999700 1 Processor -- start 2023-11-30T23:12:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7f48bc999700 1 -- start start 2023-11-30T23:12:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa68659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6880afab0 0x7fa6881dba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa68659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6880afab0 0x7fa6881dba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38460/0 (socket says 172.21.15.73:38460) 2023-11-30T23:12:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa68659c700 1 -- 172.21.15.73:0/606516758 learned_addr learned my addr 172.21.15.73:0/606516758 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa686d9d700 1 --2- 172.21.15.73:0/606516758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa6880b1260 0x7fa6881dfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa685d9b700 1 --2- 172.21.15.73:0/606516758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6880b0e80 0x7fa6881cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa68659c700 1 -- 172.21.15.73:0/606516758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa6880b1260 msgr2=0x7fa6881dfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa68659c700 1 --2- 172.21.15.73:0/606516758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa6880b1260 0x7fa6881dfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa68659c700 1 -- 172.21.15.73:0/606516758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6880b0e80 msgr2=0x7fa6881cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa68659c700 1 --2- 172.21.15.73:0/606516758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6880b0e80 0x7fa6881cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa68659c700 1 -- 172.21.15.73:0/606516758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c0094b0 con 0x7fa6880afab0 2023-11-30T23:12:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa685d9b700 1 --2- 172.21.15.73:0/606516758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6880b0e80 0x7fa6881cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:12:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fa68659c700 1 --2- 172.21.15.73:0/606516758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6880afab0 0x7fa6881dba90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa67800c4e0 tx=0x7fa67800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7f48bc999700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f48b80ae720 0x7f48b8149f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7f48bc999700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b80ac8d0 con 0x7f48b80adc60 2023-11-30T23:12:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7f48bc999700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b80b4e50 con 0x7f48b80b12b0 2023-11-30T23:12:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7f48bc999700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b80ae040 con 0x7f48b80ae720 2023-11-30T23:12:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fb4a1a66700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb49c06efb0 0x7fb49c13e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fb4a1a66700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb49c0b3880 con 0x7fb49c0b1420 2023-11-30T23:12:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fb4a1a66700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb49c0b3e40 con 0x7fb49c144b80 2023-11-30T23:12:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fb4a1a66700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c070410 con 0x7fb49c06efb0 2023-11-30T23:12:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fb4a0a64700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb49c0b1420 0x7fb49c144470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38226/0 (socket says 172.21.15.73:38226) 2023-11-30T23:12:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fb4a0a64700 1 -- 172.21.15.73:0/3745062695 learned_addr learned my addr 172.21.15.73:0/3745062695 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fb49bfff700 1 --2- 172.21.15.73:0/3745062695 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb49c06efb0 0x7fb49c13e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7f48b6d9d700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f48b80b12b0 0x7f48b8151240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.73:48594/0 (socket says 172.21.15.73:48594) 2023-11-30T23:12:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7f48b6d9d700 1 -- 172.21.15.73:0/1074452966 learned_addr learned my addr 172.21.15.73:0/1074452966 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7f48b5d9b700 1 --2- 172.21.15.73:0/1074452966 >> v2:172.21.15.156:3300/0 conn(0x7f48b80ae720 0x7f48b8149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7f48b5d9b700 1 -- 172.21.15.73:0/1074452966 >> v1:172.21.15.156:6789/0 conn(0x7f48b80b12b0 legacy=0x7f48b8151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7f48b5d9b700 1 -- 172.21.15.73:0/1074452966 >> v1:172.21.15.73:6789/0 conn(0x7f48b80adc60 legacy=0x7f48b80b0ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-30T23:12:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7f48b5d9b700 1 -- 172.21.15.73:0/1074452966 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b80af320 con 0x7f48b80ae720 2023-11-30T23:12:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fb49bfff700 1 -- 172.21.15.73:0/3745062695 >> v1:172.21.15.156:6789/0 conn(0x7fb49c144b80 legacy=0x7fb49c13e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fb49bfff700 1 -- 172.21.15.73:0/3745062695 >> v1:172.21.15.73:6789/0 conn(0x7fb49c0b1420 legacy=0x7fb49c144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fb49bfff700 1 -- 172.21.15.73:0/3745062695 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49c0b0fc0 con 0x7fb49c06efb0 2023-11-30T23:12:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7f48b5d9b700 1 --2- 172.21.15.73:0/1074452966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48b80ae720 0x7f48b8149f10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009850 tx=0x7f48ac009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10dcc96d5ae5951a server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.027+0000 7fb49bfff700 1 --2- 172.21.15.73:0/3745062695 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb49c06efb0 0x7fb49c13e110 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb494009dc0 tx=0x7fb49400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bdcf9d121b8d67b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.031+0000 7fb49b7fe700 1 -- 172.21.15.73:0/3745062695 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49400e070 con 0x7fb49c06efb0 2023-11-30T23:12:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.031+0000 7fb49b7fe700 1 -- 172.21.15.73:0/3745062695 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49400bad0 con 0x7fb49c06efb0 2023-11-30T23:12:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.031+0000 7fb49b7fe700 1 -- 172.21.15.73:0/3745062695 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49400be80 con 0x7fb49c06efb0 2023-11-30T23:12:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.031+0000 7fb4a1a66700 1 -- 172.21.15.73:0/3745062695 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb49c06efb0 msgr2=0x7fb49c13e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.031+0000 7fb4a1a66700 1 --2- 172.21.15.73:0/3745062695 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb49c06efb0 0x7fb49c13e110 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb494009dc0 tx=0x7fb49400b330 comp rx=0 tx=0).stop 2023-11-30T23:12:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.031+0000 7ff84d7fa700 1 -- 172.21.15.73:0/172597821 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff840005d90 con 0x7ff8500b0bb0 2023-11-30T23:12:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.031+0000 7ff855c8c700 1 -- 172.21.15.73:0/172597821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff85006f470 con 0x7ff8500b0bb0 2023-11-30T23:12:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.031+0000 7ff84d7fa700 1 -- 172.21.15.73:0/172597821 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8400070d0 con 0x7ff8500b0bb0 2023-11-30T23:12:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.031+0000 7ff84d7fa700 1 -- 172.21.15.73:0/172597821 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff840007480 con 0x7ff8500b0bb0 2023-11-30T23:12:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.031+0000 7fa676ffd700 1 -- 172.21.15.73:0/606516758 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678011790 con 0x7fa6880afab0 2023-11-30T23:12:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.031+0000 7fa676ffd700 1 -- 172.21.15.73:0/606516758 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa678011910 con 0x7fa6880afab0 2023-11-30T23:12:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.031+0000 7fa676ffd700 1 -- 172.21.15.73:0/606516758 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678011cc0 con 0x7fa6880afab0 2023-11-30T23:12:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.031+0000 7fa68759e700 1 -- 172.21.15.73:0/606516758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6881c8a20 con 0x7fa6880afab0 2023-11-30T23:12:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.031+0000 7fa68759e700 1 -- 172.21.15.73:0/606516758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6881df250 con 0x7fa6880afab0 2023-11-30T23:12:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.031+0000 7f0a1effd700 1 -- 172.21.15.73:0/2643022305 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f0a20051cb0 con 0x7f0a3014e1f0 2023-11-30T23:12:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.031+0000 7ff855c8c700 1 -- 172.21.15.73:0/172597821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff850148480 con 0x7ff8500b0bb0 2023-11-30T23:12:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.031+0000 7ff84d7fa700 1 -- 172.21.15.73:0/172597821 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff8400075e0 con 0x7ff8500b0bb0 2023-11-30T23:12:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.035+0000 7ff84d7fa700 1 --2- 172.21.15.73:0/172597821 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff83c065b00 0x7ff83c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.035+0000 7f48b559a700 1 -- 172.21.15.73:0/1074452966 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac004230 con 0x7f48b80ae720 2023-11-30T23:12:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.035+0000 7f48b559a700 1 -- 172.21.15.73:0/1074452966 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac004390 con 0x7f48b80ae720 2023-11-30T23:12:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.035+0000 7f48b559a700 1 -- 172.21.15.73:0/1074452966 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac0036c0 con 0x7f48b80ae720 2023-11-30T23:12:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.035+0000 7ff84ffff700 1 --2- 172.21.15.73:0/172597821 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff83c065b00 0x7ff83c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.035+0000 7ff84ffff700 1 --2- 172.21.15.73:0/172597821 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff83c065b00 0x7ff83c067fc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff850147430 tx=0x7ff844008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.035+0000 7fa676ffd700 1 -- 172.21.15.73:0/606516758 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa67801c460 con 0x7fa6880afab0 2023-11-30T23:12:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.035+0000 7fa676ffd700 1 --2- 172.21.15.73:0/606516758 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa668065ad0 0x7fa668067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.035+0000 7fa676ffd700 1 -- 172.21.15.73:0/606516758 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa678082f00 con 0x7fa6880afab0 2023-11-30T23:12:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.035+0000 7f48bc999700 1 -- 172.21.15.73:0/1074452966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48b80ae720 msgr2=0x7f48b8149f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.035+0000 7f48bc999700 1 --2- 172.21.15.73:0/1074452966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48b80ae720 0x7f48b8149f10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009850 tx=0x7f48ac009b60 comp rx=0 tx=0).stop 2023-11-30T23:12:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.035+0000 7ff855c8c700 1 -- 172.21.15.73:0/172597821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff850147e00 con 0x7ff8500b0bb0 2023-11-30T23:12:56.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7f48bc999700 1 -- 172.21.15.73:0/1074452966 shutdown_connections 2023-11-30T23:12:56.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7f48bc999700 1 --2- 172.21.15.73:0/1074452966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48b80ae720 0x7f48b8149f10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7f48bc999700 1 -- 172.21.15.73:0/1074452966 >> 172.21.15.73:0/1074452966 conn(0x7f48b806a360 msgr2=0x7f48b806a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:56.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fa685d9b700 1 --2- 172.21.15.73:0/606516758 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa668065ad0 0x7fa668067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1a66700 1 -- 172.21.15.73:0/3745062695 shutdown_connections 2023-11-30T23:12:56.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1a66700 1 --2- 172.21.15.73:0/3745062695 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb49c06efb0 0x7fb49c13e110 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1a66700 1 -- 172.21.15.73:0/3745062695 >> 172.21.15.73:0/3745062695 conn(0x7fb49c06ab90 msgr2=0x7fb49c0b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:56.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1a66700 1 -- 172.21.15.73:0/3745062695 shutdown_connections 2023-11-30T23:12:56.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7ff84d7fa700 1 -- 172.21.15.73:0/172597821 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff840054190 con 0x7ff8500b0bb0 2023-11-30T23:12:56.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1a66700 1 -- 172.21.15.73:0/3745062695 wait complete. 2023-11-30T23:12:56.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fa685d9b700 1 --2- 172.21.15.73:0/606516758 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa668065ad0 0x7fa668067f90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009ae0 tx=0x7fa67c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1a66700 1 Processor -- start 2023-11-30T23:12:56.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1a66700 1 -- start start 2023-11-30T23:12:56.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1a66700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb49c06efb0 0x7fb49c0b6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1a66700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb49c0b1420 0x7fb49c12f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1a66700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb49c144b80 0x7fb49c12fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1a66700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c0b7ea0 con 0x7fb49c144b80 2023-11-30T23:12:56.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1a66700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c0b5960 con 0x7fb49c0b1420 2023-11-30T23:12:56.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1a66700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c0b8110 con 0x7fb49c06efb0 2023-11-30T23:12:56.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1265700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb49c144b80 0x7fb49c12fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1265700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb49c144b80 0x7fb49c12fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38468/0 (socket says 172.21.15.73:38468) 2023-11-30T23:12:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1265700 1 -- 172.21.15.73:0/196226066 learned_addr learned my addr 172.21.15.73:0/196226066 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a0a64700 1 --2- 172.21.15.73:0/196226066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb49c06efb0 0x7fb49c0b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb49bfff700 1 --2- 172.21.15.73:0/196226066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb49c0b1420 0x7fb49c12f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1265700 1 -- 172.21.15.73:0/196226066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb49c06efb0 msgr2=0x7fb49c0b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1265700 1 --2- 172.21.15.73:0/196226066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb49c06efb0 0x7fb49c0b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1265700 1 -- 172.21.15.73:0/196226066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb49c0b1420 msgr2=0x7fb49c12f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1265700 1 --2- 172.21.15.73:0/196226066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb49c0b1420 0x7fb49c12f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1265700 1 -- 172.21.15.73:0/196226066 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb494009a70 con 0x7fb49c144b80 2023-11-30T23:12:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.039+0000 7fb4a1265700 1 --2- 172.21.15.73:0/196226066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb49c144b80 0x7fb49c12fc20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00c780 tx=0x7fb48c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48bc999700 1 -- 172.21.15.73:0/1074452966 shutdown_connections 2023-11-30T23:12:56.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7fa68759e700 1 -- 172.21.15.73:0/606516758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68804ed80 con 0x7fa6880afab0 2023-11-30T23:12:56.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48bc999700 1 -- 172.21.15.73:0/1074452966 wait complete. 2023-11-30T23:12:56.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48bc999700 1 Processor -- start 2023-11-30T23:12:56.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48bc999700 1 -- start start 2023-11-30T23:12:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48bc999700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48b80adc60 0x7f48b81df650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48bc999700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48b80ae720 0x7f48b81e90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48bc999700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48b80b12b0 0x7f48b81482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48bc999700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b81e9b60 con 0x7f48b80b12b0 2023-11-30T23:12:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48bc999700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b8147ea0 con 0x7f48b80ae720 2023-11-30T23:12:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48bc999700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b81e9610 con 0x7f48b80adc60 2023-11-30T23:12:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48b6d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48b80b12b0 0x7f48b81482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48b6d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48b80b12b0 0x7f48b81482c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38482/0 (socket says 172.21.15.73:38482) 2023-11-30T23:12:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48b6d9d700 1 -- 172.21.15.73:0/4250653051 learned_addr learned my addr 172.21.15.73:0/4250653051 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48b659c700 1 --2- 172.21.15.73:0/4250653051 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48b80adc60 0x7f48b81df650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48b5d9b700 1 --2- 172.21.15.73:0/4250653051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48b80ae720 0x7f48b81e90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48b6d9d700 1 -- 172.21.15.73:0/4250653051 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48b80adc60 msgr2=0x7f48b81df650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48b6d9d700 1 --2- 172.21.15.73:0/4250653051 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48b80adc60 0x7f48b81df650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48b6d9d700 1 -- 172.21.15.73:0/4250653051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48b80ae720 msgr2=0x7f48b81e90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48b6d9d700 1 --2- 172.21.15.73:0/4250653051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48b80ae720 0x7f48b81e90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48b6d9d700 1 -- 172.21.15.73:0/4250653051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac0094b0 con 0x7f48b80b12b0 2023-11-30T23:12:56.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48b5d9b700 1 --2- 172.21.15.73:0/4250653051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48b80ae720 0x7f48b81e90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:12:56.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.043+0000 7f48b6d9d700 1 --2- 172.21.15.73:0/4250653051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48b80b12b0 0x7f48b81482c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f48b000cad0 tx=0x7f48b000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.047+0000 7ff84d7fa700 1 -- 172.21.15.73:0/172597821 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7ff84004fdd0 con 0x7ff8500b0bb0 2023-11-30T23:12:56.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.047+0000 7fb4997fa700 1 -- 172.21.15.73:0/196226066 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c005480 con 0x7fb49c144b80 2023-11-30T23:12:56.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.047+0000 7fb4a1a66700 1 -- 172.21.15.73:0/196226066 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb49c0b83f0 con 0x7fb49c144b80 2023-11-30T23:12:56.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.047+0000 7fb4a1a66700 1 -- 172.21.15.73:0/196226066 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49c0b6ca0 con 0x7fb49c144b80 2023-11-30T23:12:56.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.051+0000 7f48a6ffd700 1 -- 172.21.15.73:0/4250653051 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b000a9a0 con 0x7f48b80b12b0 2023-11-30T23:12:56.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.051+0000 7f48bc999700 1 -- 172.21.15.73:0/4250653051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b81e9880 con 0x7f48b80b12b0 2023-11-30T23:12:56.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.051+0000 7f48bc999700 1 -- 172.21.15.73:0/4250653051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b81dc8c0 con 0x7f48b80b12b0 2023-11-30T23:12:56.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.051+0000 7fb4a1a66700 1 -- 172.21.15.73:0/196226066 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49c04ed80 con 0x7fb49c144b80 2023-11-30T23:12:56.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.051+0000 7f48bc999700 1 -- 172.21.15.73:0/4250653051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b8147c00 con 0x7f48b80b12b0 2023-11-30T23:12:56.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f7508f11700 1 Processor -- start 2023-11-30T23:12:56.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7fb4997fa700 1 -- 172.21.15.73:0/196226066 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c0036a0 con 0x7fb49c144b80 2023-11-30T23:12:56.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7fb4997fa700 1 -- 172.21.15.73:0/196226066 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c003a10 con 0x7fb49c144b80 2023-11-30T23:12:56.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f48a6ffd700 1 -- 172.21.15.73:0/4250653051 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b0001ab0 con 0x7f48b80b12b0 2023-11-30T23:12:56.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f48a6ffd700 1 -- 172.21.15.73:0/4250653051 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b000ad00 con 0x7f48b80b12b0 2023-11-30T23:12:56.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7fa676ffd700 1 -- 172.21.15.73:0/606516758 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fa6780508b0 con 0x7fa6880afab0 2023-11-30T23:12:56.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f7508f11700 1 -- start start 2023-11-30T23:12:56.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7fb4997fa700 1 -- 172.21.15.73:0/196226066 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb48c012400 con 0x7fb49c144b80 2023-11-30T23:12:56.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f7508f11700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75040b0e80 0x7f7504142b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f7508f11700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f75040b1260 0x7f7504071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f7508f11700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7504072440 0x7f75040afab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f7508f11700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75040af660 con 0x7f75040b1260 2023-11-30T23:12:56.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f7508f11700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750406e280 con 0x7f7504072440 2023-11-30T23:12:56.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f7508f11700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75041430f0 con 0x7f75040b0e80 2023-11-30T23:12:56.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f7503fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7504072440 0x7f75040afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f75037fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75040b0e80 0x7f7504142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f7503fff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7504072440 0x7f75040afab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59660/0 (socket says 172.21.15.73:59660) 2023-11-30T23:12:56.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f7503fff700 1 -- 172.21.15.73:0/2327549594 learned_addr learned my addr 172.21.15.73:0/2327549594 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:56.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7fb4997fa700 1 --2- 172.21.15.73:0/196226066 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb484065bc0 0x7fb484068080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f7503fff700 1 -- 172.21.15.73:0/2327549594 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75040b0e80 msgr2=0x7f7504142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:56.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f7503fff700 1 --2- 172.21.15.73:0/2327549594 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75040b0e80 0x7f7504142b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f7503fff700 1 -- 172.21.15.73:0/2327549594 >> v2:172.21.15.73:3300/0 conn(0x7f75040b1260 msgr2=0x7f7504071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:56.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7fb4997fa700 1 -- 172.21.15.73:0/196226066 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb48c082cc0 con 0x7fb49c144b80 2023-11-30T23:12:56.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f7503fff700 1 --2- 172.21.15.73:0/2327549594 >> v2:172.21.15.73:3300/0 conn(0x7f75040b1260 0x7f7504071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f7503fff700 1 -- 172.21.15.73:0/2327549594 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75041433d0 con 0x7f7504072440 2023-11-30T23:12:56.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7f7503fff700 1 --2- 172.21.15.73:0/2327549594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7504072440 0x7f75040afab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f750406b690 tx=0x7f74f4009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30d1a30063031505 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.055+0000 7fb4a0a64700 1 --2- 172.21.15.73:0/196226066 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb484065bc0 0x7fb484068080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.059+0000 7fb4a0a64700 1 --2- 172.21.15.73:0/196226066 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb484065bc0 0x7fb484068080 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb490005930 tx=0x7fb490009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.059+0000 7f48a6ffd700 1 -- 172.21.15.73:0/4250653051 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f48b0005d50 con 0x7f48b80b12b0 2023-11-30T23:12:56.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.059+0000 7f48a6ffd700 1 --2- 172.21.15.73:0/4250653051 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f4898065ad0 0x7f4898067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.059+0000 7f48a6ffd700 1 -- 172.21.15.73:0/4250653051 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48b0082f20 con 0x7f48b80b12b0 2023-11-30T23:12:56.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.059+0000 7f48b659c700 1 --2- 172.21.15.73:0/4250653051 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f4898065ad0 0x7f4898067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.059+0000 7f48b659c700 1 --2- 172.21.15.73:0/4250653051 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f4898065ad0 0x7f4898067f90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f48a8006fd0 tx=0x7f48a8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.067+0000 7fb4997fa700 1 -- 172.21.15.73:0/196226066 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fb48c050860 con 0x7fb49c144b80 2023-11-30T23:12:56.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.063+0000 7f75027fc700 1 -- 172.21.15.73:0/2327549594 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f4013c90 con 0x7f7504072440 2023-11-30T23:12:56.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.063+0000 7f75027fc700 1 -- 172.21.15.73:0/2327549594 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f4013df0 con 0x7f7504072440 2023-11-30T23:12:56.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.063+0000 7f75027fc700 1 -- 172.21.15.73:0/2327549594 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f401b620 con 0x7f7504072440 2023-11-30T23:12:56.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.063+0000 7f7508f11700 1 -- 172.21.15.73:0/2327549594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7504072440 msgr2=0x7f75040afab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.063+0000 7f7508f11700 1 --2- 172.21.15.73:0/2327549594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7504072440 0x7f75040afab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f750406b690 tx=0x7f74f4009bf0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.063+0000 7f7508f11700 1 -- 172.21.15.73:0/2327549594 shutdown_connections 2023-11-30T23:12:56.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.063+0000 7f7508f11700 1 --2- 172.21.15.73:0/2327549594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7504072440 0x7f75040afab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.063+0000 7f7508f11700 1 --2- 172.21.15.73:0/2327549594 >> v2:172.21.15.73:3300/0 conn(0x7f75040b1260 0x7f7504071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.063+0000 7f7508f11700 1 --2- 172.21.15.73:0/2327549594 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75040b0e80 0x7f7504142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.063+0000 7f7508f11700 1 -- 172.21.15.73:0/2327549594 >> 172.21.15.73:0/2327549594 conn(0x7f750406ab90 msgr2=0x7f75040b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:56.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.071+0000 7f7508f11700 1 -- 172.21.15.73:0/2327549594 shutdown_connections 2023-11-30T23:12:56.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.071+0000 7f7508f11700 1 -- 172.21.15.73:0/2327549594 wait complete. 2023-11-30T23:12:56.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.071+0000 7f7508f11700 1 Processor -- start 2023-11-30T23:12:56.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.071+0000 7f7508f11700 1 -- start start 2023-11-30T23:12:56.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.075+0000 7f48a6ffd700 1 -- 172.21.15.73:0/4250653051 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f48b00509e0 con 0x7f48b80b12b0 2023-11-30T23:12:56.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.075+0000 7f7508f11700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7504072440 0x7f750413aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f7508f11700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75040b0e80 0x7f75041d7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f7508f11700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75040b1260 0x7f75041db1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f7508f11700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75041d78c0 con 0x7f75040b0e80 2023-11-30T23:12:56.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f7508f11700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750413d030 con 0x7f75040b1260 2023-11-30T23:12:56.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f7508f11700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75041d7590 con 0x7f7504072440 2023-11-30T23:12:56.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f7502ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75040b0e80 0x7f75041d7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f7502ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75040b0e80 0x7f75041d7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38498/0 (socket says 172.21.15.73:38498) 2023-11-30T23:12:56.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f7502ffd700 1 -- 172.21.15.73:0/2884576403 learned_addr learned my addr 172.21.15.73:0/2884576403 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:56.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f7503fff700 1 --2- 172.21.15.73:0/2884576403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75040b1260 0x7f75041db1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f75037fe700 1 --2- 172.21.15.73:0/2884576403 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7504072440 0x7f750413aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f7502ffd700 1 -- 172.21.15.73:0/2884576403 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7504072440 msgr2=0x7f750413aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f7502ffd700 1 --2- 172.21.15.73:0/2884576403 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7504072440 0x7f750413aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f7502ffd700 1 -- 172.21.15.73:0/2884576403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75040b1260 msgr2=0x7f75041db1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f7502ffd700 1 --2- 172.21.15.73:0/2884576403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75040b1260 0x7f75041db1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f7502ffd700 1 -- 172.21.15.73:0/2884576403 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f4009570 con 0x7f75040b0e80 2023-11-30T23:12:56.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f75037fe700 1 --2- 172.21.15.73:0/2884576403 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7504072440 0x7f750413aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:12:56.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f7503fff700 1 --2- 172.21.15.73:0/2884576403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75040b1260 0x7f75041db1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:56.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f7502ffd700 1 --2- 172.21.15.73:0/2884576403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75040b0e80 0x7f75041d7d50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f74f800b580 tx=0x7f74f800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f74ebfff700 1 -- 172.21.15.73:0/2884576403 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8011830 con 0x7f75040b0e80 2023-11-30T23:12:56.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.079+0000 7f74ebfff700 1 -- 172.21.15.73:0/2884576403 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f8011990 con 0x7f75040b0e80 2023-11-30T23:12:56.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.083+0000 7f74ebfff700 1 -- 172.21.15.73:0/2884576403 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8011d40 con 0x7f75040b0e80 2023-11-30T23:12:56.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.083+0000 7f7508f11700 1 -- 172.21.15.73:0/2884576403 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7504070190 con 0x7f75040b0e80 2023-11-30T23:12:56.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.083+0000 7f7508f11700 1 -- 172.21.15.73:0/2884576403 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7504070b60 con 0x7f75040b0e80 2023-11-30T23:12:56.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.087+0000 7f7508f11700 1 -- 172.21.15.73:0/2884576403 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75040681c0 con 0x7f75040b0e80 2023-11-30T23:12:56.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.095+0000 7f74ebfff700 1 -- 172.21.15.73:0/2884576403 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f74f801a400 con 0x7f75040b0e80 2023-11-30T23:12:56.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.099+0000 7f74ebfff700 1 --2- 172.21.15.73:0/2884576403 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f74f0065b00 0x7f74f0067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.099+0000 7f74ebfff700 1 -- 172.21.15.73:0/2884576403 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74f8083710 con 0x7f75040b0e80 2023-11-30T23:12:56.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.099+0000 7f75037fe700 1 --2- 172.21.15.73:0/2884576403 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f74f0065b00 0x7f74f0067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.099+0000 7f74ebfff700 1 -- 172.21.15.73:0/2884576403 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f74f8083b90 con 0x7f75040b0e80 2023-11-30T23:12:56.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.099+0000 7f75037fe700 1 --2- 172.21.15.73:0/2884576403 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f74f0065b00 0x7f74f0067fc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f750413c510 tx=0x7f74fc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.275+0000 7f30a6782700 1 -- 172.21.15.73:0/4272181175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f30800055c0 con 0x7f30a00b1260 2023-11-30T23:12:56.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.279+0000 7f309cff9700 1 -- 172.21.15.73:0/4272181175 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3098054830 con 0x7f30a00b1260 2023-11-30T23:12:56.284 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2023-11-30T23:12:56.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.283+0000 7f30867fc700 1 -- 172.21.15.73:0/4272181175 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3088065d40 msgr2=0x7f3088068200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.283+0000 7f30867fc700 1 --2- 172.21.15.73:0/4272181175 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3088065d40 0x7f3088068200 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3090009fd0 tx=0x7f3090008030 comp rx=0 tx=0).stop 2023-11-30T23:12:56.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.283+0000 7f30867fc700 1 -- 172.21.15.73:0/4272181175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a00b1260 msgr2=0x7f30a013aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.283+0000 7f30867fc700 1 --2- 172.21.15.73:0/4272181175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a00b1260 0x7f30a013aae0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f309800fd20 tx=0x7f309800e440 comp rx=0 tx=0).stop 2023-11-30T23:12:56.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.283+0000 7f30867fc700 1 -- 172.21.15.73:0/4272181175 shutdown_connections 2023-11-30T23:12:56.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.283+0000 7f30867fc700 1 --2- 172.21.15.73:0/4272181175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a00b1260 0x7f30a013aae0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.283+0000 7f30867fc700 1 --2- 172.21.15.73:0/4272181175 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f30a00b0e80 0x7f30a00b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.283+0000 7f30867fc700 1 --2- 172.21.15.73:0/4272181175 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3088065d40 0x7f3088068200 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.283+0000 7f30867fc700 1 --2- 172.21.15.73:0/4272181175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30a0072440 0x7f30a013f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.283+0000 7f30867fc700 1 -- 172.21.15.73:0/4272181175 >> 172.21.15.73:0/4272181175 conn(0x7f30a006ab90 msgr2=0x7f30a013be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:56.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.283+0000 7f30867fc700 1 -- 172.21.15.73:0/4272181175 shutdown_connections 2023-11-30T23:12:56.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.283+0000 7f30867fc700 1 -- 172.21.15.73:0/4272181175 wait complete. 2023-11-30T23:12:56.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.3 2023-11-30T23:12:56.301 DEBUG:teuthology.parallel:result is None 2023-11-30T23:12:56.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.307+0000 7eff2d382700 1 -- 172.21.15.73:0/850495081 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7eff08005890 con 0x7eff280b1260 2023-11-30T23:12:56.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.307+0000 7eff24ff9700 1 -- 172.21.15.73:0/850495081 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff1c009220 con 0x7eff280b1260 2023-11-30T23:12:56.311 INFO:teuthology.orchestra.run.smithi073.stdout:55834574856 2023-11-30T23:12:56.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.311+0000 7eff2d382700 1 -- 172.21.15.73:0/850495081 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7eff14065bd0 msgr2=0x7eff14068090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.311+0000 7eff2d382700 1 --2- 172.21.15.73:0/850495081 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7eff14065bd0 0x7eff14068090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7eff18009990 tx=0x7eff18008040 comp rx=0 tx=0).stop 2023-11-30T23:12:56.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.311+0000 7eff2d382700 1 -- 172.21.15.73:0/850495081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff280b1260 msgr2=0x7eff281de6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.311+0000 7eff2d382700 1 --2- 172.21.15.73:0/850495081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff280b1260 0x7eff281de6f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00b440 tx=0x7eff1c00b800 comp rx=0 tx=0).stop 2023-11-30T23:12:56.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.311+0000 7eff2d382700 1 -- 172.21.15.73:0/850495081 shutdown_connections 2023-11-30T23:12:56.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.311+0000 7eff2d382700 1 --2- 172.21.15.73:0/850495081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff280b1260 0x7eff281de6f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.311+0000 7eff2d382700 1 --2- 172.21.15.73:0/850495081 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7eff14065bd0 0x7eff14068090 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.311+0000 7eff2d382700 1 --2- 172.21.15.73:0/850495081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff280b0e80 0x7eff281cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.311+0000 7eff2d382700 1 --2- 172.21.15.73:0/850495081 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7eff28072440 0x7eff281cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.311+0000 7eff2d382700 1 -- 172.21.15.73:0/850495081 >> 172.21.15.73:0/850495081 conn(0x7eff2806ab90 msgr2=0x7eff280b7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:56.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.311+0000 7eff2d382700 1 -- 172.21.15.73:0/850495081 shutdown_connections 2023-11-30T23:12:56.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.311+0000 7eff2d382700 1 -- 172.21.15.73:0/850495081 wait complete. 2023-11-30T23:12:56.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.2 2023-11-30T23:12:56.328 DEBUG:teuthology.parallel:result is None 2023-11-30T23:12:56.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.327+0000 7ff855c8c700 1 -- 172.21.15.73:0/172597821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff85004ed80 con 0x7ff8500b0bb0 2023-11-30T23:12:56.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.327+0000 7ff84d7fa700 1 -- 172.21.15.73:0/172597821 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff840017030 con 0x7ff8500b0bb0 2023-11-30T23:12:56.330 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2023-11-30T23:12:56.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.327+0000 7ff855c8c700 1 -- 172.21.15.73:0/172597821 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff83c065b00 msgr2=0x7ff83c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.327+0000 7ff855c8c700 1 --2- 172.21.15.73:0/172597821 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff83c065b00 0x7ff83c067fc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff850147430 tx=0x7ff844008040 comp rx=0 tx=0).stop 2023-11-30T23:12:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.327+0000 7ff855c8c700 1 -- 172.21.15.73:0/172597821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8500b0bb0 msgr2=0x7ff85014dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.327+0000 7ff855c8c700 1 --2- 172.21.15.73:0/172597821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8500b0bb0 0x7ff85014dc30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff84000c700 tx=0x7ff84000cac0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.327+0000 7ff855c8c700 1 -- 172.21.15.73:0/172597821 shutdown_connections 2023-11-30T23:12:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.327+0000 7ff855c8c700 1 --2- 172.21.15.73:0/172597821 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff850144800 0x7ff850145380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.327+0000 7ff855c8c700 1 --2- 172.21.15.73:0/172597821 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff83c065b00 0x7ff83c067fc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.327+0000 7ff855c8c700 1 --2- 172.21.15.73:0/172597821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8500b24a0 0x7ff8501e3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.327+0000 7ff855c8c700 1 --2- 172.21.15.73:0/172597821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8500b0bb0 0x7ff85014dc30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.327+0000 7ff855c8c700 1 -- 172.21.15.73:0/172597821 >> 172.21.15.73:0/172597821 conn(0x7ff85006ab90 msgr2=0x7ff8500af6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.327+0000 7ff855c8c700 1 -- 172.21.15.73:0/172597821 shutdown_connections 2023-11-30T23:12:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.327+0000 7ff855c8c700 1 -- 172.21.15.73:0/172597821 wait complete. 2023-11-30T23:12:56.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.335+0000 7f0a34bea700 1 -- 172.21.15.73:0/2643022305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0a14005890 con 0x7f0a3014e1f0 2023-11-30T23:12:56.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.335+0000 7f0a1effd700 1 -- 172.21.15.73:0/2643022305 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0a20015090 con 0x7f0a3014e1f0 2023-11-30T23:12:56.341 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2023-11-30T23:12:56.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.4 2023-11-30T23:12:56.343 DEBUG:teuthology.parallel:result is None 2023-11-30T23:12:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.339+0000 7f0a34bea700 1 -- 172.21.15.73:0/2643022305 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0a10065ad0 msgr2=0x7f0a10067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.339+0000 7f0a34bea700 1 --2- 172.21.15.73:0/2643022305 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0a10065ad0 0x7f0a10067f90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0a24009b50 tx=0x7f0a24009240 comp rx=0 tx=0).stop 2023-11-30T23:12:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.339+0000 7f0a34bea700 1 -- 172.21.15.73:0/2643022305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a3014e1f0 msgr2=0x7f0a301ebc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.339+0000 7f0a34bea700 1 --2- 172.21.15.73:0/2643022305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a3014e1f0 0x7f0a301ebc60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009f70 tx=0x7f0a20004770 comp rx=0 tx=0).stop 2023-11-30T23:12:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.339+0000 7f0a34bea700 1 -- 172.21.15.73:0/2643022305 shutdown_connections 2023-11-30T23:12:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.339+0000 7f0a34bea700 1 --2- 172.21.15.73:0/2643022305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a3014e1f0 0x7f0a301ebc60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.339+0000 7f0a34bea700 1 --2- 172.21.15.73:0/2643022305 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0a300b24a0 0x7f0a300b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.339+0000 7f0a34bea700 1 --2- 172.21.15.73:0/2643022305 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0a10065ad0 0x7f0a10067f90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.339+0000 7f0a34bea700 1 --2- 172.21.15.73:0/2643022305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a300afcc0 0x7f0a301de910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.339+0000 7f0a34bea700 1 -- 172.21.15.73:0/2643022305 >> 172.21.15.73:0/2643022305 conn(0x7f0a300b45a0 msgr2=0x7f0a30142240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:56.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.339+0000 7f0a34bea700 1 -- 172.21.15.73:0/2643022305 shutdown_connections 2023-11-30T23:12:56.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.339+0000 7f0a34bea700 1 -- 172.21.15.73:0/2643022305 wait complete. 2023-11-30T23:12:56.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.6 2023-11-30T23:12:56.357 DEBUG:teuthology.parallel:result is None 2023-11-30T23:12:56.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.355+0000 7fb4a1a66700 1 -- 172.21.15.73:0/196226066 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb49c071470 con 0x7fb49c144b80 2023-11-30T23:12:56.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.355+0000 7fb4997fa700 1 -- 172.21.15.73:0/196226066 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb48c053e80 con 0x7fb49c144b80 2023-11-30T23:12:56.360 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2023-11-30T23:12:56.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fb4a1a66700 1 -- 172.21.15.73:0/196226066 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb484065bc0 msgr2=0x7fb484068080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fb4a1a66700 1 --2- 172.21.15.73:0/196226066 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb484065bc0 0x7fb484068080 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb490005930 tx=0x7fb490009040 comp rx=0 tx=0).stop 2023-11-30T23:12:56.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fb4a1a66700 1 -- 172.21.15.73:0/196226066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb49c144b80 msgr2=0x7fb49c12fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fb4a1a66700 1 --2- 172.21.15.73:0/196226066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb49c144b80 0x7fb49c12fc20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00c780 tx=0x7fb48c00cb40 comp rx=0 tx=0).stop 2023-11-30T23:12:56.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fb4a1a66700 1 -- 172.21.15.73:0/196226066 shutdown_connections 2023-11-30T23:12:56.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fb4a1a66700 1 --2- 172.21.15.73:0/196226066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb49c144b80 0x7fb49c12fc20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fb4a1a66700 1 --2- 172.21.15.73:0/196226066 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb484065bc0 0x7fb484068080 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fb4a1a66700 1 --2- 172.21.15.73:0/196226066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb49c0b1420 0x7fb49c12f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fb4a1a66700 1 --2- 172.21.15.73:0/196226066 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb49c06efb0 0x7fb49c0b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fb4a1a66700 1 -- 172.21.15.73:0/196226066 >> 172.21.15.73:0/196226066 conn(0x7fb49c06ab90 msgr2=0x7fb49c13dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:56.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fb4a1a66700 1 -- 172.21.15.73:0/196226066 shutdown_connections 2023-11-30T23:12:56.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fb4a1a66700 1 -- 172.21.15.73:0/196226066 wait complete. 2023-11-30T23:12:56.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fa68759e700 1 -- 172.21.15.73:0/606516758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa68813ffe0 con 0x7fa6880afab0 2023-11-30T23:12:56.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fa676ffd700 1 -- 172.21.15.73:0/606516758 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa678053ed0 con 0x7fa6880afab0 2023-11-30T23:12:56.364 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2023-11-30T23:12:56.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fa68759e700 1 -- 172.21.15.73:0/606516758 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa668065ad0 msgr2=0x7fa668067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fa68759e700 1 --2- 172.21.15.73:0/606516758 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa668065ad0 0x7fa668067f90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009ae0 tx=0x7fa67c008030 comp rx=0 tx=0).stop 2023-11-30T23:12:56.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fa68759e700 1 -- 172.21.15.73:0/606516758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6880afab0 msgr2=0x7fa6881dba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fa68759e700 1 --2- 172.21.15.73:0/606516758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6880afab0 0x7fa6881dba90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa67800c4e0 tx=0x7fa67800c7f0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fa68759e700 1 -- 172.21.15.73:0/606516758 shutdown_connections 2023-11-30T23:12:56.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fa68759e700 1 --2- 172.21.15.73:0/606516758 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa6880b1260 0x7fa6881dfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fa68759e700 1 --2- 172.21.15.73:0/606516758 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa668065ad0 0x7fa668067f90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fa68759e700 1 --2- 172.21.15.73:0/606516758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6880b0e80 0x7fa6881cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fa68759e700 1 --2- 172.21.15.73:0/606516758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6880afab0 0x7fa6881dba90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.359+0000 7fa68759e700 1 -- 172.21.15.73:0/606516758 >> 172.21.15.73:0/606516758 conn(0x7fa68806ab90 msgr2=0x7fa6880acf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:56.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.363+0000 7fa68759e700 1 -- 172.21.15.73:0/606516758 shutdown_connections 2023-11-30T23:12:56.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.363+0000 7fa68759e700 1 -- 172.21.15.73:0/606516758 wait complete. 2023-11-30T23:12:56.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.0 2023-11-30T23:12:56.373 DEBUG:teuthology.parallel:result is None 2023-11-30T23:12:56.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.5 2023-11-30T23:12:56.376 DEBUG:teuthology.parallel:result is None 2023-11-30T23:12:56.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.387+0000 7f48bc999700 1 -- 172.21.15.73:0/4250653051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f48b8147fe0 con 0x7f48b80b12b0 2023-11-30T23:12:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.387+0000 7f48a6ffd700 1 -- 172.21.15.73:0/4250653051 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48b8147fe0 con 0x7f48b80b12b0 2023-11-30T23:12:56.393 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2023-11-30T23:12:56.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.391+0000 7f48bc999700 1 -- 172.21.15.73:0/4250653051 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f4898065ad0 msgr2=0x7f4898067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.391+0000 7f48bc999700 1 --2- 172.21.15.73:0/4250653051 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f4898065ad0 0x7f4898067f90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f48a8006fd0 tx=0x7f48a8009190 comp rx=0 tx=0).stop 2023-11-30T23:12:56.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.391+0000 7f48bc999700 1 -- 172.21.15.73:0/4250653051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48b80b12b0 msgr2=0x7f48b81482c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.391+0000 7f48bc999700 1 --2- 172.21.15.73:0/4250653051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48b80b12b0 0x7f48b81482c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f48b000cad0 tx=0x7f48b000cde0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.391+0000 7f48bc999700 1 -- 172.21.15.73:0/4250653051 shutdown_connections 2023-11-30T23:12:56.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.391+0000 7f48bc999700 1 --2- 172.21.15.73:0/4250653051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48b80b12b0 0x7f48b81482c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.391+0000 7f48bc999700 1 --2- 172.21.15.73:0/4250653051 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f4898065ad0 0x7f4898067f90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.391+0000 7f48bc999700 1 --2- 172.21.15.73:0/4250653051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48b80ae720 0x7f48b81e90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.391+0000 7f48bc999700 1 --2- 172.21.15.73:0/4250653051 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f48b80adc60 0x7f48b81df650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.391+0000 7f48bc999700 1 -- 172.21.15.73:0/4250653051 >> 172.21.15.73:0/4250653051 conn(0x7f48b806a360 msgr2=0x7f48b80b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:56.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.391+0000 7f48bc999700 1 -- 172.21.15.73:0/4250653051 shutdown_connections 2023-11-30T23:12:56.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.391+0000 7f48bc999700 1 -- 172.21.15.73:0/4250653051 wait complete. 2023-11-30T23:12:56.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.395+0000 7f7508f11700 1 -- 172.21.15.73:0/2884576403 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f750404ed80 con 0x7f75040b0e80 2023-11-30T23:12:56.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.395+0000 7f74ebfff700 1 -- 172.21.15.73:0/2884576403 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74f8051140 con 0x7f75040b0e80 2023-11-30T23:12:56.400 INFO:teuthology.orchestra.run.smithi073.stdout:55834574856 2023-11-30T23:12:56.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.399+0000 7f7508f11700 1 -- 172.21.15.73:0/2884576403 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f74f0065b00 msgr2=0x7f74f0067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.399+0000 7f7508f11700 1 --2- 172.21.15.73:0/2884576403 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f74f0065b00 0x7f74f0067fc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f750413c510 tx=0x7f74fc00b040 comp rx=0 tx=0).stop 2023-11-30T23:12:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.399+0000 7f7508f11700 1 -- 172.21.15.73:0/2884576403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75040b0e80 msgr2=0x7f75041d7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.399+0000 7f7508f11700 1 --2- 172.21.15.73:0/2884576403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75040b0e80 0x7f75041d7d50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f74f800b580 tx=0x7f74f800b890 comp rx=0 tx=0).stop 2023-11-30T23:12:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.399+0000 7f7508f11700 1 -- 172.21.15.73:0/2884576403 shutdown_connections 2023-11-30T23:12:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.399+0000 7f7508f11700 1 --2- 172.21.15.73:0/2884576403 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f74f0065b00 0x7f74f0067fc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.399+0000 7f7508f11700 1 --2- 172.21.15.73:0/2884576403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75040b1260 0x7f75041db1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.399+0000 7f7508f11700 1 --2- 172.21.15.73:0/2884576403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75040b0e80 0x7f75041d7d50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.399+0000 7f7508f11700 1 --2- 172.21.15.73:0/2884576403 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f7504072440 0x7f750413aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.399+0000 7f7508f11700 1 -- 172.21.15.73:0/2884576403 >> 172.21.15.73:0/2884576403 conn(0x7f750406ab90 msgr2=0x7f75040b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.399+0000 7f7508f11700 1 -- 172.21.15.73:0/2884576403 shutdown_connections 2023-11-30T23:12:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.399+0000 7f7508f11700 1 -- 172.21.15.73:0/2884576403 wait complete. 2023-11-30T23:12:56.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.7 2023-11-30T23:12:56.409 DEBUG:teuthology.parallel:result is None 2023-11-30T23:12:56.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.1 2023-11-30T23:12:56.413 DEBUG:teuthology.parallel:result is None 2023-11-30T23:12:56.414 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-30T23:12:56.414 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T23:12:56.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.563+0000 7f61a25ad700 1 Processor -- start 2023-11-30T23:12:56.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.563+0000 7f61a25ad700 1 -- start start 2023-11-30T23:12:56.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.563+0000 7f61a25ad700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f61940374b0 0x7f6194029ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.563+0000 7f61a25ad700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f61940ca4e0 0x7f61940c4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.563+0000 7f61a25ad700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619402ae30 con 0x7f61940c49a0 2023-11-30T23:12:56.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.563+0000 7f61a25ad700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6194037890 con 0x7f61940ca4e0 2023-11-30T23:12:56.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.563+0000 7f61a25ad700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619402ab50 con 0x7f61940374b0 2023-11-30T23:12:56.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.563+0000 7f61a0daa700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f61940ca4e0 0x7f61940c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f61a0daa700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f61940ca4e0 0x7f61940c4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38506/0 (socket says 172.21.15.73:38506) 2023-11-30T23:12:56.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f61a0daa700 1 -- 172.21.15.73:0/1627304122 learned_addr learned my addr 172.21.15.73:0/1627304122 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:56.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f61a15ab700 1 --2- 172.21.15.73:0/1627304122 >> v2:172.21.15.156:3300/0 conn(0x7f61940374b0 0x7f6194029ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f61a0daa700 1 -- 172.21.15.73:0/1627304122 >> v2:172.21.15.156:3300/0 conn(0x7f61940374b0 msgr2=0x7f6194029ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:56.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f61a0daa700 1 --2- 172.21.15.73:0/1627304122 >> v2:172.21.15.156:3300/0 conn(0x7f61940374b0 0x7f6194029ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f61a0daa700 1 -- 172.21.15.73:0/1627304122 >> v1:172.21.15.156:6789/0 conn(0x7f61940c49a0 legacy=0x7f61940cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f61a0daa700 1 -- 172.21.15.73:0/1627304122 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6194039d60 con 0x7f61940ca4e0 2023-11-30T23:12:56.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f61a0daa700 1 --2- 172.21.15.73:0/1627304122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61940ca4e0 0x7f61940c4460 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6194037ec0 tx=0x7f618c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbde19ecb57b3787 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f6193fff700 1 -- 172.21.15.73:0/1627304122 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c011830 con 0x7f61940ca4e0 2023-11-30T23:12:56.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f6193fff700 1 -- 172.21.15.73:0/1627304122 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618c011990 con 0x7f61940ca4e0 2023-11-30T23:12:56.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f6193fff700 1 -- 172.21.15.73:0/1627304122 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c011d20 con 0x7f61940ca4e0 2023-11-30T23:12:56.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f61a25ad700 1 -- 172.21.15.73:0/1627304122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61940ca4e0 msgr2=0x7f61940c4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f61a25ad700 1 --2- 172.21.15.73:0/1627304122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61940ca4e0 0x7f61940c4460 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6194037ec0 tx=0x7f618c009bf0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f61a25ad700 1 -- 172.21.15.73:0/1627304122 shutdown_connections 2023-11-30T23:12:56.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f61a25ad700 1 --2- 172.21.15.73:0/1627304122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61940ca4e0 0x7f61940c4460 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f61a25ad700 1 --2- 172.21.15.73:0/1627304122 >> v2:172.21.15.156:3300/0 conn(0x7f61940374b0 0x7f6194029ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f61a25ad700 1 -- 172.21.15.73:0/1627304122 >> 172.21.15.73:0/1627304122 conn(0x7f619403ad30 msgr2=0x7f61940060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:56.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f61a25ad700 1 -- 172.21.15.73:0/1627304122 shutdown_connections 2023-11-30T23:12:56.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f61a25ad700 1 -- 172.21.15.73:0/1627304122 wait complete. 2023-11-30T23:12:56.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f61a25ad700 1 Processor -- start 2023-11-30T23:12:56.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.567+0000 7f61a25ad700 1 -- start start 2023-11-30T23:12:56.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a25ad700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61940374b0 0x7f61940c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a25ad700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61940c49a0 0x7f61940bbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a25ad700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61940ca4e0 0x7f61940c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a25ad700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61940c5a30 con 0x7f61940374b0 2023-11-30T23:12:56.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a25ad700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61940c5ec0 con 0x7f61940ca4e0 2023-11-30T23:12:56.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a25ad700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61940c6c00 con 0x7f61940c49a0 2023-11-30T23:12:56.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a15ab700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61940374b0 0x7f61940c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a15ab700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61940374b0 0x7f61940c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38514/0 (socket says 172.21.15.73:38514) 2023-11-30T23:12:56.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a15ab700 1 -- 172.21.15.73:0/1670752865 learned_addr learned my addr 172.21.15.73:0/1670752865 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:56.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a1dac700 1 --2- 172.21.15.73:0/1670752865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61940ca4e0 0x7f61940c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a0daa700 1 --2- 172.21.15.73:0/1670752865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61940c49a0 0x7f61940bbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a15ab700 1 -- 172.21.15.73:0/1670752865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61940c49a0 msgr2=0x7f61940bbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a15ab700 1 --2- 172.21.15.73:0/1670752865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61940c49a0 0x7f61940bbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a15ab700 1 -- 172.21.15.73:0/1670752865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61940ca4e0 msgr2=0x7f61940c32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a15ab700 1 --2- 172.21.15.73:0/1670752865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61940ca4e0 0x7f61940c32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a15ab700 1 -- 172.21.15.73:0/1670752865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c009570 con 0x7f61940374b0 2023-11-30T23:12:56.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a15ab700 1 --2- 172.21.15.73:0/1670752865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61940374b0 0x7f61940c65a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f619800e840 tx=0x7f619800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f6191ffb700 1 -- 172.21.15.73:0/1670752865 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61980095a0 con 0x7f61940374b0 2023-11-30T23:12:56.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f6191ffb700 1 -- 172.21.15.73:0/1670752865 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6198013680 con 0x7f61940374b0 2023-11-30T23:12:56.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a25ad700 1 -- 172.21.15.73:0/1670752865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61940c6ee0 con 0x7f61940374b0 2023-11-30T23:12:56.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f6191ffb700 1 -- 172.21.15.73:0/1670752865 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61980139f0 con 0x7f61940374b0 2023-11-30T23:12:56.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a25ad700 1 -- 172.21.15.73:0/1670752865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61940c56c0 con 0x7f61940374b0 2023-11-30T23:12:56.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.571+0000 7f61a25ad700 1 -- 172.21.15.73:0/1670752865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6194005570 con 0x7f61940374b0 2023-11-30T23:12:56.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.575+0000 7f6191ffb700 1 -- 172.21.15.73:0/1670752865 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6198013b50 con 0x7f61940374b0 2023-11-30T23:12:56.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.575+0000 7f6191ffb700 1 --2- 172.21.15.73:0/1670752865 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6180065b00 0x7f6180067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.575+0000 7f6191ffb700 1 -- 172.21.15.73:0/1670752865 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6198082f40 con 0x7f61940374b0 2023-11-30T23:12:56.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.575+0000 7f61a0daa700 1 --2- 172.21.15.73:0/1670752865 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6180065b00 0x7f6180067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.575+0000 7f61a0daa700 1 --2- 172.21.15.73:0/1670752865 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6180065b00 0x7f6180067fc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f618c009c30 tx=0x7f618c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.579+0000 7f6191ffb700 1 -- 172.21.15.73:0/1670752865 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f6198050990 con 0x7f61940374b0 2023-11-30T23:12:56.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.731+0000 7f61a25ad700 1 -- 172.21.15.73:0/1670752865 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f619402a7e0 con 0x7f6180065b00 2023-11-30T23:12:56.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.747+0000 7f6191ffb700 1 -- 172.21.15.73:0/1670752865 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264403 (secure 0 0 0) 0x7f618c011c00 con 0x7f6180065b00 2023-11-30T23:12:56.756 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:56.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.751+0000 7f61a25ad700 1 -- 172.21.15.73:0/1670752865 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6180065b00 msgr2=0x7f6180067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.751+0000 7f61a25ad700 1 --2- 172.21.15.73:0/1670752865 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6180065b00 0x7f6180067fc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f618c009c30 tx=0x7f618c008030 comp rx=0 tx=0).stop 2023-11-30T23:12:56.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.751+0000 7f61a25ad700 1 -- 172.21.15.73:0/1670752865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61940374b0 msgr2=0x7f61940c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.751+0000 7f61a25ad700 1 --2- 172.21.15.73:0/1670752865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61940374b0 0x7f61940c65a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f619800e840 tx=0x7f619800eb50 comp rx=0 tx=0).stop 2023-11-30T23:12:56.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.751+0000 7f61a25ad700 1 -- 172.21.15.73:0/1670752865 shutdown_connections 2023-11-30T23:12:56.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.751+0000 7f61a25ad700 1 --2- 172.21.15.73:0/1670752865 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6180065b00 0x7f6180067fc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.751+0000 7f61a25ad700 1 --2- 172.21.15.73:0/1670752865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61940ca4e0 0x7f61940c32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.751+0000 7f61a25ad700 1 --2- 172.21.15.73:0/1670752865 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f61940c49a0 0x7f61940bbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.751+0000 7f61a25ad700 1 --2- 172.21.15.73:0/1670752865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61940374b0 0x7f61940c65a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.751+0000 7f61a25ad700 1 -- 172.21.15.73:0/1670752865 >> 172.21.15.73:0/1670752865 conn(0x7f619403ad30 msgr2=0x7f61940beb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:56.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.751+0000 7f61a25ad700 1 -- 172.21.15.73:0/1670752865 shutdown_connections 2023-11-30T23:12:56.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.751+0000 7f61a25ad700 1 -- 172.21.15.73:0/1670752865 wait complete. 2023-11-30T23:12:56.759 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-11-30T23:12:56.770 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-30T23:12:56.351099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234824,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739896,"statfs":{"total":773094113280,"available":772853653504,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.863321"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951239+0000","last_change":"2023-11-30T23:12:47.514628+0000","last_active":"2023-11-30T23:12:48.951239+0000","last_peered":"2023-11-30T23:12:48.951239+0000","last_clean":"2023-11-30T23:12:48.951239+0000","last_became_active":"2023-11-30T23:12:47.512980+0000","last_became_peered":"2023-11-30T23:12:47.512980+0000","last_unstale":"2023-11-30T23:12:48.951239+0000","last_undegraded":"2023-11-30T23:12:48.951239+0000","last_fullsized":"2023-11-30T23:12:48.951239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:18:44.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493012+0000","last_change":"2023-11-30T23:12:47.511277+0000","last_active":"2023-11-30T23:12:48.493012+0000","last_peered":"2023-11-30T23:12:48.493012+0000","last_clean":"2023-11-30T23:12:48.493012+0000","last_became_active":"2023-11-30T23:12:47.508771+0000","last_became_peered":"2023-11-30T23:12:47.508771+0000","last_unstale":"2023-11-30T23:12:48.493012+0000","last_undegraded":"2023-11-30T23:12:48.493012+0000","last_fullsized":"2023-11-30T23:12:48.493012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492167+0000","last_change":"2023-11-30T23:12:47.508068+0000","last_active":"2023-11-30T23:12:48.492167+0000","last_peered":"2023-11-30T23:12:48.492167+0000","last_clean":"2023-11-30T23:12:48.492167+0000","last_became_active":"2023-11-30T23:12:47.507829+0000","last_became_peered":"2023-11-30T23:12:47.507829+0000","last_unstale":"2023-11-30T23:12:48.492167+0000","last_undegraded":"2023-11-30T23:12:48.492167+0000","last_fullsized":"2023-11-30T23:12:48.492167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:39.696562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950918+0000","last_change":"2023-11-30T23:12:47.522516+0000","last_active":"2023-11-30T23:12:48.950918+0000","last_peered":"2023-11-30T23:12:48.950918+0000","last_clean":"2023-11-30T23:12:48.950918+0000","last_became_active":"2023-11-30T23:12:47.522208+0000","last_became_peered":"2023-11-30T23:12:47.522208+0000","last_unstale":"2023-11-30T23:12:48.950918+0000","last_undegraded":"2023-11-30T23:12:48.950918+0000","last_fullsized":"2023-11-30T23:12:48.950918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950044+0000","last_change":"2023-11-30T23:12:47.507130+0000","last_active":"2023-11-30T23:12:48.950044+0000","last_peered":"2023-11-30T23:12:48.950044+0000","last_clean":"2023-11-30T23:12:48.950044+0000","last_became_active":"2023-11-30T23:12:47.506816+0000","last_became_peered":"2023-11-30T23:12:47.506816+0000","last_unstale":"2023-11-30T23:12:48.950044+0000","last_undegraded":"2023-11-30T23:12:48.950044+0000","last_fullsized":"2023-11-30T23:12:48.950044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:21:32.262322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950103+0000","last_change":"2023-11-30T23:12:47.514855+0000","last_active":"2023-11-30T23:12:48.950103+0000","last_peered":"2023-11-30T23:12:48.950103+0000","last_clean":"2023-11-30T23:12:48.950103+0000","last_became_active":"2023-11-30T23:12:47.513491+0000","last_became_peered":"2023-11-30T23:12:47.513491+0000","last_unstale":"2023-11-30T23:12:48.950103+0000","last_undegraded":"2023-11-30T23:12:48.950103+0000","last_fullsized":"2023-11-30T23:12:48.950103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:18:44.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948350+0000","last_change":"2023-11-30T23:12:47.508060+0000","last_active":"2023-11-30T23:12:48.948350+0000","last_peered":"2023-11-30T23:12:48.948350+0000","last_clean":"2023-11-30T23:12:48.948350+0000","last_became_active":"2023-11-30T23:12:47.507747+0000","last_became_peered":"2023-11-30T23:12:47.507747+0000","last_unstale":"2023-11-30T23:12:48.948350+0000","last_undegraded":"2023-11-30T23:12:48.948350+0000","last_fullsized":"2023-11-30T23:12:48.948350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:27.789422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948363+0000","last_change":"2023-11-30T23:12:47.523687+0000","last_active":"2023-11-30T23:12:48.948363+0000","last_peered":"2023-11-30T23:12:48.948363+0000","last_clean":"2023-11-30T23:12:48.948363+0000","last_became_active":"2023-11-30T23:12:47.523430+0000","last_became_peered":"2023-11-30T23:12:47.523430+0000","last_unstale":"2023-11-30T23:12:48.948363+0000","last_undegraded":"2023-11-30T23:12:48.948363+0000","last_fullsized":"2023-11-30T23:12:48.948363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:26:33.640383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951748+0000","last_change":"2023-11-30T23:12:47.521698+0000","last_active":"2023-11-30T23:12:48.951748+0000","last_peered":"2023-11-30T23:12:48.951748+0000","last_clean":"2023-11-30T23:12:48.951748+0000","last_became_active":"2023-11-30T23:12:47.521393+0000","last_became_peered":"2023-11-30T23:12:47.521393+0000","last_unstale":"2023-11-30T23:12:48.951748+0000","last_undegraded":"2023-11-30T23:12:48.951748+0000","last_fullsized":"2023-11-30T23:12:48.951748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:23:17.254251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949276+0000","last_change":"2023-11-30T23:12:47.522937+0000","last_active":"2023-11-30T23:12:48.949276+0000","last_peered":"2023-11-30T23:12:48.949276+0000","last_clean":"2023-11-30T23:12:48.949276+0000","last_became_active":"2023-11-30T23:12:47.522618+0000","last_became_peered":"2023-11-30T23:12:47.522618+0000","last_unstale":"2023-11-30T23:12:48.949276+0000","last_undegraded":"2023-11-30T23:12:48.949276+0000","last_fullsized":"2023-11-30T23:12:48.949276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950146+0000","last_change":"2023-11-30T23:12:47.522869+0000","last_active":"2023-11-30T23:12:48.950146+0000","last_peered":"2023-11-30T23:12:48.950146+0000","last_clean":"2023-11-30T23:12:48.950146+0000","last_became_active":"2023-11-30T23:12:47.522552+0000","last_became_peered":"2023-11-30T23:12:47.522552+0000","last_unstale":"2023-11-30T23:12:48.950146+0000","last_undegraded":"2023-11-30T23:12:48.950146+0000","last_fullsized":"2023-11-30T23:12:48.950146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952576+0000","last_change":"2023-11-30T23:12:47.513660+0000","last_active":"2023-11-30T23:12:48.952576+0000","last_peered":"2023-11-30T23:12:48.952576+0000","last_clean":"2023-11-30T23:12:48.952576+0000","last_became_active":"2023-11-30T23:12:47.513401+0000","last_became_peered":"2023-11-30T23:12:47.513401+0000","last_unstale":"2023-11-30T23:12:48.952576+0000","last_undegraded":"2023-11-30T23:12:48.952576+0000","last_fullsized":"2023-11-30T23:12:48.952576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:22.086661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948954+0000","last_change":"2023-11-30T23:12:47.513995+0000","last_active":"2023-11-30T23:12:48.948954+0000","last_peered":"2023-11-30T23:12:48.948954+0000","last_clean":"2023-11-30T23:12:48.948954+0000","last_became_active":"2023-11-30T23:12:47.513714+0000","last_became_peered":"2023-11-30T23:12:47.513714+0000","last_unstale":"2023-11-30T23:12:48.948954+0000","last_undegraded":"2023-11-30T23:12:48.948954+0000","last_fullsized":"2023-11-30T23:12:48.948954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:20:31.102899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491646+0000","last_change":"2023-11-30T23:12:47.507240+0000","last_active":"2023-11-30T23:12:48.491646+0000","last_peered":"2023-11-30T23:12:48.491646+0000","last_clean":"2023-11-30T23:12:48.491646+0000","last_became_active":"2023-11-30T23:12:47.506967+0000","last_became_peered":"2023-11-30T23:12:47.506967+0000","last_unstale":"2023-11-30T23:12:48.491646+0000","last_undegraded":"2023-11-30T23:12:48.491646+0000","last_fullsized":"2023-11-30T23:12:48.491646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492735+0000","last_change":"2023-11-30T23:12:47.513430+0000","last_active":"2023-11-30T23:12:48.492735+0000","last_peered":"2023-11-30T23:12:48.492735+0000","last_clean":"2023-11-30T23:12:48.492735+0000","last_became_active":"2023-11-30T23:12:47.513018+0000","last_became_peered":"2023-11-30T23:12:47.513018+0000","last_unstale":"2023-11-30T23:12:48.492735+0000","last_undegraded":"2023-11-30T23:12:48.492735+0000","last_fullsized":"2023-11-30T23:12:48.492735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948206+0000","last_change":"2023-11-30T23:12:47.521933+0000","last_active":"2023-11-30T23:12:48.948206+0000","last_peered":"2023-11-30T23:12:48.948206+0000","last_clean":"2023-11-30T23:12:48.948206+0000","last_became_active":"2023-11-30T23:12:47.520518+0000","last_became_peered":"2023-11-30T23:12:47.520518+0000","last_unstale":"2023-11-30T23:12:48.948206+0000","last_undegraded":"2023-11-30T23:12:48.948206+0000","last_fullsized":"2023-11-30T23:12:48.948206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:27.789422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.953013+0000","last_change":"2023-11-30T23:12:47.516657+0000","last_active":"2023-11-30T23:12:48.953013+0000","last_peered":"2023-11-30T23:12:48.953013+0000","last_clean":"2023-11-30T23:12:48.953013+0000","last_became_active":"2023-11-30T23:12:47.516382+0000","last_became_peered":"2023-11-30T23:12:47.516382+0000","last_unstale":"2023-11-30T23:12:48.953013+0000","last_undegraded":"2023-11-30T23:12:48.953013+0000","last_fullsized":"2023-11-30T23:12:48.953013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:54:46.925262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.494119+0000","last_change":"2023-11-30T23:12:47.509616+0000","last_active":"2023-11-30T23:12:48.494119+0000","last_peered":"2023-11-30T23:12:48.494119+0000","last_clean":"2023-11-30T23:12:48.494119+0000","last_became_active":"2023-11-30T23:12:47.509340+0000","last_became_peered":"2023-11-30T23:12:47.509340+0000","last_unstale":"2023-11-30T23:12:48.494119+0000","last_undegraded":"2023-11-30T23:12:48.494119+0000","last_fullsized":"2023-11-30T23:12:48.494119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:29.167074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950366+0000","last_change":"2023-11-30T23:12:47.507039+0000","last_active":"2023-11-30T23:12:48.950366+0000","last_peered":"2023-11-30T23:12:48.950366+0000","last_clean":"2023-11-30T23:12:48.950366+0000","last_became_active":"2023-11-30T23:12:47.506733+0000","last_became_peered":"2023-11-30T23:12:47.506733+0000","last_unstale":"2023-11-30T23:12:48.950366+0000","last_undegraded":"2023-11-30T23:12:48.950366+0000","last_fullsized":"2023-11-30T23:12:48.950366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949761+0000","last_change":"2023-11-30T23:12:47.522534+0000","last_active":"2023-11-30T23:12:48.949761+0000","last_peered":"2023-11-30T23:12:48.949761+0000","last_clean":"2023-11-30T23:12:48.949761+0000","last_became_active":"2023-11-30T23:12:47.518819+0000","last_became_peered":"2023-11-30T23:12:47.518819+0000","last_unstale":"2023-11-30T23:12:48.949761+0000","last_undegraded":"2023-11-30T23:12:48.949761+0000","last_fullsized":"2023-11-30T23:12:48.949761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491549+0000","last_change":"2023-11-30T23:12:47.514472+0000","last_active":"2023-11-30T23:12:48.491549+0000","last_peered":"2023-11-30T23:12:48.491549+0000","last_clean":"2023-11-30T23:12:48.491549+0000","last_became_active":"2023-11-30T23:12:47.514223+0000","last_became_peered":"2023-11-30T23:12:47.514223+0000","last_unstale":"2023-11-30T23:12:48.491549+0000","last_undegraded":"2023-11-30T23:12:48.491549+0000","last_fullsized":"2023-11-30T23:12:48.491549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:34:32.232378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950329+0000","last_change":"2023-11-30T23:12:47.520514+0000","last_active":"2023-11-30T23:12:48.950329+0000","last_peered":"2023-11-30T23:12:48.950329+0000","last_clean":"2023-11-30T23:12:48.950329+0000","last_became_active":"2023-11-30T23:12:47.520228+0000","last_became_peered":"2023-11-30T23:12:47.520228+0000","last_unstale":"2023-11-30T23:12:48.950329+0000","last_undegraded":"2023-11-30T23:12:48.950329+0000","last_fullsized":"2023-11-30T23:12:48.950329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:26:06.870586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948524+0000","last_change":"2023-11-30T23:12:47.515492+0000","last_active":"2023-11-30T23:12:48.948524+0000","last_peered":"2023-11-30T23:12:48.948524+0000","last_clean":"2023-11-30T23:12:48.948524+0000","last_became_active":"2023-11-30T23:12:47.515247+0000","last_became_peered":"2023-11-30T23:12:47.515247+0000","last_unstale":"2023-11-30T23:12:48.948524+0000","last_undegraded":"2023-11-30T23:12:48.948524+0000","last_fullsized":"2023-11-30T23:12:48.948524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948562+0000","last_change":"2023-11-30T23:12:47.511363+0000","last_active":"2023-11-30T23:12:48.948562+0000","last_peered":"2023-11-30T23:12:48.948562+0000","last_clean":"2023-11-30T23:12:48.948562+0000","last_became_active":"2023-11-30T23:12:47.511097+0000","last_became_peered":"2023-11-30T23:12:47.511097+0000","last_unstale":"2023-11-30T23:12:48.948562+0000","last_undegraded":"2023-11-30T23:12:48.948562+0000","last_fullsized":"2023-11-30T23:12:48.948562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949389+0000","last_change":"2023-11-30T23:12:47.510657+0000","last_active":"2023-11-30T23:12:48.949389+0000","last_peered":"2023-11-30T23:12:48.949389+0000","last_clean":"2023-11-30T23:12:48.949389+0000","last_became_active":"2023-11-30T23:12:47.510404+0000","last_became_peered":"2023-11-30T23:12:47.510404+0000","last_unstale":"2023-11-30T23:12:48.949389+0000","last_undegraded":"2023-11-30T23:12:48.949389+0000","last_fullsized":"2023-11-30T23:12:48.949389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949508+0000","last_change":"2023-11-30T23:12:47.516808+0000","last_active":"2023-11-30T23:12:48.949508+0000","last_peered":"2023-11-30T23:12:48.949508+0000","last_clean":"2023-11-30T23:12:48.949508+0000","last_became_active":"2023-11-30T23:12:47.516539+0000","last_became_peered":"2023-11-30T23:12:47.516539+0000","last_unstale":"2023-11-30T23:12:48.949508+0000","last_undegraded":"2023-11-30T23:12:48.949508+0000","last_fullsized":"2023-11-30T23:12:48.949508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493067+0000","last_change":"2023-11-30T23:12:47.506558+0000","last_active":"2023-11-30T23:12:48.493067+0000","last_peered":"2023-11-30T23:12:48.493067+0000","last_clean":"2023-11-30T23:12:48.493067+0000","last_became_active":"2023-11-30T23:12:47.506284+0000","last_became_peered":"2023-11-30T23:12:47.506284+0000","last_unstale":"2023-11-30T23:12:48.493067+0000","last_undegraded":"2023-11-30T23:12:48.493067+0000","last_fullsized":"2023-11-30T23:12:48.493067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949214+0000","last_change":"2023-11-30T23:12:47.512060+0000","last_active":"2023-11-30T23:12:48.949214+0000","last_peered":"2023-11-30T23:12:48.949214+0000","last_clean":"2023-11-30T23:12:48.949214+0000","last_became_active":"2023-11-30T23:12:47.511800+0000","last_became_peered":"2023-11-30T23:12:47.511800+0000","last_unstale":"2023-11-30T23:12:48.949214+0000","last_undegraded":"2023-11-30T23:12:48.949214+0000","last_fullsized":"2023-11-30T23:12:48.949214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491631+0000","last_change":"2023-11-30T23:12:47.513225+0000","last_active":"2023-11-30T23:12:48.491631+0000","last_peered":"2023-11-30T23:12:48.491631+0000","last_clean":"2023-11-30T23:12:48.491631+0000","last_became_active":"2023-11-30T23:12:47.512978+0000","last_became_peered":"2023-11-30T23:12:47.512978+0000","last_unstale":"2023-11-30T23:12:48.491631+0000","last_undegraded":"2023-11-30T23:12:48.491631+0000","last_fullsized":"2023-11-30T23:12:48.491631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950359+0000","last_change":"2023-11-30T23:12:47.511972+0000","last_active":"2023-11-30T23:12:48.950359+0000","last_peered":"2023-11-30T23:12:48.950359+0000","last_clean":"2023-11-30T23:12:48.950359+0000","last_became_active":"2023-11-30T23:12:47.511699+0000","last_became_peered":"2023-11-30T23:12:47.511699+0000","last_unstale":"2023-11-30T23:12:48.950359+0000","last_undegraded":"2023-11-30T23:12:48.950359+0000","last_fullsized":"2023-11-30T23:12:48.950359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493146+0000","last_change":"2023-11-30T23:12:47.521874+0000","last_active":"2023-11-30T23:12:48.493146+0000","last_peered":"2023-11-30T23:12:48.493146+0000","last_clean":"2023-11-30T23:12:48.493146+0000","last_became_active":"2023-11-30T23:12:47.521604+0000","last_became_peered":"2023-11-30T23:12:47.521604+0000","last_unstale":"2023-11-30T23:12:48.493146+0000","last_undegraded":"2023-11-30T23:12:48.493146+0000","last_fullsized":"2023-11-30T23:12:48.493146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:02.220181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948617+0000","last_change":"2023-11-30T23:12:47.517728+0000","last_active":"2023-11-30T23:12:48.948617+0000","last_peered":"2023-11-30T23:12:48.948617+0000","last_clean":"2023-11-30T23:12:48.948617+0000","last_became_active":"2023-11-30T23:12:47.517283+0000","last_became_peered":"2023-11-30T23:12:47.517283+0000","last_unstale":"2023-11-30T23:12:48.948617+0000","last_undegraded":"2023-11-30T23:12:48.948617+0000","last_fullsized":"2023-11-30T23:12:48.948617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949668+0000","last_change":"2023-11-30T23:12:47.509055+0000","last_active":"2023-11-30T23:12:48.949668+0000","last_peered":"2023-11-30T23:12:48.949668+0000","last_clean":"2023-11-30T23:12:48.949668+0000","last_became_active":"2023-11-30T23:12:47.508725+0000","last_became_peered":"2023-11-30T23:12:47.508725+0000","last_unstale":"2023-11-30T23:12:48.949668+0000","last_undegraded":"2023-11-30T23:12:48.949668+0000","last_fullsized":"2023-11-30T23:12:48.949668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:54.893320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949177+0000","last_change":"2023-11-30T23:12:47.139071+0000","last_active":"2023-11-30T23:12:48.949177+0000","last_peered":"2023-11-30T23:12:48.949177+0000","last_clean":"2023-11-30T23:12:48.949177+0000","last_became_active":"2023-11-30T23:12:47.138768+0000","last_became_peered":"2023-11-30T23:12:47.138768+0000","last_unstale":"2023-11-30T23:12:48.949177+0000","last_undegraded":"2023-11-30T23:12:48.949177+0000","last_fullsized":"2023-11-30T23:12:48.949177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491791+0000","last_change":"2023-11-30T23:12:47.516574+0000","last_active":"2023-11-30T23:12:48.491791+0000","last_peered":"2023-11-30T23:12:48.491791+0000","last_clean":"2023-11-30T23:12:48.491791+0000","last_became_active":"2023-11-30T23:12:47.516214+0000","last_became_peered":"2023-11-30T23:12:47.516214+0000","last_unstale":"2023-11-30T23:12:48.491791+0000","last_undegraded":"2023-11-30T23:12:48.491791+0000","last_fullsized":"2023-11-30T23:12:48.491791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948803+0000","last_change":"2023-11-30T23:12:47.130416+0000","last_active":"2023-11-30T23:12:48.948803+0000","last_peered":"2023-11-30T23:12:48.948803+0000","last_clean":"2023-11-30T23:12:48.948803+0000","last_became_active":"2023-11-30T23:12:47.129771+0000","last_became_peered":"2023-11-30T23:12:47.129771+0000","last_unstale":"2023-11-30T23:12:48.948803+0000","last_undegraded":"2023-11-30T23:12:48.948803+0000","last_fullsized":"2023-11-30T23:12:48.948803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948794+0000","last_change":"2023-11-30T23:12:47.133733+0000","last_active":"2023-11-30T23:12:48.948794+0000","last_peered":"2023-11-30T23:12:48.948794+0000","last_clean":"2023-11-30T23:12:48.948794+0000","last_became_active":"2023-11-30T23:12:47.133440+0000","last_became_peered":"2023-11-30T23:12:47.133440+0000","last_unstale":"2023-11-30T23:12:48.948794+0000","last_undegraded":"2023-11-30T23:12:48.948794+0000","last_fullsized":"2023-11-30T23:12:48.948794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:48.913175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948507+0000","last_change":"2023-11-30T23:12:47.507868+0000","last_active":"2023-11-30T23:12:48.948507+0000","last_peered":"2023-11-30T23:12:48.948507+0000","last_clean":"2023-11-30T23:12:48.948507+0000","last_became_active":"2023-11-30T23:12:47.507617+0000","last_became_peered":"2023-11-30T23:12:47.507617+0000","last_unstale":"2023-11-30T23:12:48.948507+0000","last_undegraded":"2023-11-30T23:12:48.948507+0000","last_fullsized":"2023-11-30T23:12:48.948507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:08:47.117163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948855+0000","last_change":"2023-11-30T23:12:47.132638+0000","last_active":"2023-11-30T23:12:48.948855+0000","last_peered":"2023-11-30T23:12:48.948855+0000","last_clean":"2023-11-30T23:12:48.948855+0000","last_became_active":"2023-11-30T23:12:47.132351+0000","last_became_peered":"2023-11-30T23:12:47.132351+0000","last_unstale":"2023-11-30T23:12:48.948855+0000","last_undegraded":"2023-11-30T23:12:48.948855+0000","last_fullsized":"2023-11-30T23:12:48.948855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492595+0000","last_change":"2023-11-30T23:12:47.506332+0000","last_active":"2023-11-30T23:12:48.492595+0000","last_peered":"2023-11-30T23:12:48.492595+0000","last_clean":"2023-11-30T23:12:48.492595+0000","last_became_active":"2023-11-30T23:12:47.506082+0000","last_became_peered":"2023-11-30T23:12:47.506082+0000","last_unstale":"2023-11-30T23:12:48.492595+0000","last_undegraded":"2023-11-30T23:12:48.492595+0000","last_fullsized":"2023-11-30T23:12:48.492595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951065+0000","last_change":"2023-11-30T23:12:47.139722+0000","last_active":"2023-11-30T23:12:48.951065+0000","last_peered":"2023-11-30T23:12:48.951065+0000","last_clean":"2023-11-30T23:12:48.951065+0000","last_became_active":"2023-11-30T23:12:47.139400+0000","last_became_peered":"2023-11-30T23:12:47.139400+0000","last_unstale":"2023-11-30T23:12:48.951065+0000","last_undegraded":"2023-11-30T23:12:48.951065+0000","last_fullsized":"2023-11-30T23:12:48.951065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952521+0000","last_change":"2023-11-30T23:12:47.520429+0000","last_active":"2023-11-30T23:12:48.952521+0000","last_peered":"2023-11-30T23:12:48.952521+0000","last_clean":"2023-11-30T23:12:48.952521+0000","last_became_active":"2023-11-30T23:12:47.520153+0000","last_became_peered":"2023-11-30T23:12:47.520153+0000","last_unstale":"2023-11-30T23:12:48.952521+0000","last_undegraded":"2023-11-30T23:12:48.952521+0000","last_fullsized":"2023-11-30T23:12:48.952521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:17:01.774183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952510+0000","last_change":"2023-11-30T23:12:47.139328+0000","last_active":"2023-11-30T23:12:48.952510+0000","last_peered":"2023-11-30T23:12:48.952510+0000","last_clean":"2023-11-30T23:12:48.952510+0000","last_became_active":"2023-11-30T23:12:47.139047+0000","last_became_peered":"2023-11-30T23:12:47.139047+0000","last_unstale":"2023-11-30T23:12:48.952510+0000","last_undegraded":"2023-11-30T23:12:48.952510+0000","last_fullsized":"2023-11-30T23:12:48.952510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491614+0000","last_change":"2023-11-30T23:12:47.522974+0000","last_active":"2023-11-30T23:12:48.491614+0000","last_peered":"2023-11-30T23:12:48.491614+0000","last_clean":"2023-11-30T23:12:48.491614+0000","last_became_active":"2023-11-30T23:12:47.522711+0000","last_became_peered":"2023-11-30T23:12:47.522711+0000","last_unstale":"2023-11-30T23:12:48.491614+0000","last_undegraded":"2023-11-30T23:12:48.491614+0000","last_fullsized":"2023-11-30T23:12:48.491614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:19:43.387626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493283+0000","last_change":"2023-11-30T23:12:47.140794+0000","last_active":"2023-11-30T23:12:48.493283+0000","last_peered":"2023-11-30T23:12:48.493283+0000","last_clean":"2023-11-30T23:12:48.493283+0000","last_became_active":"2023-11-30T23:12:47.140531+0000","last_became_peered":"2023-11-30T23:12:47.140531+0000","last_unstale":"2023-11-30T23:12:48.493283+0000","last_undegraded":"2023-11-30T23:12:48.493283+0000","last_fullsized":"2023-11-30T23:12:48.493283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:53.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952707+0000","last_change":"2023-11-30T23:12:47.517475+0000","last_active":"2023-11-30T23:12:48.952707+0000","last_peered":"2023-11-30T23:12:48.952707+0000","last_clean":"2023-11-30T23:12:48.952707+0000","last_became_active":"2023-11-30T23:12:47.513983+0000","last_became_peered":"2023-11-30T23:12:47.513983+0000","last_unstale":"2023-11-30T23:12:48.952707+0000","last_undegraded":"2023-11-30T23:12:48.952707+0000","last_fullsized":"2023-11-30T23:12:48.952707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:39.696562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949883+0000","last_change":"2023-11-30T23:12:47.140168+0000","last_active":"2023-11-30T23:12:48.949883+0000","last_peered":"2023-11-30T23:12:48.949883+0000","last_clean":"2023-11-30T23:12:48.949883+0000","last_became_active":"2023-11-30T23:12:47.139799+0000","last_became_peered":"2023-11-30T23:12:47.139799+0000","last_unstale":"2023-11-30T23:12:48.949883+0000","last_undegraded":"2023-11-30T23:12:48.949883+0000","last_fullsized":"2023-11-30T23:12:48.949883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949684+0000","last_change":"2023-11-30T23:12:47.503606+0000","last_active":"2023-11-30T23:12:48.949684+0000","last_peered":"2023-11-30T23:12:48.949684+0000","last_clean":"2023-11-30T23:12:48.949684+0000","last_became_active":"2023-11-30T23:12:47.503333+0000","last_became_peered":"2023-11-30T23:12:47.503333+0000","last_unstale":"2023-11-30T23:12:48.949684+0000","last_undegraded":"2023-11-30T23:12:48.949684+0000","last_fullsized":"2023-11-30T23:12:48.949684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491844+0000","last_change":"2023-11-30T23:12:47.136931+0000","last_active":"2023-11-30T23:12:48.491844+0000","last_peered":"2023-11-30T23:12:48.491844+0000","last_clean":"2023-11-30T23:12:48.491844+0000","last_became_active":"2023-11-30T23:12:47.136620+0000","last_became_peered":"2023-11-30T23:12:47.136620+0000","last_unstale":"2023-11-30T23:12:48.491844+0000","last_undegraded":"2023-11-30T23:12:48.491844+0000","last_fullsized":"2023-11-30T23:12:48.491844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:22:43.069951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491335+0000","last_change":"2023-11-30T23:12:47.503541+0000","last_active":"2023-11-30T23:12:48.491335+0000","last_peered":"2023-11-30T23:12:48.491335+0000","last_clean":"2023-11-30T23:12:48.491335+0000","last_became_active":"2023-11-30T23:12:47.503294+0000","last_became_peered":"2023-11-30T23:12:47.503294+0000","last_unstale":"2023-11-30T23:12:48.491335+0000","last_undegraded":"2023-11-30T23:12:48.491335+0000","last_fullsized":"2023-11-30T23:12:48.491335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950583+0000","last_change":"2023-11-30T23:12:47.140575+0000","last_active":"2023-11-30T23:12:48.950583+0000","last_peered":"2023-11-30T23:12:48.950583+0000","last_clean":"2023-11-30T23:12:48.950583+0000","last_became_active":"2023-11-30T23:12:47.140125+0000","last_became_peered":"2023-11-30T23:12:47.140125+0000","last_unstale":"2023-11-30T23:12:48.950583+0000","last_undegraded":"2023-11-30T23:12:48.950583+0000","last_fullsized":"2023-11-30T23:12:48.950583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950166+0000","last_change":"2023-11-30T23:12:47.515720+0000","last_active":"2023-11-30T23:12:48.950166+0000","last_peered":"2023-11-30T23:12:48.950166+0000","last_clean":"2023-11-30T23:12:48.950166+0000","last_became_active":"2023-11-30T23:12:47.515427+0000","last_became_peered":"2023-11-30T23:12:47.515427+0000","last_unstale":"2023-11-30T23:12:48.950166+0000","last_undegraded":"2023-11-30T23:12:48.950166+0000","last_fullsized":"2023-11-30T23:12:48.950166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:26:06.870586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949198+0000","last_change":"2023-11-30T23:12:47.129492+0000","last_active":"2023-11-30T23:12:48.949198+0000","last_peered":"2023-11-30T23:12:48.949198+0000","last_clean":"2023-11-30T23:12:48.949198+0000","last_became_active":"2023-11-30T23:12:47.129180+0000","last_became_peered":"2023-11-30T23:12:47.129180+0000","last_unstale":"2023-11-30T23:12:48.949198+0000","last_undegraded":"2023-11-30T23:12:48.949198+0000","last_fullsized":"2023-11-30T23:12:48.949198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948802+0000","last_change":"2023-11-30T23:12:47.517541+0000","last_active":"2023-11-30T23:12:48.948802+0000","last_peered":"2023-11-30T23:12:48.948802+0000","last_clean":"2023-11-30T23:12:48.948802+0000","last_became_active":"2023-11-30T23:12:47.516980+0000","last_became_peered":"2023-11-30T23:12:47.516980+0000","last_unstale":"2023-11-30T23:12:48.948802+0000","last_undegraded":"2023-11-30T23:12:48.948802+0000","last_fullsized":"2023-11-30T23:12:48.948802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492929+0000","last_change":"2023-11-30T23:12:47.129703+0000","last_active":"2023-11-30T23:12:48.492929+0000","last_peered":"2023-11-30T23:12:48.492929+0000","last_clean":"2023-11-30T23:12:48.492929+0000","last_became_active":"2023-11-30T23:12:47.129349+0000","last_became_peered":"2023-11-30T23:12:47.129349+0000","last_unstale":"2023-11-30T23:12:48.492929+0000","last_undegraded":"2023-11-30T23:12:48.492929+0000","last_fullsized":"2023-11-30T23:12:48.492929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949277+0000","last_change":"2023-11-30T23:12:47.514610+0000","last_active":"2023-11-30T23:12:48.949277+0000","last_peered":"2023-11-30T23:12:48.949277+0000","last_clean":"2023-11-30T23:12:48.949277+0000","last_became_active":"2023-11-30T23:12:47.514140+0000","last_became_peered":"2023-11-30T23:12:47.514140+0000","last_unstale":"2023-11-30T23:12:48.949277+0000","last_undegraded":"2023-11-30T23:12:48.949277+0000","last_fullsized":"2023-11-30T23:12:48.949277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:54:46.925262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952235+0000","last_change":"2023-11-30T23:12:47.136924+0000","last_active":"2023-11-30T23:12:48.952235+0000","last_peered":"2023-11-30T23:12:48.952235+0000","last_clean":"2023-11-30T23:12:48.952235+0000","last_became_active":"2023-11-30T23:12:47.136631+0000","last_became_peered":"2023-11-30T23:12:47.136631+0000","last_unstale":"2023-11-30T23:12:48.952235+0000","last_undegraded":"2023-11-30T23:12:48.952235+0000","last_fullsized":"2023-11-30T23:12:48.952235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:22:48.835054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950899+0000","last_change":"2023-11-30T23:12:47.514450+0000","last_active":"2023-11-30T23:12:48.950899+0000","last_peered":"2023-11-30T23:12:48.950899+0000","last_clean":"2023-11-30T23:12:48.950899+0000","last_became_active":"2023-11-30T23:12:47.514053+0000","last_became_peered":"2023-11-30T23:12:47.514053+0000","last_unstale":"2023-11-30T23:12:48.950899+0000","last_undegraded":"2023-11-30T23:12:48.950899+0000","last_fullsized":"2023-11-30T23:12:48.950899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.494177+0000","last_change":"2023-11-30T23:12:47.138008+0000","last_active":"2023-11-30T23:12:48.494177+0000","last_peered":"2023-11-30T23:12:48.494177+0000","last_clean":"2023-11-30T23:12:48.494177+0000","last_became_active":"2023-11-30T23:12:47.137695+0000","last_became_peered":"2023-11-30T23:12:47.137695+0000","last_unstale":"2023-11-30T23:12:48.494177+0000","last_undegraded":"2023-11-30T23:12:48.494177+0000","last_fullsized":"2023-11-30T23:12:48.494177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951499+0000","last_change":"2023-11-30T23:12:47.516065+0000","last_active":"2023-11-30T23:12:48.951499+0000","last_peered":"2023-11-30T23:12:48.951499+0000","last_clean":"2023-11-30T23:12:48.951499+0000","last_became_active":"2023-11-30T23:12:47.514822+0000","last_became_peered":"2023-11-30T23:12:47.514822+0000","last_unstale":"2023-11-30T23:12:48.951499+0000","last_undegraded":"2023-11-30T23:12:48.951499+0000","last_fullsized":"2023-11-30T23:12:48.951499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:02:36.020857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493499+0000","last_change":"2023-11-30T23:12:47.129184+0000","last_active":"2023-11-30T23:12:48.493499+0000","last_peered":"2023-11-30T23:12:48.493499+0000","last_clean":"2023-11-30T23:12:48.493499+0000","last_became_active":"2023-11-30T23:12:47.128682+0000","last_became_peered":"2023-11-30T23:12:47.128682+0000","last_unstale":"2023-11-30T23:12:48.493499+0000","last_undegraded":"2023-11-30T23:12:48.493499+0000","last_fullsized":"2023-11-30T23:12:48.493499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952861+0000","last_change":"2023-11-30T23:12:47.516581+0000","last_active":"2023-11-30T23:12:48.952861+0000","last_peered":"2023-11-30T23:12:48.952861+0000","last_clean":"2023-11-30T23:12:48.952861+0000","last_became_active":"2023-11-30T23:12:47.516317+0000","last_became_peered":"2023-11-30T23:12:47.516317+0000","last_unstale":"2023-11-30T23:12:48.952861+0000","last_undegraded":"2023-11-30T23:12:48.952861+0000","last_fullsized":"2023-11-30T23:12:48.952861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:20:31.102899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493457+0000","last_change":"2023-11-30T23:12:47.140679+0000","last_active":"2023-11-30T23:12:48.493457+0000","last_peered":"2023-11-30T23:12:48.493457+0000","last_clean":"2023-11-30T23:12:48.493457+0000","last_became_active":"2023-11-30T23:12:47.140400+0000","last_became_peered":"2023-11-30T23:12:47.140400+0000","last_unstale":"2023-11-30T23:12:48.493457+0000","last_undegraded":"2023-11-30T23:12:48.493457+0000","last_fullsized":"2023-11-30T23:12:48.493457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949914+0000","last_change":"2023-11-30T23:12:47.521764+0000","last_active":"2023-11-30T23:12:48.949914+0000","last_peered":"2023-11-30T23:12:48.949914+0000","last_clean":"2023-11-30T23:12:48.949914+0000","last_became_active":"2023-11-30T23:12:47.521481+0000","last_became_peered":"2023-11-30T23:12:47.521481+0000","last_unstale":"2023-11-30T23:12:48.949914+0000","last_undegraded":"2023-11-30T23:12:48.949914+0000","last_fullsized":"2023-11-30T23:12:48.949914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:17:01.774183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-30T23:12:47.490864+0000","last_change":"2023-11-30T23:12:36.558633+0000","last_active":"2023-11-30T23:12:47.490864+0000","last_peered":"2023-11-30T23:12:47.490864+0000","last_clean":"2023-11-30T23:12:47.490864+0000","last_became_active":"2023-11-30T23:12:36.556455+0000","last_became_peered":"2023-11-30T23:12:36.556455+0000","last_unstale":"2023-11-30T23:12:47.490864+0000","last_undegraded":"2023-11-30T23:12:47.490864+0000","last_fullsized":"2023-11-30T23:12:47.490864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:34.652815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:34.652815+0000","last_clean_scrub_stamp":"2023-11-30T23:12:34.652815+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:36:52.941511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948996+0000","last_change":"2023-11-30T23:12:47.132985+0000","last_active":"2023-11-30T23:12:48.948996+0000","last_peered":"2023-11-30T23:12:48.948996+0000","last_clean":"2023-11-30T23:12:48.948996+0000","last_became_active":"2023-11-30T23:12:47.132365+0000","last_became_peered":"2023-11-30T23:12:47.132365+0000","last_unstale":"2023-11-30T23:12:48.948996+0000","last_undegraded":"2023-11-30T23:12:48.948996+0000","last_fullsized":"2023-11-30T23:12:48.948996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949001+0000","last_change":"2023-11-30T23:12:47.509943+0000","last_active":"2023-11-30T23:12:48.949001+0000","last_peered":"2023-11-30T23:12:48.949001+0000","last_clean":"2023-11-30T23:12:48.949001+0000","last_became_active":"2023-11-30T23:12:47.508677+0000","last_became_peered":"2023-11-30T23:12:47.508677+0000","last_unstale":"2023-11-30T23:12:48.949001+0000","last_undegraded":"2023-11-30T23:12:48.949001+0000","last_fullsized":"2023-11-30T23:12:48.949001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948349+0000","last_change":"2023-11-30T23:12:47.148775+0000","last_active":"2023-11-30T23:12:48.948349+0000","last_peered":"2023-11-30T23:12:48.948349+0000","last_clean":"2023-11-30T23:12:48.948349+0000","last_became_active":"2023-11-30T23:12:47.148547+0000","last_became_peered":"2023-11-30T23:12:47.148547+0000","last_unstale":"2023-11-30T23:12:48.948349+0000","last_undegraded":"2023-11-30T23:12:48.948349+0000","last_fullsized":"2023-11-30T23:12:48.948349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:01.207700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.490955+0000","last_change":"2023-11-30T23:12:47.515805+0000","last_active":"2023-11-30T23:12:48.490955+0000","last_peered":"2023-11-30T23:12:48.490955+0000","last_clean":"2023-11-30T23:12:48.490955+0000","last_became_active":"2023-11-30T23:12:47.515553+0000","last_became_peered":"2023-11-30T23:12:47.515553+0000","last_unstale":"2023-11-30T23:12:48.490955+0000","last_undegraded":"2023-11-30T23:12:48.490955+0000","last_fullsized":"2023-11-30T23:12:48.490955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:22.086661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493249+0000","last_change":"2023-11-30T23:12:47.136018+0000","last_active":"2023-11-30T23:12:48.493249+0000","last_peered":"2023-11-30T23:12:48.493249+0000","last_clean":"2023-11-30T23:12:48.493249+0000","last_became_active":"2023-11-30T23:12:47.135746+0000","last_became_peered":"2023-11-30T23:12:47.135746+0000","last_unstale":"2023-11-30T23:12:48.493249+0000","last_undegraded":"2023-11-30T23:12:48.493249+0000","last_fullsized":"2023-11-30T23:12:48.493249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492802+0000","last_change":"2023-11-30T23:12:47.513832+0000","last_active":"2023-11-30T23:12:48.492802+0000","last_peered":"2023-11-30T23:12:48.492802+0000","last_clean":"2023-11-30T23:12:48.492802+0000","last_became_active":"2023-11-30T23:12:47.510024+0000","last_became_peered":"2023-11-30T23:12:47.510024+0000","last_unstale":"2023-11-30T23:12:48.492802+0000","last_undegraded":"2023-11-30T23:12:48.492802+0000","last_fullsized":"2023-11-30T23:12:48.492802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950516+0000","last_change":"2023-11-30T23:12:47.141605+0000","last_active":"2023-11-30T23:12:48.950516+0000","last_peered":"2023-11-30T23:12:48.950516+0000","last_clean":"2023-11-30T23:12:48.950516+0000","last_became_active":"2023-11-30T23:12:47.141115+0000","last_became_peered":"2023-11-30T23:12:47.141115+0000","last_unstale":"2023-11-30T23:12:48.950516+0000","last_undegraded":"2023-11-30T23:12:48.950516+0000","last_fullsized":"2023-11-30T23:12:48.950516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951647+0000","last_change":"2023-11-30T23:12:47.514830+0000","last_active":"2023-11-30T23:12:48.951647+0000","last_peered":"2023-11-30T23:12:48.951647+0000","last_clean":"2023-11-30T23:12:48.951647+0000","last_became_active":"2023-11-30T23:12:47.514572+0000","last_became_peered":"2023-11-30T23:12:47.514572+0000","last_unstale":"2023-11-30T23:12:48.951647+0000","last_undegraded":"2023-11-30T23:12:48.951647+0000","last_fullsized":"2023-11-30T23:12:48.951647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:29.167074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.494540+0000","last_change":"2023-11-30T23:12:47.141801+0000","last_active":"2023-11-30T23:12:48.494540+0000","last_peered":"2023-11-30T23:12:48.494540+0000","last_clean":"2023-11-30T23:12:48.494540+0000","last_became_active":"2023-11-30T23:12:47.141411+0000","last_became_peered":"2023-11-30T23:12:47.141411+0000","last_unstale":"2023-11-30T23:12:48.494540+0000","last_undegraded":"2023-11-30T23:12:48.494540+0000","last_fullsized":"2023-11-30T23:12:48.494540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951738+0000","last_change":"2023-11-30T23:12:47.519303+0000","last_active":"2023-11-30T23:12:48.951738+0000","last_peered":"2023-11-30T23:12:48.951738+0000","last_clean":"2023-11-30T23:12:48.951738+0000","last_became_active":"2023-11-30T23:12:47.517033+0000","last_became_peered":"2023-11-30T23:12:47.517033+0000","last_unstale":"2023-11-30T23:12:48.951738+0000","last_undegraded":"2023-11-30T23:12:48.951738+0000","last_fullsized":"2023-11-30T23:12:48.951738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950582+0000","last_change":"2023-11-30T23:12:47.143317+0000","last_active":"2023-11-30T23:12:48.950582+0000","last_peered":"2023-11-30T23:12:48.950582+0000","last_clean":"2023-11-30T23:12:48.950582+0000","last_became_active":"2023-11-30T23:12:47.143061+0000","last_became_peered":"2023-11-30T23:12:47.143061+0000","last_unstale":"2023-11-30T23:12:48.950582+0000","last_undegraded":"2023-11-30T23:12:48.950582+0000","last_fullsized":"2023-11-30T23:12:48.950582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:38.684081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.494595+0000","last_change":"2023-11-30T23:12:47.501784+0000","last_active":"2023-11-30T23:12:48.494595+0000","last_peered":"2023-11-30T23:12:48.494595+0000","last_clean":"2023-11-30T23:12:48.494595+0000","last_became_active":"2023-11-30T23:12:47.501516+0000","last_became_peered":"2023-11-30T23:12:47.501516+0000","last_unstale":"2023-11-30T23:12:48.494595+0000","last_undegraded":"2023-11-30T23:12:48.494595+0000","last_fullsized":"2023-11-30T23:12:48.494595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:34:32.232378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:49.077550+0000","last_change":"2023-11-30T23:12:47.135053+0000","last_active":"2023-11-30T23:12:49.077550+0000","last_peered":"2023-11-30T23:12:49.077550+0000","last_clean":"2023-11-30T23:12:49.077550+0000","last_became_active":"2023-11-30T23:12:47.134776+0000","last_became_peered":"2023-11-30T23:12:47.134776+0000","last_unstale":"2023-11-30T23:12:49.077550+0000","last_undegraded":"2023-11-30T23:12:49.077550+0000","last_fullsized":"2023-11-30T23:12:49.077550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949473+0000","last_change":"2023-11-30T23:12:47.498935+0000","last_active":"2023-11-30T23:12:48.949473+0000","last_peered":"2023-11-30T23:12:48.949473+0000","last_clean":"2023-11-30T23:12:48.949473+0000","last_became_active":"2023-11-30T23:12:47.498631+0000","last_became_peered":"2023-11-30T23:12:47.498631+0000","last_unstale":"2023-11-30T23:12:48.949473+0000","last_undegraded":"2023-11-30T23:12:48.949473+0000","last_fullsized":"2023-11-30T23:12:48.949473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951298+0000","last_change":"2023-11-30T23:12:47.137707+0000","last_active":"2023-11-30T23:12:48.951298+0000","last_peered":"2023-11-30T23:12:48.951298+0000","last_clean":"2023-11-30T23:12:48.951298+0000","last_became_active":"2023-11-30T23:12:47.137406+0000","last_became_peered":"2023-11-30T23:12:47.137406+0000","last_unstale":"2023-11-30T23:12:48.951298+0000","last_undegraded":"2023-11-30T23:12:48.951298+0000","last_fullsized":"2023-11-30T23:12:48.951298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491277+0000","last_change":"2023-11-30T23:12:47.506770+0000","last_active":"2023-11-30T23:12:48.491277+0000","last_peered":"2023-11-30T23:12:48.491277+0000","last_clean":"2023-11-30T23:12:48.491277+0000","last_became_active":"2023-11-30T23:12:47.506447+0000","last_became_peered":"2023-11-30T23:12:47.506447+0000","last_unstale":"2023-11-30T23:12:48.491277+0000","last_undegraded":"2023-11-30T23:12:48.491277+0000","last_fullsized":"2023-11-30T23:12:48.491277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:35:21.183993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948253+0000","last_change":"2023-11-30T23:12:47.142532+0000","last_active":"2023-11-30T23:12:48.948253+0000","last_peered":"2023-11-30T23:12:48.948253+0000","last_clean":"2023-11-30T23:12:48.948253+0000","last_became_active":"2023-11-30T23:12:47.142135+0000","last_became_peered":"2023-11-30T23:12:47.142135+0000","last_unstale":"2023-11-30T23:12:48.948253+0000","last_undegraded":"2023-11-30T23:12:48.948253+0000","last_fullsized":"2023-11-30T23:12:48.948253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:53.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949668+0000","last_change":"2023-11-30T23:12:47.514258+0000","last_active":"2023-11-30T23:12:48.949668+0000","last_peered":"2023-11-30T23:12:48.949668+0000","last_clean":"2023-11-30T23:12:48.949668+0000","last_became_active":"2023-11-30T23:12:47.513966+0000","last_became_peered":"2023-11-30T23:12:47.513966+0000","last_unstale":"2023-11-30T23:12:48.949668+0000","last_undegraded":"2023-11-30T23:12:48.949668+0000","last_fullsized":"2023-11-30T23:12:48.949668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:02.220181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492838+0000","last_change":"2023-11-30T23:12:47.140898+0000","last_active":"2023-11-30T23:12:48.492838+0000","last_peered":"2023-11-30T23:12:48.492838+0000","last_clean":"2023-11-30T23:12:48.492838+0000","last_became_active":"2023-11-30T23:12:47.140565+0000","last_became_peered":"2023-11-30T23:12:47.140565+0000","last_unstale":"2023-11-30T23:12:48.492838+0000","last_undegraded":"2023-11-30T23:12:48.492838+0000","last_fullsized":"2023-11-30T23:12:48.492838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948628+0000","last_change":"2023-11-30T23:12:47.501516+0000","last_active":"2023-11-30T23:12:48.948628+0000","last_peered":"2023-11-30T23:12:48.948628+0000","last_clean":"2023-11-30T23:12:48.948628+0000","last_became_active":"2023-11-30T23:12:47.501315+0000","last_became_peered":"2023-11-30T23:12:47.501315+0000","last_unstale":"2023-11-30T23:12:48.948628+0000","last_undegraded":"2023-11-30T23:12:48.948628+0000","last_fullsized":"2023-11-30T23:12:48.948628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492956+0000","last_change":"2023-11-30T23:12:47.140328+0000","last_active":"2023-11-30T23:12:48.492956+0000","last_peered":"2023-11-30T23:12:48.492956+0000","last_clean":"2023-11-30T23:12:48.492956+0000","last_became_active":"2023-11-30T23:12:47.140037+0000","last_became_peered":"2023-11-30T23:12:47.140037+0000","last_unstale":"2023-11-30T23:12:48.492956+0000","last_undegraded":"2023-11-30T23:12:48.492956+0000","last_fullsized":"2023-11-30T23:12:48.492956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:38.684081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949106+0000","last_change":"2023-11-30T23:12:47.509056+0000","last_active":"2023-11-30T23:12:48.949106+0000","last_peered":"2023-11-30T23:12:48.949106+0000","last_clean":"2023-11-30T23:12:48.949106+0000","last_became_active":"2023-11-30T23:12:47.507181+0000","last_became_peered":"2023-11-30T23:12:47.507181+0000","last_unstale":"2023-11-30T23:12:48.949106+0000","last_undegraded":"2023-11-30T23:12:48.949106+0000","last_fullsized":"2023-11-30T23:12:48.949106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950357+0000","last_change":"2023-11-30T23:12:47.142027+0000","last_active":"2023-11-30T23:12:48.950357+0000","last_peered":"2023-11-30T23:12:48.950357+0000","last_clean":"2023-11-30T23:12:48.950357+0000","last_became_active":"2023-11-30T23:12:47.141664+0000","last_became_peered":"2023-11-30T23:12:47.141664+0000","last_unstale":"2023-11-30T23:12:48.950357+0000","last_undegraded":"2023-11-30T23:12:48.950357+0000","last_fullsized":"2023-11-30T23:12:48.950357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948584+0000","last_change":"2023-11-30T23:12:47.517183+0000","last_active":"2023-11-30T23:12:48.948584+0000","last_peered":"2023-11-30T23:12:48.948584+0000","last_clean":"2023-11-30T23:12:48.948584+0000","last_became_active":"2023-11-30T23:12:47.516939+0000","last_became_peered":"2023-11-30T23:12:47.516939+0000","last_unstale":"2023-11-30T23:12:48.948584+0000","last_undegraded":"2023-11-30T23:12:48.948584+0000","last_fullsized":"2023-11-30T23:12:48.948584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951672+0000","last_change":"2023-11-30T23:12:47.522937+0000","last_active":"2023-11-30T23:12:48.951672+0000","last_peered":"2023-11-30T23:12:48.951672+0000","last_clean":"2023-11-30T23:12:48.951672+0000","last_became_active":"2023-11-30T23:12:47.521310+0000","last_became_peered":"2023-11-30T23:12:47.521310+0000","last_unstale":"2023-11-30T23:12:48.951672+0000","last_undegraded":"2023-11-30T23:12:48.951672+0000","last_fullsized":"2023-11-30T23:12:48.951672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:08:47.117163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950610+0000","last_change":"2023-11-30T23:12:47.143819+0000","last_active":"2023-11-30T23:12:48.950610+0000","last_peered":"2023-11-30T23:12:48.950610+0000","last_clean":"2023-11-30T23:12:48.950610+0000","last_became_active":"2023-11-30T23:12:47.143512+0000","last_became_peered":"2023-11-30T23:12:47.143512+0000","last_unstale":"2023-11-30T23:12:48.950610+0000","last_undegraded":"2023-11-30T23:12:48.950610+0000","last_fullsized":"2023-11-30T23:12:48.950610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:35:20.171512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950946+0000","last_change":"2023-11-30T23:12:47.521920+0000","last_active":"2023-11-30T23:12:48.950946+0000","last_peered":"2023-11-30T23:12:48.950946+0000","last_clean":"2023-11-30T23:12:48.950946+0000","last_became_active":"2023-11-30T23:12:47.520322+0000","last_became_peered":"2023-11-30T23:12:47.520322+0000","last_unstale":"2023-11-30T23:12:48.950946+0000","last_undegraded":"2023-11-30T23:12:48.950946+0000","last_fullsized":"2023-11-30T23:12:48.950946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950135+0000","last_change":"2023-11-30T23:12:47.142276+0000","last_active":"2023-11-30T23:12:48.950135+0000","last_peered":"2023-11-30T23:12:48.950135+0000","last_clean":"2023-11-30T23:12:48.950135+0000","last_became_active":"2023-11-30T23:12:47.141965+0000","last_became_peered":"2023-11-30T23:12:47.141965+0000","last_unstale":"2023-11-30T23:12:48.950135+0000","last_undegraded":"2023-11-30T23:12:48.950135+0000","last_fullsized":"2023-11-30T23:12:48.950135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:28.154593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491664+0000","last_change":"2023-11-30T23:12:47.522292+0000","last_active":"2023-11-30T23:12:48.491664+0000","last_peered":"2023-11-30T23:12:48.491664+0000","last_clean":"2023-11-30T23:12:48.491664+0000","last_became_active":"2023-11-30T23:12:47.522002+0000","last_became_peered":"2023-11-30T23:12:47.522002+0000","last_unstale":"2023-11-30T23:12:48.491664+0000","last_undegraded":"2023-11-30T23:12:48.491664+0000","last_fullsized":"2023-11-30T23:12:48.491664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949635+0000","last_change":"2023-11-30T23:12:47.139186+0000","last_active":"2023-11-30T23:12:48.949635+0000","last_peered":"2023-11-30T23:12:48.949635+0000","last_clean":"2023-11-30T23:12:48.949635+0000","last_became_active":"2023-11-30T23:12:47.138275+0000","last_became_peered":"2023-11-30T23:12:47.138275+0000","last_unstale":"2023-11-30T23:12:48.949635+0000","last_undegraded":"2023-11-30T23:12:48.949635+0000","last_fullsized":"2023-11-30T23:12:48.949635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:58:25.168678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949437+0000","last_change":"2023-11-30T23:12:47.509024+0000","last_active":"2023-11-30T23:12:48.949437+0000","last_peered":"2023-11-30T23:12:48.949437+0000","last_clean":"2023-11-30T23:12:48.949437+0000","last_became_active":"2023-11-30T23:12:47.508718+0000","last_became_peered":"2023-11-30T23:12:47.508718+0000","last_unstale":"2023-11-30T23:12:48.949437+0000","last_undegraded":"2023-11-30T23:12:48.949437+0000","last_fullsized":"2023-11-30T23:12:48.949437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491906+0000","last_change":"2023-11-30T23:12:47.141150+0000","last_active":"2023-11-30T23:12:48.491906+0000","last_peered":"2023-11-30T23:12:48.491906+0000","last_clean":"2023-11-30T23:12:48.491906+0000","last_became_active":"2023-11-30T23:12:47.140891+0000","last_became_peered":"2023-11-30T23:12:47.140891+0000","last_unstale":"2023-11-30T23:12:48.491906+0000","last_undegraded":"2023-11-30T23:12:48.491906+0000","last_fullsized":"2023-11-30T23:12:48.491906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:22:48.835054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31832,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31260,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340580,"statfs":{"total":96636764160,"available":96604753920,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31252,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340588,"statfs":{"total":96636764160,"available":96604762112,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.9320000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31260,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340580,"statfs":{"total":96636764160,"available":96604753920,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T23:12:56.774 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T23:12:56.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51ac91d700 1 Processor -- start 2023-11-30T23:12:56.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51ac91d700 1 -- start start 2023-11-30T23:12:56.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51ac91d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f51a80bc8b0 0x7f51a80b3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51ac91d700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f51a80b4b20 0x7f51a8140340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51ac91d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a8140880 0x7f51a8149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51ac91d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a80b3b20 con 0x7f51a80bc8b0 2023-11-30T23:12:56.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51ac91d700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a80b3e00 con 0x7f51a80b4b20 2023-11-30T23:12:56.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51ac91d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80b40e0 con 0x7f51a8140880 2023-11-30T23:12:56.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51a6d9d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f51a80bc8b0 0x7f51a80b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51a6d9d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f51a80bc8b0 0x7f51a80b3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38522/0 (socket says 172.21.15.73:38522) 2023-11-30T23:12:56.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51a6d9d700 1 -- 172.21.15.73:0/3026233561 learned_addr learned my addr 172.21.15.73:0/3026233561 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:56.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51a659c700 1 --2- 172.21.15.73:0/3026233561 >> v2:172.21.15.156:3300/0 conn(0x7f51a80b4b20 0x7f51a8140340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51a759e700 1 --2- 172.21.15.73:0/3026233561 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a8140880 0x7f51a8149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51a6d9d700 1 -- 172.21.15.73:0/3026233561 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a8140880 msgr2=0x7f51a8149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:56.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51a6d9d700 1 --2- 172.21.15.73:0/3026233561 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a8140880 0x7f51a8149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51a6d9d700 1 -- 172.21.15.73:0/3026233561 >> v2:172.21.15.156:3300/0 conn(0x7f51a80b4b20 msgr2=0x7f51a8140340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:56.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51a6d9d700 1 --2- 172.21.15.73:0/3026233561 >> v2:172.21.15.156:3300/0 conn(0x7f51a80b4b20 0x7f51a8140340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51a6d9d700 1 -- 172.21.15.73:0/3026233561 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a80bcc90 con 0x7f51a80bc8b0 2023-11-30T23:12:56.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51a759e700 1 --2- 172.21.15.73:0/3026233561 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a8140880 0x7f51a8149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:12:56.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51a6d9d700 1 --2- 172.21.15.73:0/3026233561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a80bc8b0 0x7f51a80b3540 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f51a80b5970 tx=0x7f519c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5517bb0bbd959a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.871+0000 7f51a5d9b700 1 -- 172.21.15.73:0/3026233561 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c011830 con 0x7f51a80bc8b0 2023-11-30T23:12:56.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.875+0000 7f51a5d9b700 1 -- 172.21.15.73:0/3026233561 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c011990 con 0x7f51a80bc8b0 2023-11-30T23:12:56.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.875+0000 7f51a5d9b700 1 -- 172.21.15.73:0/3026233561 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c011d20 con 0x7f51a80bc8b0 2023-11-30T23:12:56.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.875+0000 7f51ac91d700 1 -- 172.21.15.73:0/3026233561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a80bc8b0 msgr2=0x7f51a80b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.875+0000 7f51ac91d700 1 --2- 172.21.15.73:0/3026233561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a80bc8b0 0x7f51a80b3540 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f51a80b5970 tx=0x7f519c009bf0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.875+0000 7f51ac91d700 1 -- 172.21.15.73:0/3026233561 shutdown_connections 2023-11-30T23:12:56.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.875+0000 7f51ac91d700 1 --2- 172.21.15.73:0/3026233561 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a8140880 0x7f51a8149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.875+0000 7f51ac91d700 1 --2- 172.21.15.73:0/3026233561 >> v2:172.21.15.156:3300/0 conn(0x7f51a80b4b20 0x7f51a8140340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.875+0000 7f51ac91d700 1 --2- 172.21.15.73:0/3026233561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a80bc8b0 0x7f51a80b3540 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.875+0000 7f51ac91d700 1 -- 172.21.15.73:0/3026233561 >> 172.21.15.73:0/3026233561 conn(0x7f51a8071ee0 msgr2=0x7f51a80bbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:56.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.875+0000 7f51ac91d700 1 -- 172.21.15.73:0/3026233561 shutdown_connections 2023-11-30T23:12:56.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.875+0000 7f51ac91d700 1 -- 172.21.15.73:0/3026233561 wait complete. 2023-11-30T23:12:56.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.875+0000 7f51ac91d700 1 Processor -- start 2023-11-30T23:12:56.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51ac91d700 1 -- start start 2023-11-30T23:12:56.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51ac91d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a80b4b20 0x7f51a8146160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51ac91d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a80bc8b0 0x7f51a81db900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51ac91d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a8140880 0x7f51a81dbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51ac91d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a8143470 con 0x7f51a8140880 2023-11-30T23:12:56.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51ac91d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a8143750 con 0x7f51a80b4b20 2023-11-30T23:12:56.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51ac91d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80a8ab0 con 0x7f51a80bc8b0 2023-11-30T23:12:56.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51a759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a8140880 0x7f51a81dbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51a759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a8140880 0x7f51a81dbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38524/0 (socket says 172.21.15.73:38524) 2023-11-30T23:12:56.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51a759e700 1 -- 172.21.15.73:0/3452274284 learned_addr learned my addr 172.21.15.73:0/3452274284 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:56.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51a659c700 1 --2- 172.21.15.73:0/3452274284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a80bc8b0 0x7f51a81db900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51a6d9d700 1 --2- 172.21.15.73:0/3452274284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a80b4b20 0x7f51a8146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51a759e700 1 -- 172.21.15.73:0/3452274284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a80bc8b0 msgr2=0x7f51a81db900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51a759e700 1 --2- 172.21.15.73:0/3452274284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a80bc8b0 0x7f51a81db900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51a759e700 1 -- 172.21.15.73:0/3452274284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a80b4b20 msgr2=0x7f51a8146160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:56.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51a759e700 1 --2- 172.21.15.73:0/3452274284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a80b4b20 0x7f51a8146160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:56.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51a759e700 1 -- 172.21.15.73:0/3452274284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c009570 con 0x7f51a8140880 2023-11-30T23:12:56.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51a759e700 1 --2- 172.21.15.73:0/3452274284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a8140880 0x7f51a81dbe40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f51a0007e60 tx=0x7f51a000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f518f7fe700 1 -- 172.21.15.73:0/3452274284 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a000dd20 con 0x7f51a8140880 2023-11-30T23:12:56.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f518f7fe700 1 -- 172.21.15.73:0/3452274284 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a000f040 con 0x7f51a8140880 2023-11-30T23:12:56.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51ac91d700 1 -- 172.21.15.73:0/3452274284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a81466a0 con 0x7f51a8140880 2023-11-30T23:12:56.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f518f7fe700 1 -- 172.21.15.73:0/3452274284 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a000dea0 con 0x7f51a8140880 2023-11-30T23:12:56.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.879+0000 7f51ac91d700 1 -- 172.21.15.73:0/3452274284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a8144210 con 0x7f51a8140880 2023-11-30T23:12:56.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.883+0000 7f51ac91d700 1 -- 172.21.15.73:0/3452274284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a8143970 con 0x7f51a8140880 2023-11-30T23:12:56.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.883+0000 7f518f7fe700 1 -- 172.21.15.73:0/3452274284 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f51a0003c80 con 0x7f51a8140880 2023-11-30T23:12:56.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.883+0000 7f518f7fe700 1 --2- 172.21.15.73:0/3452274284 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f5194065ad0 0x7f5194067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:56.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.883+0000 7f518f7fe700 1 -- 172.21.15.73:0/3452274284 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51a0082fb0 con 0x7f51a8140880 2023-11-30T23:12:56.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.883+0000 7f51a6d9d700 1 --2- 172.21.15.73:0/3452274284 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f5194065ad0 0x7f5194067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:56.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.883+0000 7f51a6d9d700 1 --2- 172.21.15.73:0/3452274284 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f5194065ad0 0x7f5194067f90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f519c000c00 tx=0x7f519c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:56.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:56.891+0000 7f518f7fe700 1 -- 172.21.15.73:0/3452274284 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f51a00b4070 con 0x7f51a8140880 2023-11-30T23:12:57.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.039+0000 7f51ac91d700 1 -- 172.21.15.73:0/3452274284 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51a80b4fb0 con 0x7f5194065ad0 2023-11-30T23:12:57.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.047+0000 7f518f7fe700 1 -- 172.21.15.73:0/3452274284 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264403 (secure 0 0 0) 0x7f519c011b00 con 0x7f5194065ad0 2023-11-30T23:12:57.057 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:57.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.051+0000 7f51ac91d700 1 -- 172.21.15.73:0/3452274284 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f5194065ad0 msgr2=0x7f5194067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:57.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.051+0000 7f51ac91d700 1 --2- 172.21.15.73:0/3452274284 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f5194065ad0 0x7f5194067f90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f519c000c00 tx=0x7f519c008030 comp rx=0 tx=0).stop 2023-11-30T23:12:57.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.051+0000 7f51ac91d700 1 -- 172.21.15.73:0/3452274284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a8140880 msgr2=0x7f51a81dbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:57.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.051+0000 7f51ac91d700 1 --2- 172.21.15.73:0/3452274284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a8140880 0x7f51a81dbe40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f51a0007e60 tx=0x7f51a000d3b0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.051+0000 7f51ac91d700 1 -- 172.21.15.73:0/3452274284 shutdown_connections 2023-11-30T23:12:57.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.051+0000 7f51ac91d700 1 --2- 172.21.15.73:0/3452274284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a8140880 0x7f51a81dbe40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.051+0000 7f51ac91d700 1 --2- 172.21.15.73:0/3452274284 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f51a80bc8b0 0x7f51a81db900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.051+0000 7f51ac91d700 1 --2- 172.21.15.73:0/3452274284 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f5194065ad0 0x7f5194067f90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.051+0000 7f51ac91d700 1 --2- 172.21.15.73:0/3452274284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51a80b4b20 0x7f51a8146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.051+0000 7f51ac91d700 1 -- 172.21.15.73:0/3452274284 >> 172.21.15.73:0/3452274284 conn(0x7f51a8071ee0 msgr2=0x7f51a80b7140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.051+0000 7f51ac91d700 1 -- 172.21.15.73:0/3452274284 shutdown_connections 2023-11-30T23:12:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.051+0000 7f51ac91d700 1 -- 172.21.15.73:0/3452274284 wait complete. 2023-11-30T23:12:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-11-30T23:12:57.069 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-30T23:12:56.351099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234824,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739896,"statfs":{"total":773094113280,"available":772853653504,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.863321"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951239+0000","last_change":"2023-11-30T23:12:47.514628+0000","last_active":"2023-11-30T23:12:48.951239+0000","last_peered":"2023-11-30T23:12:48.951239+0000","last_clean":"2023-11-30T23:12:48.951239+0000","last_became_active":"2023-11-30T23:12:47.512980+0000","last_became_peered":"2023-11-30T23:12:47.512980+0000","last_unstale":"2023-11-30T23:12:48.951239+0000","last_undegraded":"2023-11-30T23:12:48.951239+0000","last_fullsized":"2023-11-30T23:12:48.951239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:18:44.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493012+0000","last_change":"2023-11-30T23:12:47.511277+0000","last_active":"2023-11-30T23:12:48.493012+0000","last_peered":"2023-11-30T23:12:48.493012+0000","last_clean":"2023-11-30T23:12:48.493012+0000","last_became_active":"2023-11-30T23:12:47.508771+0000","last_became_peered":"2023-11-30T23:12:47.508771+0000","last_unstale":"2023-11-30T23:12:48.493012+0000","last_undegraded":"2023-11-30T23:12:48.493012+0000","last_fullsized":"2023-11-30T23:12:48.493012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492167+0000","last_change":"2023-11-30T23:12:47.508068+0000","last_active":"2023-11-30T23:12:48.492167+0000","last_peered":"2023-11-30T23:12:48.492167+0000","last_clean":"2023-11-30T23:12:48.492167+0000","last_became_active":"2023-11-30T23:12:47.507829+0000","last_became_peered":"2023-11-30T23:12:47.507829+0000","last_unstale":"2023-11-30T23:12:48.492167+0000","last_undegraded":"2023-11-30T23:12:48.492167+0000","last_fullsized":"2023-11-30T23:12:48.492167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:39.696562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950918+0000","last_change":"2023-11-30T23:12:47.522516+0000","last_active":"2023-11-30T23:12:48.950918+0000","last_peered":"2023-11-30T23:12:48.950918+0000","last_clean":"2023-11-30T23:12:48.950918+0000","last_became_active":"2023-11-30T23:12:47.522208+0000","last_became_peered":"2023-11-30T23:12:47.522208+0000","last_unstale":"2023-11-30T23:12:48.950918+0000","last_undegraded":"2023-11-30T23:12:48.950918+0000","last_fullsized":"2023-11-30T23:12:48.950918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950044+0000","last_change":"2023-11-30T23:12:47.507130+0000","last_active":"2023-11-30T23:12:48.950044+0000","last_peered":"2023-11-30T23:12:48.950044+0000","last_clean":"2023-11-30T23:12:48.950044+0000","last_became_active":"2023-11-30T23:12:47.506816+0000","last_became_peered":"2023-11-30T23:12:47.506816+0000","last_unstale":"2023-11-30T23:12:48.950044+0000","last_undegraded":"2023-11-30T23:12:48.950044+0000","last_fullsized":"2023-11-30T23:12:48.950044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:21:32.262322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950103+0000","last_change":"2023-11-30T23:12:47.514855+0000","last_active":"2023-11-30T23:12:48.950103+0000","last_peered":"2023-11-30T23:12:48.950103+0000","last_clean":"2023-11-30T23:12:48.950103+0000","last_became_active":"2023-11-30T23:12:47.513491+0000","last_became_peered":"2023-11-30T23:12:47.513491+0000","last_unstale":"2023-11-30T23:12:48.950103+0000","last_undegraded":"2023-11-30T23:12:48.950103+0000","last_fullsized":"2023-11-30T23:12:48.950103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:18:44.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948350+0000","last_change":"2023-11-30T23:12:47.508060+0000","last_active":"2023-11-30T23:12:48.948350+0000","last_peered":"2023-11-30T23:12:48.948350+0000","last_clean":"2023-11-30T23:12:48.948350+0000","last_became_active":"2023-11-30T23:12:47.507747+0000","last_became_peered":"2023-11-30T23:12:47.507747+0000","last_unstale":"2023-11-30T23:12:48.948350+0000","last_undegraded":"2023-11-30T23:12:48.948350+0000","last_fullsized":"2023-11-30T23:12:48.948350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:27.789422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948363+0000","last_change":"2023-11-30T23:12:47.523687+0000","last_active":"2023-11-30T23:12:48.948363+0000","last_peered":"2023-11-30T23:12:48.948363+0000","last_clean":"2023-11-30T23:12:48.948363+0000","last_became_active":"2023-11-30T23:12:47.523430+0000","last_became_peered":"2023-11-30T23:12:47.523430+0000","last_unstale":"2023-11-30T23:12:48.948363+0000","last_undegraded":"2023-11-30T23:12:48.948363+0000","last_fullsized":"2023-11-30T23:12:48.948363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:26:33.640383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951748+0000","last_change":"2023-11-30T23:12:47.521698+0000","last_active":"2023-11-30T23:12:48.951748+0000","last_peered":"2023-11-30T23:12:48.951748+0000","last_clean":"2023-11-30T23:12:48.951748+0000","last_became_active":"2023-11-30T23:12:47.521393+0000","last_became_peered":"2023-11-30T23:12:47.521393+0000","last_unstale":"2023-11-30T23:12:48.951748+0000","last_undegraded":"2023-11-30T23:12:48.951748+0000","last_fullsized":"2023-11-30T23:12:48.951748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:23:17.254251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949276+0000","last_change":"2023-11-30T23:12:47.522937+0000","last_active":"2023-11-30T23:12:48.949276+0000","last_peered":"2023-11-30T23:12:48.949276+0000","last_clean":"2023-11-30T23:12:48.949276+0000","last_became_active":"2023-11-30T23:12:47.522618+0000","last_became_peered":"2023-11-30T23:12:47.522618+0000","last_unstale":"2023-11-30T23:12:48.949276+0000","last_undegraded":"2023-11-30T23:12:48.949276+0000","last_fullsized":"2023-11-30T23:12:48.949276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950146+0000","last_change":"2023-11-30T23:12:47.522869+0000","last_active":"2023-11-30T23:12:48.950146+0000","last_peered":"2023-11-30T23:12:48.950146+0000","last_clean":"2023-11-30T23:12:48.950146+0000","last_became_active":"2023-11-30T23:12:47.522552+0000","last_became_peered":"2023-11-30T23:12:47.522552+0000","last_unstale":"2023-11-30T23:12:48.950146+0000","last_undegraded":"2023-11-30T23:12:48.950146+0000","last_fullsized":"2023-11-30T23:12:48.950146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952576+0000","last_change":"2023-11-30T23:12:47.513660+0000","last_active":"2023-11-30T23:12:48.952576+0000","last_peered":"2023-11-30T23:12:48.952576+0000","last_clean":"2023-11-30T23:12:48.952576+0000","last_became_active":"2023-11-30T23:12:47.513401+0000","last_became_peered":"2023-11-30T23:12:47.513401+0000","last_unstale":"2023-11-30T23:12:48.952576+0000","last_undegraded":"2023-11-30T23:12:48.952576+0000","last_fullsized":"2023-11-30T23:12:48.952576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:22.086661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948954+0000","last_change":"2023-11-30T23:12:47.513995+0000","last_active":"2023-11-30T23:12:48.948954+0000","last_peered":"2023-11-30T23:12:48.948954+0000","last_clean":"2023-11-30T23:12:48.948954+0000","last_became_active":"2023-11-30T23:12:47.513714+0000","last_became_peered":"2023-11-30T23:12:47.513714+0000","last_unstale":"2023-11-30T23:12:48.948954+0000","last_undegraded":"2023-11-30T23:12:48.948954+0000","last_fullsized":"2023-11-30T23:12:48.948954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:20:31.102899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491646+0000","last_change":"2023-11-30T23:12:47.507240+0000","last_active":"2023-11-30T23:12:48.491646+0000","last_peered":"2023-11-30T23:12:48.491646+0000","last_clean":"2023-11-30T23:12:48.491646+0000","last_became_active":"2023-11-30T23:12:47.506967+0000","last_became_peered":"2023-11-30T23:12:47.506967+0000","last_unstale":"2023-11-30T23:12:48.491646+0000","last_undegraded":"2023-11-30T23:12:48.491646+0000","last_fullsized":"2023-11-30T23:12:48.491646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492735+0000","last_change":"2023-11-30T23:12:47.513430+0000","last_active":"2023-11-30T23:12:48.492735+0000","last_peered":"2023-11-30T23:12:48.492735+0000","last_clean":"2023-11-30T23:12:48.492735+0000","last_became_active":"2023-11-30T23:12:47.513018+0000","last_became_peered":"2023-11-30T23:12:47.513018+0000","last_unstale":"2023-11-30T23:12:48.492735+0000","last_undegraded":"2023-11-30T23:12:48.492735+0000","last_fullsized":"2023-11-30T23:12:48.492735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948206+0000","last_change":"2023-11-30T23:12:47.521933+0000","last_active":"2023-11-30T23:12:48.948206+0000","last_peered":"2023-11-30T23:12:48.948206+0000","last_clean":"2023-11-30T23:12:48.948206+0000","last_became_active":"2023-11-30T23:12:47.520518+0000","last_became_peered":"2023-11-30T23:12:47.520518+0000","last_unstale":"2023-11-30T23:12:48.948206+0000","last_undegraded":"2023-11-30T23:12:48.948206+0000","last_fullsized":"2023-11-30T23:12:48.948206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:27.789422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.953013+0000","last_change":"2023-11-30T23:12:47.516657+0000","last_active":"2023-11-30T23:12:48.953013+0000","last_peered":"2023-11-30T23:12:48.953013+0000","last_clean":"2023-11-30T23:12:48.953013+0000","last_became_active":"2023-11-30T23:12:47.516382+0000","last_became_peered":"2023-11-30T23:12:47.516382+0000","last_unstale":"2023-11-30T23:12:48.953013+0000","last_undegraded":"2023-11-30T23:12:48.953013+0000","last_fullsized":"2023-11-30T23:12:48.953013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:54:46.925262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.494119+0000","last_change":"2023-11-30T23:12:47.509616+0000","last_active":"2023-11-30T23:12:48.494119+0000","last_peered":"2023-11-30T23:12:48.494119+0000","last_clean":"2023-11-30T23:12:48.494119+0000","last_became_active":"2023-11-30T23:12:47.509340+0000","last_became_peered":"2023-11-30T23:12:47.509340+0000","last_unstale":"2023-11-30T23:12:48.494119+0000","last_undegraded":"2023-11-30T23:12:48.494119+0000","last_fullsized":"2023-11-30T23:12:48.494119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:29.167074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950366+0000","last_change":"2023-11-30T23:12:47.507039+0000","last_active":"2023-11-30T23:12:48.950366+0000","last_peered":"2023-11-30T23:12:48.950366+0000","last_clean":"2023-11-30T23:12:48.950366+0000","last_became_active":"2023-11-30T23:12:47.506733+0000","last_became_peered":"2023-11-30T23:12:47.506733+0000","last_unstale":"2023-11-30T23:12:48.950366+0000","last_undegraded":"2023-11-30T23:12:48.950366+0000","last_fullsized":"2023-11-30T23:12:48.950366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949761+0000","last_change":"2023-11-30T23:12:47.522534+0000","last_active":"2023-11-30T23:12:48.949761+0000","last_peered":"2023-11-30T23:12:48.949761+0000","last_clean":"2023-11-30T23:12:48.949761+0000","last_became_active":"2023-11-30T23:12:47.518819+0000","last_became_peered":"2023-11-30T23:12:47.518819+0000","last_unstale":"2023-11-30T23:12:48.949761+0000","last_undegraded":"2023-11-30T23:12:48.949761+0000","last_fullsized":"2023-11-30T23:12:48.949761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491549+0000","last_change":"2023-11-30T23:12:47.514472+0000","last_active":"2023-11-30T23:12:48.491549+0000","last_peered":"2023-11-30T23:12:48.491549+0000","last_clean":"2023-11-30T23:12:48.491549+0000","last_became_active":"2023-11-30T23:12:47.514223+0000","last_became_peered":"2023-11-30T23:12:47.514223+0000","last_unstale":"2023-11-30T23:12:48.491549+0000","last_undegraded":"2023-11-30T23:12:48.491549+0000","last_fullsized":"2023-11-30T23:12:48.491549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:34:32.232378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950329+0000","last_change":"2023-11-30T23:12:47.520514+0000","last_active":"2023-11-30T23:12:48.950329+0000","last_peered":"2023-11-30T23:12:48.950329+0000","last_clean":"2023-11-30T23:12:48.950329+0000","last_became_active":"2023-11-30T23:12:47.520228+0000","last_became_peered":"2023-11-30T23:12:47.520228+0000","last_unstale":"2023-11-30T23:12:48.950329+0000","last_undegraded":"2023-11-30T23:12:48.950329+0000","last_fullsized":"2023-11-30T23:12:48.950329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:26:06.870586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948524+0000","last_change":"2023-11-30T23:12:47.515492+0000","last_active":"2023-11-30T23:12:48.948524+0000","last_peered":"2023-11-30T23:12:48.948524+0000","last_clean":"2023-11-30T23:12:48.948524+0000","last_became_active":"2023-11-30T23:12:47.515247+0000","last_became_peered":"2023-11-30T23:12:47.515247+0000","last_unstale":"2023-11-30T23:12:48.948524+0000","last_undegraded":"2023-11-30T23:12:48.948524+0000","last_fullsized":"2023-11-30T23:12:48.948524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948562+0000","last_change":"2023-11-30T23:12:47.511363+0000","last_active":"2023-11-30T23:12:48.948562+0000","last_peered":"2023-11-30T23:12:48.948562+0000","last_clean":"2023-11-30T23:12:48.948562+0000","last_became_active":"2023-11-30T23:12:47.511097+0000","last_became_peered":"2023-11-30T23:12:47.511097+0000","last_unstale":"2023-11-30T23:12:48.948562+0000","last_undegraded":"2023-11-30T23:12:48.948562+0000","last_fullsized":"2023-11-30T23:12:48.948562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949389+0000","last_change":"2023-11-30T23:12:47.510657+0000","last_active":"2023-11-30T23:12:48.949389+0000","last_peered":"2023-11-30T23:12:48.949389+0000","last_clean":"2023-11-30T23:12:48.949389+0000","last_became_active":"2023-11-30T23:12:47.510404+0000","last_became_peered":"2023-11-30T23:12:47.510404+0000","last_unstale":"2023-11-30T23:12:48.949389+0000","last_undegraded":"2023-11-30T23:12:48.949389+0000","last_fullsized":"2023-11-30T23:12:48.949389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949508+0000","last_change":"2023-11-30T23:12:47.516808+0000","last_active":"2023-11-30T23:12:48.949508+0000","last_peered":"2023-11-30T23:12:48.949508+0000","last_clean":"2023-11-30T23:12:48.949508+0000","last_became_active":"2023-11-30T23:12:47.516539+0000","last_became_peered":"2023-11-30T23:12:47.516539+0000","last_unstale":"2023-11-30T23:12:48.949508+0000","last_undegraded":"2023-11-30T23:12:48.949508+0000","last_fullsized":"2023-11-30T23:12:48.949508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493067+0000","last_change":"2023-11-30T23:12:47.506558+0000","last_active":"2023-11-30T23:12:48.493067+0000","last_peered":"2023-11-30T23:12:48.493067+0000","last_clean":"2023-11-30T23:12:48.493067+0000","last_became_active":"2023-11-30T23:12:47.506284+0000","last_became_peered":"2023-11-30T23:12:47.506284+0000","last_unstale":"2023-11-30T23:12:48.493067+0000","last_undegraded":"2023-11-30T23:12:48.493067+0000","last_fullsized":"2023-11-30T23:12:48.493067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949214+0000","last_change":"2023-11-30T23:12:47.512060+0000","last_active":"2023-11-30T23:12:48.949214+0000","last_peered":"2023-11-30T23:12:48.949214+0000","last_clean":"2023-11-30T23:12:48.949214+0000","last_became_active":"2023-11-30T23:12:47.511800+0000","last_became_peered":"2023-11-30T23:12:47.511800+0000","last_unstale":"2023-11-30T23:12:48.949214+0000","last_undegraded":"2023-11-30T23:12:48.949214+0000","last_fullsized":"2023-11-30T23:12:48.949214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491631+0000","last_change":"2023-11-30T23:12:47.513225+0000","last_active":"2023-11-30T23:12:48.491631+0000","last_peered":"2023-11-30T23:12:48.491631+0000","last_clean":"2023-11-30T23:12:48.491631+0000","last_became_active":"2023-11-30T23:12:47.512978+0000","last_became_peered":"2023-11-30T23:12:47.512978+0000","last_unstale":"2023-11-30T23:12:48.491631+0000","last_undegraded":"2023-11-30T23:12:48.491631+0000","last_fullsized":"2023-11-30T23:12:48.491631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950359+0000","last_change":"2023-11-30T23:12:47.511972+0000","last_active":"2023-11-30T23:12:48.950359+0000","last_peered":"2023-11-30T23:12:48.950359+0000","last_clean":"2023-11-30T23:12:48.950359+0000","last_became_active":"2023-11-30T23:12:47.511699+0000","last_became_peered":"2023-11-30T23:12:47.511699+0000","last_unstale":"2023-11-30T23:12:48.950359+0000","last_undegraded":"2023-11-30T23:12:48.950359+0000","last_fullsized":"2023-11-30T23:12:48.950359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493146+0000","last_change":"2023-11-30T23:12:47.521874+0000","last_active":"2023-11-30T23:12:48.493146+0000","last_peered":"2023-11-30T23:12:48.493146+0000","last_clean":"2023-11-30T23:12:48.493146+0000","last_became_active":"2023-11-30T23:12:47.521604+0000","last_became_peered":"2023-11-30T23:12:47.521604+0000","last_unstale":"2023-11-30T23:12:48.493146+0000","last_undegraded":"2023-11-30T23:12:48.493146+0000","last_fullsized":"2023-11-30T23:12:48.493146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:02.220181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948617+0000","last_change":"2023-11-30T23:12:47.517728+0000","last_active":"2023-11-30T23:12:48.948617+0000","last_peered":"2023-11-30T23:12:48.948617+0000","last_clean":"2023-11-30T23:12:48.948617+0000","last_became_active":"2023-11-30T23:12:47.517283+0000","last_became_peered":"2023-11-30T23:12:47.517283+0000","last_unstale":"2023-11-30T23:12:48.948617+0000","last_undegraded":"2023-11-30T23:12:48.948617+0000","last_fullsized":"2023-11-30T23:12:48.948617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949668+0000","last_change":"2023-11-30T23:12:47.509055+0000","last_active":"2023-11-30T23:12:48.949668+0000","last_peered":"2023-11-30T23:12:48.949668+0000","last_clean":"2023-11-30T23:12:48.949668+0000","last_became_active":"2023-11-30T23:12:47.508725+0000","last_became_peered":"2023-11-30T23:12:47.508725+0000","last_unstale":"2023-11-30T23:12:48.949668+0000","last_undegraded":"2023-11-30T23:12:48.949668+0000","last_fullsized":"2023-11-30T23:12:48.949668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:54.893320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949177+0000","last_change":"2023-11-30T23:12:47.139071+0000","last_active":"2023-11-30T23:12:48.949177+0000","last_peered":"2023-11-30T23:12:48.949177+0000","last_clean":"2023-11-30T23:12:48.949177+0000","last_became_active":"2023-11-30T23:12:47.138768+0000","last_became_peered":"2023-11-30T23:12:47.138768+0000","last_unstale":"2023-11-30T23:12:48.949177+0000","last_undegraded":"2023-11-30T23:12:48.949177+0000","last_fullsized":"2023-11-30T23:12:48.949177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491791+0000","last_change":"2023-11-30T23:12:47.516574+0000","last_active":"2023-11-30T23:12:48.491791+0000","last_peered":"2023-11-30T23:12:48.491791+0000","last_clean":"2023-11-30T23:12:48.491791+0000","last_became_active":"2023-11-30T23:12:47.516214+0000","last_became_peered":"2023-11-30T23:12:47.516214+0000","last_unstale":"2023-11-30T23:12:48.491791+0000","last_undegraded":"2023-11-30T23:12:48.491791+0000","last_fullsized":"2023-11-30T23:12:48.491791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948803+0000","last_change":"2023-11-30T23:12:47.130416+0000","last_active":"2023-11-30T23:12:48.948803+0000","last_peered":"2023-11-30T23:12:48.948803+0000","last_clean":"2023-11-30T23:12:48.948803+0000","last_became_active":"2023-11-30T23:12:47.129771+0000","last_became_peered":"2023-11-30T23:12:47.129771+0000","last_unstale":"2023-11-30T23:12:48.948803+0000","last_undegraded":"2023-11-30T23:12:48.948803+0000","last_fullsized":"2023-11-30T23:12:48.948803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948794+0000","last_change":"2023-11-30T23:12:47.133733+0000","last_active":"2023-11-30T23:12:48.948794+0000","last_peered":"2023-11-30T23:12:48.948794+0000","last_clean":"2023-11-30T23:12:48.948794+0000","last_became_active":"2023-11-30T23:12:47.133440+0000","last_became_peered":"2023-11-30T23:12:47.133440+0000","last_unstale":"2023-11-30T23:12:48.948794+0000","last_undegraded":"2023-11-30T23:12:48.948794+0000","last_fullsized":"2023-11-30T23:12:48.948794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:48.913175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948507+0000","last_change":"2023-11-30T23:12:47.507868+0000","last_active":"2023-11-30T23:12:48.948507+0000","last_peered":"2023-11-30T23:12:48.948507+0000","last_clean":"2023-11-30T23:12:48.948507+0000","last_became_active":"2023-11-30T23:12:47.507617+0000","last_became_peered":"2023-11-30T23:12:47.507617+0000","last_unstale":"2023-11-30T23:12:48.948507+0000","last_undegraded":"2023-11-30T23:12:48.948507+0000","last_fullsized":"2023-11-30T23:12:48.948507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:08:47.117163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948855+0000","last_change":"2023-11-30T23:12:47.132638+0000","last_active":"2023-11-30T23:12:48.948855+0000","last_peered":"2023-11-30T23:12:48.948855+0000","last_clean":"2023-11-30T23:12:48.948855+0000","last_became_active":"2023-11-30T23:12:47.132351+0000","last_became_peered":"2023-11-30T23:12:47.132351+0000","last_unstale":"2023-11-30T23:12:48.948855+0000","last_undegraded":"2023-11-30T23:12:48.948855+0000","last_fullsized":"2023-11-30T23:12:48.948855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492595+0000","last_change":"2023-11-30T23:12:47.506332+0000","last_active":"2023-11-30T23:12:48.492595+0000","last_peered":"2023-11-30T23:12:48.492595+0000","last_clean":"2023-11-30T23:12:48.492595+0000","last_became_active":"2023-11-30T23:12:47.506082+0000","last_became_peered":"2023-11-30T23:12:47.506082+0000","last_unstale":"2023-11-30T23:12:48.492595+0000","last_undegraded":"2023-11-30T23:12:48.492595+0000","last_fullsized":"2023-11-30T23:12:48.492595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951065+0000","last_change":"2023-11-30T23:12:47.139722+0000","last_active":"2023-11-30T23:12:48.951065+0000","last_peered":"2023-11-30T23:12:48.951065+0000","last_clean":"2023-11-30T23:12:48.951065+0000","last_became_active":"2023-11-30T23:12:47.139400+0000","last_became_peered":"2023-11-30T23:12:47.139400+0000","last_unstale":"2023-11-30T23:12:48.951065+0000","last_undegraded":"2023-11-30T23:12:48.951065+0000","last_fullsized":"2023-11-30T23:12:48.951065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952521+0000","last_change":"2023-11-30T23:12:47.520429+0000","last_active":"2023-11-30T23:12:48.952521+0000","last_peered":"2023-11-30T23:12:48.952521+0000","last_clean":"2023-11-30T23:12:48.952521+0000","last_became_active":"2023-11-30T23:12:47.520153+0000","last_became_peered":"2023-11-30T23:12:47.520153+0000","last_unstale":"2023-11-30T23:12:48.952521+0000","last_undegraded":"2023-11-30T23:12:48.952521+0000","last_fullsized":"2023-11-30T23:12:48.952521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:17:01.774183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952510+0000","last_change":"2023-11-30T23:12:47.139328+0000","last_active":"2023-11-30T23:12:48.952510+0000","last_peered":"2023-11-30T23:12:48.952510+0000","last_clean":"2023-11-30T23:12:48.952510+0000","last_became_active":"2023-11-30T23:12:47.139047+0000","last_became_peered":"2023-11-30T23:12:47.139047+0000","last_unstale":"2023-11-30T23:12:48.952510+0000","last_undegraded":"2023-11-30T23:12:48.952510+0000","last_fullsized":"2023-11-30T23:12:48.952510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491614+0000","last_change":"2023-11-30T23:12:47.522974+0000","last_active":"2023-11-30T23:12:48.491614+0000","last_peered":"2023-11-30T23:12:48.491614+0000","last_clean":"2023-11-30T23:12:48.491614+0000","last_became_active":"2023-11-30T23:12:47.522711+0000","last_became_peered":"2023-11-30T23:12:47.522711+0000","last_unstale":"2023-11-30T23:12:48.491614+0000","last_undegraded":"2023-11-30T23:12:48.491614+0000","last_fullsized":"2023-11-30T23:12:48.491614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:19:43.387626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493283+0000","last_change":"2023-11-30T23:12:47.140794+0000","last_active":"2023-11-30T23:12:48.493283+0000","last_peered":"2023-11-30T23:12:48.493283+0000","last_clean":"2023-11-30T23:12:48.493283+0000","last_became_active":"2023-11-30T23:12:47.140531+0000","last_became_peered":"2023-11-30T23:12:47.140531+0000","last_unstale":"2023-11-30T23:12:48.493283+0000","last_undegraded":"2023-11-30T23:12:48.493283+0000","last_fullsized":"2023-11-30T23:12:48.493283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:53.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952707+0000","last_change":"2023-11-30T23:12:47.517475+0000","last_active":"2023-11-30T23:12:48.952707+0000","last_peered":"2023-11-30T23:12:48.952707+0000","last_clean":"2023-11-30T23:12:48.952707+0000","last_became_active":"2023-11-30T23:12:47.513983+0000","last_became_peered":"2023-11-30T23:12:47.513983+0000","last_unstale":"2023-11-30T23:12:48.952707+0000","last_undegraded":"2023-11-30T23:12:48.952707+0000","last_fullsized":"2023-11-30T23:12:48.952707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:39.696562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949883+0000","last_change":"2023-11-30T23:12:47.140168+0000","last_active":"2023-11-30T23:12:48.949883+0000","last_peered":"2023-11-30T23:12:48.949883+0000","last_clean":"2023-11-30T23:12:48.949883+0000","last_became_active":"2023-11-30T23:12:47.139799+0000","last_became_peered":"2023-11-30T23:12:47.139799+0000","last_unstale":"2023-11-30T23:12:48.949883+0000","last_undegraded":"2023-11-30T23:12:48.949883+0000","last_fullsized":"2023-11-30T23:12:48.949883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949684+0000","last_change":"2023-11-30T23:12:47.503606+0000","last_active":"2023-11-30T23:12:48.949684+0000","last_peered":"2023-11-30T23:12:48.949684+0000","last_clean":"2023-11-30T23:12:48.949684+0000","last_became_active":"2023-11-30T23:12:47.503333+0000","last_became_peered":"2023-11-30T23:12:47.503333+0000","last_unstale":"2023-11-30T23:12:48.949684+0000","last_undegraded":"2023-11-30T23:12:48.949684+0000","last_fullsized":"2023-11-30T23:12:48.949684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491844+0000","last_change":"2023-11-30T23:12:47.136931+0000","last_active":"2023-11-30T23:12:48.491844+0000","last_peered":"2023-11-30T23:12:48.491844+0000","last_clean":"2023-11-30T23:12:48.491844+0000","last_became_active":"2023-11-30T23:12:47.136620+0000","last_became_peered":"2023-11-30T23:12:47.136620+0000","last_unstale":"2023-11-30T23:12:48.491844+0000","last_undegraded":"2023-11-30T23:12:48.491844+0000","last_fullsized":"2023-11-30T23:12:48.491844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:22:43.069951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491335+0000","last_change":"2023-11-30T23:12:47.503541+0000","last_active":"2023-11-30T23:12:48.491335+0000","last_peered":"2023-11-30T23:12:48.491335+0000","last_clean":"2023-11-30T23:12:48.491335+0000","last_became_active":"2023-11-30T23:12:47.503294+0000","last_became_peered":"2023-11-30T23:12:47.503294+0000","last_unstale":"2023-11-30T23:12:48.491335+0000","last_undegraded":"2023-11-30T23:12:48.491335+0000","last_fullsized":"2023-11-30T23:12:48.491335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950583+0000","last_change":"2023-11-30T23:12:47.140575+0000","last_active":"2023-11-30T23:12:48.950583+0000","last_peered":"2023-11-30T23:12:48.950583+0000","last_clean":"2023-11-30T23:12:48.950583+0000","last_became_active":"2023-11-30T23:12:47.140125+0000","last_became_peered":"2023-11-30T23:12:47.140125+0000","last_unstale":"2023-11-30T23:12:48.950583+0000","last_undegraded":"2023-11-30T23:12:48.950583+0000","last_fullsized":"2023-11-30T23:12:48.950583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950166+0000","last_change":"2023-11-30T23:12:47.515720+0000","last_active":"2023-11-30T23:12:48.950166+0000","last_peered":"2023-11-30T23:12:48.950166+0000","last_clean":"2023-11-30T23:12:48.950166+0000","last_became_active":"2023-11-30T23:12:47.515427+0000","last_became_peered":"2023-11-30T23:12:47.515427+0000","last_unstale":"2023-11-30T23:12:48.950166+0000","last_undegraded":"2023-11-30T23:12:48.950166+0000","last_fullsized":"2023-11-30T23:12:48.950166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:26:06.870586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949198+0000","last_change":"2023-11-30T23:12:47.129492+0000","last_active":"2023-11-30T23:12:48.949198+0000","last_peered":"2023-11-30T23:12:48.949198+0000","last_clean":"2023-11-30T23:12:48.949198+0000","last_became_active":"2023-11-30T23:12:47.129180+0000","last_became_peered":"2023-11-30T23:12:47.129180+0000","last_unstale":"2023-11-30T23:12:48.949198+0000","last_undegraded":"2023-11-30T23:12:48.949198+0000","last_fullsized":"2023-11-30T23:12:48.949198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948802+0000","last_change":"2023-11-30T23:12:47.517541+0000","last_active":"2023-11-30T23:12:48.948802+0000","last_peered":"2023-11-30T23:12:48.948802+0000","last_clean":"2023-11-30T23:12:48.948802+0000","last_became_active":"2023-11-30T23:12:47.516980+0000","last_became_peered":"2023-11-30T23:12:47.516980+0000","last_unstale":"2023-11-30T23:12:48.948802+0000","last_undegraded":"2023-11-30T23:12:48.948802+0000","last_fullsized":"2023-11-30T23:12:48.948802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492929+0000","last_change":"2023-11-30T23:12:47.129703+0000","last_active":"2023-11-30T23:12:48.492929+0000","last_peered":"2023-11-30T23:12:48.492929+0000","last_clean":"2023-11-30T23:12:48.492929+0000","last_became_active":"2023-11-30T23:12:47.129349+0000","last_became_peered":"2023-11-30T23:12:47.129349+0000","last_unstale":"2023-11-30T23:12:48.492929+0000","last_undegraded":"2023-11-30T23:12:48.492929+0000","last_fullsized":"2023-11-30T23:12:48.492929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949277+0000","last_change":"2023-11-30T23:12:47.514610+0000","last_active":"2023-11-30T23:12:48.949277+0000","last_peered":"2023-11-30T23:12:48.949277+0000","last_clean":"2023-11-30T23:12:48.949277+0000","last_became_active":"2023-11-30T23:12:47.514140+0000","last_became_peered":"2023-11-30T23:12:47.514140+0000","last_unstale":"2023-11-30T23:12:48.949277+0000","last_undegraded":"2023-11-30T23:12:48.949277+0000","last_fullsized":"2023-11-30T23:12:48.949277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:54:46.925262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952235+0000","last_change":"2023-11-30T23:12:47.136924+0000","last_active":"2023-11-30T23:12:48.952235+0000","last_peered":"2023-11-30T23:12:48.952235+0000","last_clean":"2023-11-30T23:12:48.952235+0000","last_became_active":"2023-11-30T23:12:47.136631+0000","last_became_peered":"2023-11-30T23:12:47.136631+0000","last_unstale":"2023-11-30T23:12:48.952235+0000","last_undegraded":"2023-11-30T23:12:48.952235+0000","last_fullsized":"2023-11-30T23:12:48.952235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:22:48.835054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950899+0000","last_change":"2023-11-30T23:12:47.514450+0000","last_active":"2023-11-30T23:12:48.950899+0000","last_peered":"2023-11-30T23:12:48.950899+0000","last_clean":"2023-11-30T23:12:48.950899+0000","last_became_active":"2023-11-30T23:12:47.514053+0000","last_became_peered":"2023-11-30T23:12:47.514053+0000","last_unstale":"2023-11-30T23:12:48.950899+0000","last_undegraded":"2023-11-30T23:12:48.950899+0000","last_fullsized":"2023-11-30T23:12:48.950899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.494177+0000","last_change":"2023-11-30T23:12:47.138008+0000","last_active":"2023-11-30T23:12:48.494177+0000","last_peered":"2023-11-30T23:12:48.494177+0000","last_clean":"2023-11-30T23:12:48.494177+0000","last_became_active":"2023-11-30T23:12:47.137695+0000","last_became_peered":"2023-11-30T23:12:47.137695+0000","last_unstale":"2023-11-30T23:12:48.494177+0000","last_undegraded":"2023-11-30T23:12:48.494177+0000","last_fullsized":"2023-11-30T23:12:48.494177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951499+0000","last_change":"2023-11-30T23:12:47.516065+0000","last_active":"2023-11-30T23:12:48.951499+0000","last_peered":"2023-11-30T23:12:48.951499+0000","last_clean":"2023-11-30T23:12:48.951499+0000","last_became_active":"2023-11-30T23:12:47.514822+0000","last_became_peered":"2023-11-30T23:12:47.514822+0000","last_unstale":"2023-11-30T23:12:48.951499+0000","last_undegraded":"2023-11-30T23:12:48.951499+0000","last_fullsized":"2023-11-30T23:12:48.951499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:02:36.020857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493499+0000","last_change":"2023-11-30T23:12:47.129184+0000","last_active":"2023-11-30T23:12:48.493499+0000","last_peered":"2023-11-30T23:12:48.493499+0000","last_clean":"2023-11-30T23:12:48.493499+0000","last_became_active":"2023-11-30T23:12:47.128682+0000","last_became_peered":"2023-11-30T23:12:47.128682+0000","last_unstale":"2023-11-30T23:12:48.493499+0000","last_undegraded":"2023-11-30T23:12:48.493499+0000","last_fullsized":"2023-11-30T23:12:48.493499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.952861+0000","last_change":"2023-11-30T23:12:47.516581+0000","last_active":"2023-11-30T23:12:48.952861+0000","last_peered":"2023-11-30T23:12:48.952861+0000","last_clean":"2023-11-30T23:12:48.952861+0000","last_became_active":"2023-11-30T23:12:47.516317+0000","last_became_peered":"2023-11-30T23:12:47.516317+0000","last_unstale":"2023-11-30T23:12:48.952861+0000","last_undegraded":"2023-11-30T23:12:48.952861+0000","last_fullsized":"2023-11-30T23:12:48.952861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:20:31.102899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493457+0000","last_change":"2023-11-30T23:12:47.140679+0000","last_active":"2023-11-30T23:12:48.493457+0000","last_peered":"2023-11-30T23:12:48.493457+0000","last_clean":"2023-11-30T23:12:48.493457+0000","last_became_active":"2023-11-30T23:12:47.140400+0000","last_became_peered":"2023-11-30T23:12:47.140400+0000","last_unstale":"2023-11-30T23:12:48.493457+0000","last_undegraded":"2023-11-30T23:12:48.493457+0000","last_fullsized":"2023-11-30T23:12:48.493457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949914+0000","last_change":"2023-11-30T23:12:47.521764+0000","last_active":"2023-11-30T23:12:48.949914+0000","last_peered":"2023-11-30T23:12:48.949914+0000","last_clean":"2023-11-30T23:12:48.949914+0000","last_became_active":"2023-11-30T23:12:47.521481+0000","last_became_peered":"2023-11-30T23:12:47.521481+0000","last_unstale":"2023-11-30T23:12:48.949914+0000","last_undegraded":"2023-11-30T23:12:48.949914+0000","last_fullsized":"2023-11-30T23:12:48.949914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:17:01.774183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-30T23:12:47.490864+0000","last_change":"2023-11-30T23:12:36.558633+0000","last_active":"2023-11-30T23:12:47.490864+0000","last_peered":"2023-11-30T23:12:47.490864+0000","last_clean":"2023-11-30T23:12:47.490864+0000","last_became_active":"2023-11-30T23:12:36.556455+0000","last_became_peered":"2023-11-30T23:12:36.556455+0000","last_unstale":"2023-11-30T23:12:47.490864+0000","last_undegraded":"2023-11-30T23:12:47.490864+0000","last_fullsized":"2023-11-30T23:12:47.490864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:34.652815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:34.652815+0000","last_clean_scrub_stamp":"2023-11-30T23:12:34.652815+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:36:52.941511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948996+0000","last_change":"2023-11-30T23:12:47.132985+0000","last_active":"2023-11-30T23:12:48.948996+0000","last_peered":"2023-11-30T23:12:48.948996+0000","last_clean":"2023-11-30T23:12:48.948996+0000","last_became_active":"2023-11-30T23:12:47.132365+0000","last_became_peered":"2023-11-30T23:12:47.132365+0000","last_unstale":"2023-11-30T23:12:48.948996+0000","last_undegraded":"2023-11-30T23:12:48.948996+0000","last_fullsized":"2023-11-30T23:12:48.948996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949001+0000","last_change":"2023-11-30T23:12:47.509943+0000","last_active":"2023-11-30T23:12:48.949001+0000","last_peered":"2023-11-30T23:12:48.949001+0000","last_clean":"2023-11-30T23:12:48.949001+0000","last_became_active":"2023-11-30T23:12:47.508677+0000","last_became_peered":"2023-11-30T23:12:47.508677+0000","last_unstale":"2023-11-30T23:12:48.949001+0000","last_undegraded":"2023-11-30T23:12:48.949001+0000","last_fullsized":"2023-11-30T23:12:48.949001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948349+0000","last_change":"2023-11-30T23:12:47.148775+0000","last_active":"2023-11-30T23:12:48.948349+0000","last_peered":"2023-11-30T23:12:48.948349+0000","last_clean":"2023-11-30T23:12:48.948349+0000","last_became_active":"2023-11-30T23:12:47.148547+0000","last_became_peered":"2023-11-30T23:12:47.148547+0000","last_unstale":"2023-11-30T23:12:48.948349+0000","last_undegraded":"2023-11-30T23:12:48.948349+0000","last_fullsized":"2023-11-30T23:12:48.948349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:01.207700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.490955+0000","last_change":"2023-11-30T23:12:47.515805+0000","last_active":"2023-11-30T23:12:48.490955+0000","last_peered":"2023-11-30T23:12:48.490955+0000","last_clean":"2023-11-30T23:12:48.490955+0000","last_became_active":"2023-11-30T23:12:47.515553+0000","last_became_peered":"2023-11-30T23:12:47.515553+0000","last_unstale":"2023-11-30T23:12:48.490955+0000","last_undegraded":"2023-11-30T23:12:48.490955+0000","last_fullsized":"2023-11-30T23:12:48.490955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:22.086661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.493249+0000","last_change":"2023-11-30T23:12:47.136018+0000","last_active":"2023-11-30T23:12:48.493249+0000","last_peered":"2023-11-30T23:12:48.493249+0000","last_clean":"2023-11-30T23:12:48.493249+0000","last_became_active":"2023-11-30T23:12:47.135746+0000","last_became_peered":"2023-11-30T23:12:47.135746+0000","last_unstale":"2023-11-30T23:12:48.493249+0000","last_undegraded":"2023-11-30T23:12:48.493249+0000","last_fullsized":"2023-11-30T23:12:48.493249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492802+0000","last_change":"2023-11-30T23:12:47.513832+0000","last_active":"2023-11-30T23:12:48.492802+0000","last_peered":"2023-11-30T23:12:48.492802+0000","last_clean":"2023-11-30T23:12:48.492802+0000","last_became_active":"2023-11-30T23:12:47.510024+0000","last_became_peered":"2023-11-30T23:12:47.510024+0000","last_unstale":"2023-11-30T23:12:48.492802+0000","last_undegraded":"2023-11-30T23:12:48.492802+0000","last_fullsized":"2023-11-30T23:12:48.492802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950516+0000","last_change":"2023-11-30T23:12:47.141605+0000","last_active":"2023-11-30T23:12:48.950516+0000","last_peered":"2023-11-30T23:12:48.950516+0000","last_clean":"2023-11-30T23:12:48.950516+0000","last_became_active":"2023-11-30T23:12:47.141115+0000","last_became_peered":"2023-11-30T23:12:47.141115+0000","last_unstale":"2023-11-30T23:12:48.950516+0000","last_undegraded":"2023-11-30T23:12:48.950516+0000","last_fullsized":"2023-11-30T23:12:48.950516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951647+0000","last_change":"2023-11-30T23:12:47.514830+0000","last_active":"2023-11-30T23:12:48.951647+0000","last_peered":"2023-11-30T23:12:48.951647+0000","last_clean":"2023-11-30T23:12:48.951647+0000","last_became_active":"2023-11-30T23:12:47.514572+0000","last_became_peered":"2023-11-30T23:12:47.514572+0000","last_unstale":"2023-11-30T23:12:48.951647+0000","last_undegraded":"2023-11-30T23:12:48.951647+0000","last_fullsized":"2023-11-30T23:12:48.951647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:29.167074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.494540+0000","last_change":"2023-11-30T23:12:47.141801+0000","last_active":"2023-11-30T23:12:48.494540+0000","last_peered":"2023-11-30T23:12:48.494540+0000","last_clean":"2023-11-30T23:12:48.494540+0000","last_became_active":"2023-11-30T23:12:47.141411+0000","last_became_peered":"2023-11-30T23:12:47.141411+0000","last_unstale":"2023-11-30T23:12:48.494540+0000","last_undegraded":"2023-11-30T23:12:48.494540+0000","last_fullsized":"2023-11-30T23:12:48.494540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951738+0000","last_change":"2023-11-30T23:12:47.519303+0000","last_active":"2023-11-30T23:12:48.951738+0000","last_peered":"2023-11-30T23:12:48.951738+0000","last_clean":"2023-11-30T23:12:48.951738+0000","last_became_active":"2023-11-30T23:12:47.517033+0000","last_became_peered":"2023-11-30T23:12:47.517033+0000","last_unstale":"2023-11-30T23:12:48.951738+0000","last_undegraded":"2023-11-30T23:12:48.951738+0000","last_fullsized":"2023-11-30T23:12:48.951738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950582+0000","last_change":"2023-11-30T23:12:47.143317+0000","last_active":"2023-11-30T23:12:48.950582+0000","last_peered":"2023-11-30T23:12:48.950582+0000","last_clean":"2023-11-30T23:12:48.950582+0000","last_became_active":"2023-11-30T23:12:47.143061+0000","last_became_peered":"2023-11-30T23:12:47.143061+0000","last_unstale":"2023-11-30T23:12:48.950582+0000","last_undegraded":"2023-11-30T23:12:48.950582+0000","last_fullsized":"2023-11-30T23:12:48.950582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:38.684081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.494595+0000","last_change":"2023-11-30T23:12:47.501784+0000","last_active":"2023-11-30T23:12:48.494595+0000","last_peered":"2023-11-30T23:12:48.494595+0000","last_clean":"2023-11-30T23:12:48.494595+0000","last_became_active":"2023-11-30T23:12:47.501516+0000","last_became_peered":"2023-11-30T23:12:47.501516+0000","last_unstale":"2023-11-30T23:12:48.494595+0000","last_undegraded":"2023-11-30T23:12:48.494595+0000","last_fullsized":"2023-11-30T23:12:48.494595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:34:32.232378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:49.077550+0000","last_change":"2023-11-30T23:12:47.135053+0000","last_active":"2023-11-30T23:12:49.077550+0000","last_peered":"2023-11-30T23:12:49.077550+0000","last_clean":"2023-11-30T23:12:49.077550+0000","last_became_active":"2023-11-30T23:12:47.134776+0000","last_became_peered":"2023-11-30T23:12:47.134776+0000","last_unstale":"2023-11-30T23:12:49.077550+0000","last_undegraded":"2023-11-30T23:12:49.077550+0000","last_fullsized":"2023-11-30T23:12:49.077550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949473+0000","last_change":"2023-11-30T23:12:47.498935+0000","last_active":"2023-11-30T23:12:48.949473+0000","last_peered":"2023-11-30T23:12:48.949473+0000","last_clean":"2023-11-30T23:12:48.949473+0000","last_became_active":"2023-11-30T23:12:47.498631+0000","last_became_peered":"2023-11-30T23:12:47.498631+0000","last_unstale":"2023-11-30T23:12:48.949473+0000","last_undegraded":"2023-11-30T23:12:48.949473+0000","last_fullsized":"2023-11-30T23:12:48.949473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951298+0000","last_change":"2023-11-30T23:12:47.137707+0000","last_active":"2023-11-30T23:12:48.951298+0000","last_peered":"2023-11-30T23:12:48.951298+0000","last_clean":"2023-11-30T23:12:48.951298+0000","last_became_active":"2023-11-30T23:12:47.137406+0000","last_became_peered":"2023-11-30T23:12:47.137406+0000","last_unstale":"2023-11-30T23:12:48.951298+0000","last_undegraded":"2023-11-30T23:12:48.951298+0000","last_fullsized":"2023-11-30T23:12:48.951298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491277+0000","last_change":"2023-11-30T23:12:47.506770+0000","last_active":"2023-11-30T23:12:48.491277+0000","last_peered":"2023-11-30T23:12:48.491277+0000","last_clean":"2023-11-30T23:12:48.491277+0000","last_became_active":"2023-11-30T23:12:47.506447+0000","last_became_peered":"2023-11-30T23:12:47.506447+0000","last_unstale":"2023-11-30T23:12:48.491277+0000","last_undegraded":"2023-11-30T23:12:48.491277+0000","last_fullsized":"2023-11-30T23:12:48.491277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:35:21.183993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948253+0000","last_change":"2023-11-30T23:12:47.142532+0000","last_active":"2023-11-30T23:12:48.948253+0000","last_peered":"2023-11-30T23:12:48.948253+0000","last_clean":"2023-11-30T23:12:48.948253+0000","last_became_active":"2023-11-30T23:12:47.142135+0000","last_became_peered":"2023-11-30T23:12:47.142135+0000","last_unstale":"2023-11-30T23:12:48.948253+0000","last_undegraded":"2023-11-30T23:12:48.948253+0000","last_fullsized":"2023-11-30T23:12:48.948253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:53.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949668+0000","last_change":"2023-11-30T23:12:47.514258+0000","last_active":"2023-11-30T23:12:48.949668+0000","last_peered":"2023-11-30T23:12:48.949668+0000","last_clean":"2023-11-30T23:12:48.949668+0000","last_became_active":"2023-11-30T23:12:47.513966+0000","last_became_peered":"2023-11-30T23:12:47.513966+0000","last_unstale":"2023-11-30T23:12:48.949668+0000","last_undegraded":"2023-11-30T23:12:48.949668+0000","last_fullsized":"2023-11-30T23:12:48.949668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:02.220181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492838+0000","last_change":"2023-11-30T23:12:47.140898+0000","last_active":"2023-11-30T23:12:48.492838+0000","last_peered":"2023-11-30T23:12:48.492838+0000","last_clean":"2023-11-30T23:12:48.492838+0000","last_became_active":"2023-11-30T23:12:47.140565+0000","last_became_peered":"2023-11-30T23:12:47.140565+0000","last_unstale":"2023-11-30T23:12:48.492838+0000","last_undegraded":"2023-11-30T23:12:48.492838+0000","last_fullsized":"2023-11-30T23:12:48.492838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948628+0000","last_change":"2023-11-30T23:12:47.501516+0000","last_active":"2023-11-30T23:12:48.948628+0000","last_peered":"2023-11-30T23:12:48.948628+0000","last_clean":"2023-11-30T23:12:48.948628+0000","last_became_active":"2023-11-30T23:12:47.501315+0000","last_became_peered":"2023-11-30T23:12:47.501315+0000","last_unstale":"2023-11-30T23:12:48.948628+0000","last_undegraded":"2023-11-30T23:12:48.948628+0000","last_fullsized":"2023-11-30T23:12:48.948628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.492956+0000","last_change":"2023-11-30T23:12:47.140328+0000","last_active":"2023-11-30T23:12:48.492956+0000","last_peered":"2023-11-30T23:12:48.492956+0000","last_clean":"2023-11-30T23:12:48.492956+0000","last_became_active":"2023-11-30T23:12:47.140037+0000","last_became_peered":"2023-11-30T23:12:47.140037+0000","last_unstale":"2023-11-30T23:12:48.492956+0000","last_undegraded":"2023-11-30T23:12:48.492956+0000","last_fullsized":"2023-11-30T23:12:48.492956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:38.684081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949106+0000","last_change":"2023-11-30T23:12:47.509056+0000","last_active":"2023-11-30T23:12:48.949106+0000","last_peered":"2023-11-30T23:12:48.949106+0000","last_clean":"2023-11-30T23:12:48.949106+0000","last_became_active":"2023-11-30T23:12:47.507181+0000","last_became_peered":"2023-11-30T23:12:47.507181+0000","last_unstale":"2023-11-30T23:12:48.949106+0000","last_undegraded":"2023-11-30T23:12:48.949106+0000","last_fullsized":"2023-11-30T23:12:48.949106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950357+0000","last_change":"2023-11-30T23:12:47.142027+0000","last_active":"2023-11-30T23:12:48.950357+0000","last_peered":"2023-11-30T23:12:48.950357+0000","last_clean":"2023-11-30T23:12:48.950357+0000","last_became_active":"2023-11-30T23:12:47.141664+0000","last_became_peered":"2023-11-30T23:12:47.141664+0000","last_unstale":"2023-11-30T23:12:48.950357+0000","last_undegraded":"2023-11-30T23:12:48.950357+0000","last_fullsized":"2023-11-30T23:12:48.950357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.948584+0000","last_change":"2023-11-30T23:12:47.517183+0000","last_active":"2023-11-30T23:12:48.948584+0000","last_peered":"2023-11-30T23:12:48.948584+0000","last_clean":"2023-11-30T23:12:48.948584+0000","last_became_active":"2023-11-30T23:12:47.516939+0000","last_became_peered":"2023-11-30T23:12:47.516939+0000","last_unstale":"2023-11-30T23:12:48.948584+0000","last_undegraded":"2023-11-30T23:12:48.948584+0000","last_fullsized":"2023-11-30T23:12:48.948584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.951672+0000","last_change":"2023-11-30T23:12:47.522937+0000","last_active":"2023-11-30T23:12:48.951672+0000","last_peered":"2023-11-30T23:12:48.951672+0000","last_clean":"2023-11-30T23:12:48.951672+0000","last_became_active":"2023-11-30T23:12:47.521310+0000","last_became_peered":"2023-11-30T23:12:47.521310+0000","last_unstale":"2023-11-30T23:12:48.951672+0000","last_undegraded":"2023-11-30T23:12:48.951672+0000","last_fullsized":"2023-11-30T23:12:48.951672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:08:47.117163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950610+0000","last_change":"2023-11-30T23:12:47.143819+0000","last_active":"2023-11-30T23:12:48.950610+0000","last_peered":"2023-11-30T23:12:48.950610+0000","last_clean":"2023-11-30T23:12:48.950610+0000","last_became_active":"2023-11-30T23:12:47.143512+0000","last_became_peered":"2023-11-30T23:12:47.143512+0000","last_unstale":"2023-11-30T23:12:48.950610+0000","last_undegraded":"2023-11-30T23:12:48.950610+0000","last_fullsized":"2023-11-30T23:12:48.950610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:35:20.171512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950946+0000","last_change":"2023-11-30T23:12:47.521920+0000","last_active":"2023-11-30T23:12:48.950946+0000","last_peered":"2023-11-30T23:12:48.950946+0000","last_clean":"2023-11-30T23:12:48.950946+0000","last_became_active":"2023-11-30T23:12:47.520322+0000","last_became_peered":"2023-11-30T23:12:47.520322+0000","last_unstale":"2023-11-30T23:12:48.950946+0000","last_undegraded":"2023-11-30T23:12:48.950946+0000","last_fullsized":"2023-11-30T23:12:48.950946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.950135+0000","last_change":"2023-11-30T23:12:47.142276+0000","last_active":"2023-11-30T23:12:48.950135+0000","last_peered":"2023-11-30T23:12:48.950135+0000","last_clean":"2023-11-30T23:12:48.950135+0000","last_became_active":"2023-11-30T23:12:47.141965+0000","last_became_peered":"2023-11-30T23:12:47.141965+0000","last_unstale":"2023-11-30T23:12:48.950135+0000","last_undegraded":"2023-11-30T23:12:48.950135+0000","last_fullsized":"2023-11-30T23:12:48.950135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:28.154593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491664+0000","last_change":"2023-11-30T23:12:47.522292+0000","last_active":"2023-11-30T23:12:48.491664+0000","last_peered":"2023-11-30T23:12:48.491664+0000","last_clean":"2023-11-30T23:12:48.491664+0000","last_became_active":"2023-11-30T23:12:47.522002+0000","last_became_peered":"2023-11-30T23:12:47.522002+0000","last_unstale":"2023-11-30T23:12:48.491664+0000","last_undegraded":"2023-11-30T23:12:48.491664+0000","last_fullsized":"2023-11-30T23:12:48.491664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949635+0000","last_change":"2023-11-30T23:12:47.139186+0000","last_active":"2023-11-30T23:12:48.949635+0000","last_peered":"2023-11-30T23:12:48.949635+0000","last_clean":"2023-11-30T23:12:48.949635+0000","last_became_active":"2023-11-30T23:12:47.138275+0000","last_became_peered":"2023-11-30T23:12:47.138275+0000","last_unstale":"2023-11-30T23:12:48.949635+0000","last_undegraded":"2023-11-30T23:12:48.949635+0000","last_fullsized":"2023-11-30T23:12:48.949635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:58:25.168678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.949437+0000","last_change":"2023-11-30T23:12:47.509024+0000","last_active":"2023-11-30T23:12:48.949437+0000","last_peered":"2023-11-30T23:12:48.949437+0000","last_clean":"2023-11-30T23:12:48.949437+0000","last_became_active":"2023-11-30T23:12:47.508718+0000","last_became_peered":"2023-11-30T23:12:47.508718+0000","last_unstale":"2023-11-30T23:12:48.949437+0000","last_undegraded":"2023-11-30T23:12:48.949437+0000","last_fullsized":"2023-11-30T23:12:48.949437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-30T23:12:48.491906+0000","last_change":"2023-11-30T23:12:47.141150+0000","last_active":"2023-11-30T23:12:48.491906+0000","last_peered":"2023-11-30T23:12:48.491906+0000","last_clean":"2023-11-30T23:12:48.491906+0000","last_became_active":"2023-11-30T23:12:47.140891+0000","last_became_peered":"2023-11-30T23:12:47.140891+0000","last_unstale":"2023-11-30T23:12:48.491906+0000","last_undegraded":"2023-11-30T23:12:48.491906+0000","last_fullsized":"2023-11-30T23:12:48.491906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:22:48.835054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31832,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31260,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340580,"statfs":{"total":96636764160,"available":96604753920,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31252,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340588,"statfs":{"total":96636764160,"available":96604762112,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.9320000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31260,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340580,"statfs":{"total":96636764160,"available":96604753920,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T23:12:57.073 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-30T23:12:57.073 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-30T23:12:57.073 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-30T23:12:57.073 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-30T23:12:57.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.179+0000 7fbb36fd2700 1 Processor -- start 2023-11-30T23:12:57.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.179+0000 7fbb36fd2700 1 -- start start 2023-11-30T23:12:57.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.179+0000 7fbb36fd2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb280cfcc0 0x7fbb280d0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:57.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.179+0000 7fbb36fd2700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2803a090 con 0x7fbb28007630 2023-11-30T23:12:57.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.179+0000 7fbb36fd2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb28007a10 con 0x7fbb280c6180 2023-11-30T23:12:57.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.179+0000 7fbb36fd2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2803ac00 con 0x7fbb280cfcc0 2023-11-30T23:12:57.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb35fd0700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbb28007630 0x7fbb28039980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38240/0 (socket says 172.21.15.73:38240) 2023-11-30T23:12:57.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb35fd0700 1 -- 172.21.15.73:0/1051207131 learned_addr learned my addr 172.21.15.73:0/1051207131 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:57.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb357cf700 1 --2- 172.21.15.73:0/1051207131 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb280cfcc0 0x7fbb280d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:57.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb34fce700 1 -- 172.21.15.73:0/1051207131 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476943882 0 0) 0x7fbb2803a090 con 0x7fbb28007630 2023-11-30T23:12:57.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb34fce700 1 -- 172.21.15.73:0/1051207131 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb1c0035d0 con 0x7fbb28007630 2023-11-30T23:12:57.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb357cf700 1 -- 172.21.15.73:0/1051207131 >> v1:172.21.15.156:6789/0 conn(0x7fbb280c6180 legacy=0x7fbb280c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:57.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb357cf700 1 -- 172.21.15.73:0/1051207131 >> v1:172.21.15.73:6789/0 conn(0x7fbb28007630 legacy=0x7fbb28039980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:57.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb357cf700 1 -- 172.21.15.73:0/1051207131 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2803aee0 con 0x7fbb280cfcc0 2023-11-30T23:12:57.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb357cf700 1 --2- 172.21.15.73:0/1051207131 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb280cfcc0 0x7fbb280d0140 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009880 tx=0x7fbb20009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9064af2342e8c94 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:57.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb34fce700 1 -- 172.21.15.73:0/1051207131 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb20011830 con 0x7fbb280cfcc0 2023-11-30T23:12:57.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb34fce700 1 -- 172.21.15.73:0/1051207131 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb20011990 con 0x7fbb280cfcc0 2023-11-30T23:12:57.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb34fce700 1 -- 172.21.15.73:0/1051207131 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb20011d00 con 0x7fbb280cfcc0 2023-11-30T23:12:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb36fd2700 1 -- 172.21.15.73:0/1051207131 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb280cfcc0 msgr2=0x7fbb280d0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb36fd2700 1 --2- 172.21.15.73:0/1051207131 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb280cfcc0 0x7fbb280d0140 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009880 tx=0x7fbb20009b90 comp rx=0 tx=0).stop 2023-11-30T23:12:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb36fd2700 1 -- 172.21.15.73:0/1051207131 shutdown_connections 2023-11-30T23:12:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb36fd2700 1 --2- 172.21.15.73:0/1051207131 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb280cfcc0 0x7fbb280d0140 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb36fd2700 1 -- 172.21.15.73:0/1051207131 >> 172.21.15.73:0/1051207131 conn(0x7fbb2803ecb0 msgr2=0x7fbb2803f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb36fd2700 1 -- 172.21.15.73:0/1051207131 shutdown_connections 2023-11-30T23:12:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb36fd2700 1 -- 172.21.15.73:0/1051207131 wait complete. 2023-11-30T23:12:57.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.183+0000 7fbb36fd2700 1 Processor -- start 2023-11-30T23:12:57.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb36fd2700 1 -- start start 2023-11-30T23:12:57.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb36fd2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb28007630 0x7fbb280cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:57.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb36fd2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb280c6180 0x7fbb280c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:57.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb36fd2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb280cfcc0 0x7fbb280b7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:57.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb36fd2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb281658a0 con 0x7fbb280cfcc0 2023-11-30T23:12:57.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb36fd2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb280c93f0 con 0x7fbb280c6180 2023-11-30T23:12:57.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb36fd2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28165b20 con 0x7fbb28007630 2023-11-30T23:12:57.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb367d1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb280cfcc0 0x7fbb280b7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb367d1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb280cfcc0 0x7fbb280b7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38538/0 (socket says 172.21.15.73:38538) 2023-11-30T23:12:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb367d1700 1 -- 172.21.15.73:0/337941298 learned_addr learned my addr 172.21.15.73:0/337941298 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb35fd0700 1 --2- 172.21.15.73:0/337941298 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb28007630 0x7fbb280cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb357cf700 1 --2- 172.21.15.73:0/337941298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb280c6180 0x7fbb280c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb367d1700 1 -- 172.21.15.73:0/337941298 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb28007630 msgr2=0x7fbb280cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb367d1700 1 --2- 172.21.15.73:0/337941298 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb28007630 0x7fbb280cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb367d1700 1 -- 172.21.15.73:0/337941298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb280c6180 msgr2=0x7fbb280c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb367d1700 1 --2- 172.21.15.73:0/337941298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb280c6180 0x7fbb280c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb367d1700 1 -- 172.21.15.73:0/337941298 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb200094b0 con 0x7fbb280cfcc0 2023-11-30T23:12:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb35fd0700 1 --2- 172.21.15.73:0/337941298 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb28007630 0x7fbb280cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:57.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb367d1700 1 --2- 172.21.15.73:0/337941298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb280cfcc0 0x7fbb280b7fa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbb30000b60 tx=0x7fbb30068290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb267fc700 1 -- 172.21.15.73:0/337941298 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb30067160 con 0x7fbb280cfcc0 2023-11-30T23:12:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb267fc700 1 -- 172.21.15.73:0/337941298 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb300672c0 con 0x7fbb280cfcc0 2023-11-30T23:12:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb36fd2700 1 -- 172.21.15.73:0/337941298 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb280c8ee0 con 0x7fbb280cfcc0 2023-11-30T23:12:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb267fc700 1 -- 172.21.15.73:0/337941298 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb30067650 con 0x7fbb280cfcc0 2023-11-30T23:12:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb36fd2700 1 -- 172.21.15.73:0/337941298 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb280ca110 con 0x7fbb280cfcc0 2023-11-30T23:12:57.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.187+0000 7fbb36fd2700 1 -- 172.21.15.73:0/337941298 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb28005550 con 0x7fbb280cfcc0 2023-11-30T23:12:57.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.191+0000 7fbb267fc700 1 -- 172.21.15.73:0/337941298 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbb30072040 con 0x7fbb280cfcc0 2023-11-30T23:12:57.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.191+0000 7fbb267fc700 1 --2- 172.21.15.73:0/337941298 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbb14065ad0 0x7fbb14067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:57.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.191+0000 7fbb35fd0700 1 --2- 172.21.15.73:0/337941298 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbb14065ad0 0x7fbb14067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:57.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.191+0000 7fbb267fc700 1 -- 172.21.15.73:0/337941298 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb300fd050 con 0x7fbb280cfcc0 2023-11-30T23:12:57.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.191+0000 7fbb35fd0700 1 --2- 172.21.15.73:0/337941298 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbb14065ad0 0x7fbb14067f90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c007fd0 tx=0x7fbb2c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:57.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.195+0000 7fbb267fc700 1 -- 172.21.15.73:0/337941298 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fbb300caaa0 con 0x7fbb280cfcc0 2023-11-30T23:12:57.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.379+0000 7fbb36fd2700 1 -- 172.21.15.73:0/337941298 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbb28165c60 con 0x7fbb280cfcc0 2023-11-30T23:12:57.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.379+0000 7fbb267fc700 1 -- 172.21.15.73:0/337941298 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fbb300ce0c0 con 0x7fbb280cfcc0 2023-11-30T23:12:57.383 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:57.383 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-30T23:12:57.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.379+0000 7fbb36fd2700 1 -- 172.21.15.73:0/337941298 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbb14065ad0 msgr2=0x7fbb14067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:57.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.379+0000 7fbb36fd2700 1 --2- 172.21.15.73:0/337941298 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbb14065ad0 0x7fbb14067f90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c007fd0 tx=0x7fbb2c009040 comp rx=0 tx=0).stop 2023-11-30T23:12:57.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.379+0000 7fbb36fd2700 1 -- 172.21.15.73:0/337941298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb280cfcc0 msgr2=0x7fbb280b7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:57.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.379+0000 7fbb36fd2700 1 --2- 172.21.15.73:0/337941298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb280cfcc0 0x7fbb280b7fa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbb30000b60 tx=0x7fbb30068290 comp rx=0 tx=0).stop 2023-11-30T23:12:57.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.379+0000 7fbb36fd2700 1 -- 172.21.15.73:0/337941298 shutdown_connections 2023-11-30T23:12:57.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.379+0000 7fbb36fd2700 1 --2- 172.21.15.73:0/337941298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb280cfcc0 0x7fbb280b7fa0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.379+0000 7fbb36fd2700 1 --2- 172.21.15.73:0/337941298 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fbb14065ad0 0x7fbb14067f90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.379+0000 7fbb36fd2700 1 --2- 172.21.15.73:0/337941298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb280c6180 0x7fbb280c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.379+0000 7fbb36fd2700 1 --2- 172.21.15.73:0/337941298 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fbb28007630 0x7fbb280cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.383+0000 7fbb36fd2700 1 -- 172.21.15.73:0/337941298 >> 172.21.15.73:0/337941298 conn(0x7fbb2803ecb0 msgr2=0x7fbb2803f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:57.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.383+0000 7fbb36fd2700 1 -- 172.21.15.73:0/337941298 shutdown_connections 2023-11-30T23:12:57.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.383+0000 7fbb36fd2700 1 -- 172.21.15.73:0/337941298 wait complete. 2023-11-30T23:12:57.397 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-30T23:12:57.397 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T23:12:57.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.495+0000 7f699d6e2700 1 Processor -- start 2023-11-30T23:12:57.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.495+0000 7f699d6e2700 1 -- start start 2023-11-30T23:12:57.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.495+0000 7f699d6e2700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6990029ca0 0x7f69900c4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:57.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.495+0000 7f699d6e2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f69900c49a0 0x7f69900d4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:57.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.495+0000 7f699d6e2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699002a100 con 0x7f69900374b0 2023-11-30T23:12:57.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.495+0000 7f699d6e2700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f699002ae30 con 0x7f69900c49a0 2023-11-30T23:12:57.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.495+0000 7f699d6e2700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6990037890 con 0x7f6990029ca0 2023-11-30T23:12:57.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.495+0000 7f699cee1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f69900c49a0 0x7f69900d4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:57.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.495+0000 7f699cee1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f69900c49a0 0x7f69900d4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38540/0 (socket says 172.21.15.73:38540) 2023-11-30T23:12:57.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.495+0000 7f699cee1700 1 -- 172.21.15.73:0/3510244671 learned_addr learned my addr 172.21.15.73:0/3510244671 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:57.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.495+0000 7f69977fe700 1 --2- 172.21.15.73:0/3510244671 >> v2:172.21.15.156:3300/0 conn(0x7f6990029ca0 0x7f69900c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:57.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.499+0000 7f699cee1700 1 -- 172.21.15.73:0/3510244671 >> v2:172.21.15.156:3300/0 conn(0x7f6990029ca0 msgr2=0x7f69900c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:57.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.499+0000 7f6996ffd700 1 -- 172.21.15.73:0/3510244671 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875397304 0 0) 0x7f699002a100 con 0x7f69900374b0 2023-11-30T23:12:57.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.499+0000 7f699cee1700 1 --2- 172.21.15.73:0/3510244671 >> v2:172.21.15.156:3300/0 conn(0x7f6990029ca0 0x7f69900c4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.499+0000 7f699cee1700 1 -- 172.21.15.73:0/3510244671 >> v1:172.21.15.156:6789/0 conn(0x7f69900374b0 legacy=0x7f69900ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:57.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.499+0000 7f699cee1700 1 -- 172.21.15.73:0/3510244671 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699002ab50 con 0x7f69900c49a0 2023-11-30T23:12:57.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.499+0000 7f699cee1700 1 --2- 172.21.15.73:0/3510244671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69900c49a0 0x7f69900d4e60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6998079de0 tx=0x7f699804eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f3529ea39daba5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:57.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.499+0000 7f6996ffd700 1 -- 172.21.15.73:0/3510244671 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6998067fb0 con 0x7f69900c49a0 2023-11-30T23:12:57.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.499+0000 7f6996ffd700 1 -- 172.21.15.73:0/3510244671 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6998068110 con 0x7f69900c49a0 2023-11-30T23:12:57.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.499+0000 7f6996ffd700 1 -- 172.21.15.73:0/3510244671 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6998065d40 con 0x7f69900c49a0 2023-11-30T23:12:57.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.499+0000 7f699d6e2700 1 -- 172.21.15.73:0/3510244671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69900c49a0 msgr2=0x7f69900d4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:57.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.499+0000 7f699d6e2700 1 --2- 172.21.15.73:0/3510244671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69900c49a0 0x7f69900d4e60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6998079de0 tx=0x7f699804eaa0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.499+0000 7f699d6e2700 1 -- 172.21.15.73:0/3510244671 shutdown_connections 2023-11-30T23:12:57.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.499+0000 7f699d6e2700 1 --2- 172.21.15.73:0/3510244671 >> v2:172.21.15.156:3300/0 conn(0x7f6990029ca0 0x7f69900c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.499+0000 7f699d6e2700 1 --2- 172.21.15.73:0/3510244671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69900c49a0 0x7f69900d4e60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.499+0000 7f699d6e2700 1 -- 172.21.15.73:0/3510244671 >> 172.21.15.73:0/3510244671 conn(0x7f699003ad30 msgr2=0x7f69900060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:57.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.499+0000 7f699d6e2700 1 -- 172.21.15.73:0/3510244671 shutdown_connections 2023-11-30T23:12:57.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.499+0000 7f699d6e2700 1 -- 172.21.15.73:0/3510244671 wait complete. 2023-11-30T23:12:57.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699d6e2700 1 Processor -- start 2023-11-30T23:12:57.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699d6e2700 1 -- start start 2023-11-30T23:12:57.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699d6e2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6990029ca0 0x7f6990033db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:57.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699d6e2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69900374b0 0x7f6990163170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:57.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699d6e2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69900c49a0 0x7f69901636b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:57.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699d6e2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699002f0f0 con 0x7f69900c49a0 2023-11-30T23:12:57.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699d6e2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699002ca70 con 0x7f69900374b0 2023-11-30T23:12:57.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699d6e2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699002c790 con 0x7f6990029ca0 2023-11-30T23:12:57.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699cee1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69900c49a0 0x7f69901636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:57.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699cee1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69900c49a0 0x7f69901636b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38542/0 (socket says 172.21.15.73:38542) 2023-11-30T23:12:57.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699cee1700 1 -- 172.21.15.73:0/1174865855 learned_addr learned my addr 172.21.15.73:0/1174865855 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:57.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f69977fe700 1 --2- 172.21.15.73:0/1174865855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69900374b0 0x7f6990163170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:57.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f6997fff700 1 --2- 172.21.15.73:0/1174865855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6990029ca0 0x7f6990033db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:57.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699cee1700 1 -- 172.21.15.73:0/1174865855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6990029ca0 msgr2=0x7f6990033db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:57.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699cee1700 1 --2- 172.21.15.73:0/1174865855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6990029ca0 0x7f6990033db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699cee1700 1 -- 172.21.15.73:0/1174865855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69900374b0 msgr2=0x7f6990163170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:57.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699cee1700 1 --2- 172.21.15.73:0/1174865855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69900374b0 0x7f6990163170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699cee1700 1 -- 172.21.15.73:0/1174865855 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699002cda0 con 0x7f69900c49a0 2023-11-30T23:12:57.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699cee1700 1 --2- 172.21.15.73:0/1174865855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69900c49a0 0x7f69901636b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f699802cd30 tx=0x7f69980686a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:57.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f6994ff9700 1 -- 172.21.15.73:0/1174865855 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699809a070 con 0x7f69900c49a0 2023-11-30T23:12:57.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f6994ff9700 1 -- 172.21.15.73:0/1174865855 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6998066170 con 0x7f69900c49a0 2023-11-30T23:12:57.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f6994ff9700 1 -- 172.21.15.73:0/1174865855 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6998067160 con 0x7f69900c49a0 2023-11-30T23:12:57.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699d6e2700 1 -- 172.21.15.73:0/1174865855 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f699002f340 con 0x7f69900c49a0 2023-11-30T23:12:57.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.503+0000 7f699d6e2700 1 -- 172.21.15.73:0/1174865855 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699002d940 con 0x7f69900c49a0 2023-11-30T23:12:57.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.507+0000 7f699d6e2700 1 -- 172.21.15.73:0/1174865855 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f699002cf90 con 0x7f69900c49a0 2023-11-30T23:12:57.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.507+0000 7f6994ff9700 1 -- 172.21.15.73:0/1174865855 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6998090020 con 0x7f69900c49a0 2023-11-30T23:12:57.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.507+0000 7f6994ff9700 1 --2- 172.21.15.73:0/1174865855 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6984065ad0 0x7f6984067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:57.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.507+0000 7f6997fff700 1 --2- 172.21.15.73:0/1174865855 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6984065ad0 0x7f6984067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:57.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.507+0000 7f6994ff9700 1 -- 172.21.15.73:0/1174865855 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69980fdd50 con 0x7f69900c49a0 2023-11-30T23:12:57.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.507+0000 7f6997fff700 1 --2- 172.21.15.73:0/1174865855 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6984065ad0 0x7f6984067f90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f698c000f60 tx=0x7f698c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:57.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.515+0000 7f6994ff9700 1 -- 172.21.15.73:0/1174865855 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f6998101030 con 0x7f69900c49a0 2023-11-30T23:12:57.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.679+0000 7f699d6e2700 1 -- 172.21.15.73:0/1174865855 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6990005570 con 0x7f69900c49a0 2023-11-30T23:12:57.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.683+0000 7f6994ff9700 1 -- 172.21.15.73:0/1174865855 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f69980cb8c0 con 0x7f69900c49a0 2023-11-30T23:12:57.686 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:57.686 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"a677cb6a-4a54-4567-a30d-f0fa4bc22b17","created":"2023-11-30T23:12:23.260968+0000","modified":"2023-11-30T23:12:48.484283+0000","last_up_change":"2023-11-30T23:12:33.649318+0000","last_in_change":"2023-11-30T23:12:25.326689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-30T23:12:34.413317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-30T23:12:45.403156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-30T23:12:46.475384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbf1c93f-0775-4780-8524-cf25792d9aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36686},{"type":"v1","addr":"172.21.15.73:6817","nonce":36686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36686},{"type":"v1","addr":"172.21.15.73:6819","nonce":36686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36686},{"type":"v1","addr":"172.21.15.73:6823","nonce":36686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36686},{"type":"v1","addr":"172.21.15.73:6821","nonce":36686}]},"public_addr":"172.21.15.73:6817/36686","cluster_addr":"172.21.15.73:6819/36686","heartbeat_back_addr":"172.21.15.73:6823/36686","heartbeat_front_addr":"172.21.15.73:6821/36686","state":["exists","up"]},{"osd":1,"uuid":"9d9dd122-9a42-4588-a0d2-50d13b13eba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36687},{"type":"v1","addr":"172.21.15.73:6809","nonce":36687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":36687},{"type":"v1","addr":"172.21.15.73:6811","nonce":36687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36687},{"type":"v1","addr":"172.21.15.73:6815","nonce":36687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36687},{"type":"v1","addr":"172.21.15.73:6813","nonce":36687}]},"public_addr":"172.21.15.73:6809/36687","cluster_addr":"172.21.15.73:6811/36687","heartbeat_back_addr":"172.21.15.73:6815/36687","heartbeat_front_addr":"172.21.15.73:6813/36687","state":["exists","up"]},{"osd":2,"uuid":"68ff4f1e-ec45-42e0-bb83-fe03598e4940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36688},{"type":"v1","addr":"172.21.15.73:6825","nonce":36688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36688},{"type":"v1","addr":"172.21.15.73:6827","nonce":36688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36688},{"type":"v1","addr":"172.21.15.73:6831","nonce":36688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36688},{"type":"v1","addr":"172.21.15.73:6829","nonce":36688}]},"public_addr":"172.21.15.73:6825/36688","cluster_addr":"172.21.15.73:6827/36688","heartbeat_back_addr":"172.21.15.73:6831/36688","heartbeat_front_addr":"172.21.15.73:6829/36688","state":["exists","up"]},{"osd":3,"uuid":"e4b08c98-6a4d-4ec8-a245-59a35f70a16f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36685},{"type":"v1","addr":"172.21.15.73:6801","nonce":36685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36685},{"type":"v1","addr":"172.21.15.73:6803","nonce":36685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":36685},{"type":"v1","addr":"172.21.15.73:6807","nonce":36685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36685},{"type":"v1","addr":"172.21.15.73:6805","nonce":36685}]},"public_addr":"172.21.15.73:6801/36685","cluster_addr":"172.21.15.73:6803/36685","heartbeat_back_addr":"172.21.15.73:6807/36685","heartbeat_front_addr":"172.21.15.73:6805/36685","state":["exists","up"]},{"osd":4,"uuid":"d0922b0e-5170-474d-b270-ddb5adc858cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":36908},{"type":"v1","addr":"172.21.15.156:6801","nonce":36908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":36908},{"type":"v1","addr":"172.21.15.156:6803","nonce":36908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":36908},{"type":"v1","addr":"172.21.15.156:6807","nonce":36908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":36908},{"type":"v1","addr":"172.21.15.156:6805","nonce":36908}]},"public_addr":"172.21.15.156:6801/36908","cluster_addr":"172.21.15.156:6803/36908","heartbeat_back_addr":"172.21.15.156:6807/36908","heartbeat_front_addr":"172.21.15.156:6805/36908","state":["exists","up"]},{"osd":5,"uuid":"f2791a77-db25-479c-95d5-ea7f77458685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":36909},{"type":"v1","addr":"172.21.15.156:6809","nonce":36909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":36909},{"type":"v1","addr":"172.21.15.156:6811","nonce":36909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":36909},{"type":"v1","addr":"172.21.15.156:6815","nonce":36909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":36909},{"type":"v1","addr":"172.21.15.156:6813","nonce":36909}]},"public_addr":"172.21.15.156:6809/36909","cluster_addr":"172.21.15.156:6811/36909","heartbeat_back_addr":"172.21.15.156:6815/36909","heartbeat_front_addr":"172.21.15.156:6813/36909","state":["exists","up"]},{"osd":6,"uuid":"f86c2fe9-ec8b-406e-af26-5dc65c926382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":36910},{"type":"v1","addr":"172.21.15.156:6817","nonce":36910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":36910},{"type":"v1","addr":"172.21.15.156:6819","nonce":36910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":36910},{"type":"v1","addr":"172.21.15.156:6823","nonce":36910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":36910},{"type":"v1","addr":"172.21.15.156:6821","nonce":36910}]},"public_addr":"172.21.15.156:6817/36910","cluster_addr":"172.21.15.156:6819/36910","heartbeat_back_addr":"172.21.15.156:6823/36910","heartbeat_front_addr":"172.21.15.156:6821/36910","state":["exists","up"]},{"osd":7,"uuid":"56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":36911},{"type":"v1","addr":"172.21.15.156:6825","nonce":36911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":36911},{"type":"v1","addr":"172.21.15.156:6827","nonce":36911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":36911},{"type":"v1","addr":"172.21.15.156:6831","nonce":36911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":36911},{"type":"v1","addr":"172.21.15.156:6829","nonce":36911}]},"public_addr":"172.21.15.156:6825/36911","cluster_addr":"172.21.15.156:6827/36911","heartbeat_back_addr":"172.21.15.156:6831/36911","heartbeat_front_addr":"172.21.15.156:6829/36911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.597534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.505493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.811871+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.586741+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.366817+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.101605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.627496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.829046+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T23:12:57.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.683+0000 7f699d6e2700 1 -- 172.21.15.73:0/1174865855 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6984065ad0 msgr2=0x7f6984067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:57.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.683+0000 7f699d6e2700 1 --2- 172.21.15.73:0/1174865855 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6984065ad0 0x7f6984067f90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f698c000f60 tx=0x7f698c009040 comp rx=0 tx=0).stop 2023-11-30T23:12:57.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.683+0000 7f699d6e2700 1 -- 172.21.15.73:0/1174865855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69900c49a0 msgr2=0x7f69901636b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:57.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.683+0000 7f699d6e2700 1 --2- 172.21.15.73:0/1174865855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69900c49a0 0x7f69901636b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f699802cd30 tx=0x7f69980686a0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.683+0000 7f699d6e2700 1 -- 172.21.15.73:0/1174865855 shutdown_connections 2023-11-30T23:12:57.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.683+0000 7f699d6e2700 1 --2- 172.21.15.73:0/1174865855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69900c49a0 0x7f69901636b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.683+0000 7f699d6e2700 1 --2- 172.21.15.73:0/1174865855 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6984065ad0 0x7f6984067f90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.683+0000 7f699d6e2700 1 --2- 172.21.15.73:0/1174865855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69900374b0 0x7f6990163170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.683+0000 7f699d6e2700 1 --2- 172.21.15.73:0/1174865855 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6990029ca0 0x7f6990033db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.683+0000 7f699d6e2700 1 -- 172.21.15.73:0/1174865855 >> 172.21.15.73:0/1174865855 conn(0x7f699003ad30 msgr2=0x7f6990005780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:57.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.683+0000 7f699d6e2700 1 -- 172.21.15.73:0/1174865855 shutdown_connections 2023-11-30T23:12:57.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.683+0000 7f699d6e2700 1 -- 172.21.15.73:0/1174865855 wait complete. 2023-11-30T23:12:57.701 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-30T23:12:34.413317+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T23:12:45.403156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T23:12:46.475384+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-30T23:12:57.701 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-30T23:12:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.807+0000 7f14db94b700 1 Processor -- start 2023-11-30T23:12:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.807+0000 7f14db94b700 1 -- start start 2023-11-30T23:12:57.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14db94b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f14d414a600 0x7f14d4140430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:57.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14db94b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d40b4470 0x7f14d4140970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:57.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14db94b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d4140eb0 con 0x7f14d40bca60 2023-11-30T23:12:57.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14db94b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d40b6120 con 0x7f14d414a600 2023-11-30T23:12:57.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14db94b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d40b5eb0 con 0x7f14d40b4470 2023-11-30T23:12:57.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14d8ee6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f14d414a600 0x7f14d4140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:57.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14d8ee6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f14d414a600 0x7f14d4140430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38554/0 (socket says 172.21.15.73:38554) 2023-11-30T23:12:57.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14d8ee6700 1 -- 172.21.15.73:0/383574415 learned_addr learned my addr 172.21.15.73:0/383574415 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:57.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14d9ee8700 1 --2- 172.21.15.73:0/383574415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d40b4470 0x7f14d4140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:57.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14d8ee6700 1 -- 172.21.15.73:0/383574415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d40b4470 msgr2=0x7f14d4140970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:57.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14d8ee6700 1 --2- 172.21.15.73:0/383574415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d40b4470 0x7f14d4140970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14d8ee6700 1 -- 172.21.15.73:0/383574415 >> v1:172.21.15.156:6789/0 conn(0x7f14d40bca60 legacy=0x7f14d4149ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:57.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14d8ee6700 1 -- 172.21.15.73:0/383574415 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d40bce40 con 0x7f14d414a600 2023-11-30T23:12:57.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14d8ee6700 1 --2- 172.21.15.73:0/383574415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14d414a600 0x7f14d4140430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009910 tx=0x7f14d0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78def1d9065f016 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14cbfff700 1 -- 172.21.15.73:0/383574415 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d000ba60 con 0x7f14d414a600 2023-11-30T23:12:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14cbfff700 1 -- 172.21.15.73:0/383574415 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d000bbc0 con 0x7f14d414a600 2023-11-30T23:12:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14cbfff700 1 -- 172.21.15.73:0/383574415 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0009e60 con 0x7f14d414a600 2023-11-30T23:12:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14db94b700 1 -- 172.21.15.73:0/383574415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14d414a600 msgr2=0x7f14d4140430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14db94b700 1 --2- 172.21.15.73:0/383574415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14d414a600 0x7f14d4140430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009910 tx=0x7f14d0009c20 comp rx=0 tx=0).stop 2023-11-30T23:12:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14db94b700 1 -- 172.21.15.73:0/383574415 shutdown_connections 2023-11-30T23:12:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14db94b700 1 --2- 172.21.15.73:0/383574415 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d40b4470 0x7f14d4140970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14db94b700 1 --2- 172.21.15.73:0/383574415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14d414a600 0x7f14d4140430 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14db94b700 1 -- 172.21.15.73:0/383574415 >> 172.21.15.73:0/383574415 conn(0x7f14d4071fd0 msgr2=0x7f14d40bc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14db94b700 1 -- 172.21.15.73:0/383574415 shutdown_connections 2023-11-30T23:12:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.811+0000 7f14db94b700 1 -- 172.21.15.73:0/383574415 wait complete. 2023-11-30T23:12:57.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14db94b700 1 Processor -- start 2023-11-30T23:12:57.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14db94b700 1 -- start start 2023-11-30T23:12:57.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14db94b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14d40b4470 0x7f14d40bb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:57.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14db94b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d40bca60 0x7f14d4141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:57.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14db94b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14d414a600 0x7f14d41445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:57.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14db94b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d4143790 con 0x7f14d414a600 2023-11-30T23:12:57.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14db94b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d4142910 con 0x7f14d40b4470 2023-11-30T23:12:57.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14db94b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d4143c20 con 0x7f14d40bca60 2023-11-30T23:12:57.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14d9ee8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14d414a600 0x7f14d41445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:57.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14d9ee8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14d414a600 0x7f14d41445c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38560/0 (socket says 172.21.15.73:38560) 2023-11-30T23:12:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14d9ee8700 1 -- 172.21.15.73:0/1977050210 learned_addr learned my addr 172.21.15.73:0/1977050210 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14d96e7700 1 --2- 172.21.15.73:0/1977050210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14d40b4470 0x7f14d40bb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14d8ee6700 1 --2- 172.21.15.73:0/1977050210 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d40bca60 0x7f14d4141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14d9ee8700 1 -- 172.21.15.73:0/1977050210 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d40bca60 msgr2=0x7f14d4141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14d9ee8700 1 --2- 172.21.15.73:0/1977050210 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d40bca60 0x7f14d4141520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14d9ee8700 1 -- 172.21.15.73:0/1977050210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14d40b4470 msgr2=0x7f14d40bb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14d9ee8700 1 --2- 172.21.15.73:0/1977050210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14d40b4470 0x7f14d40bb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14d9ee8700 1 -- 172.21.15.73:0/1977050210 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d0009570 con 0x7f14d414a600 2023-11-30T23:12:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14d9ee8700 1 --2- 172.21.15.73:0/1977050210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14d414a600 0x7f14d41445c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f14cc007e60 tx=0x7f14cc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14c9ffb700 1 -- 172.21.15.73:0/1977050210 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc00ed30 con 0x7f14d414a600 2023-11-30T23:12:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14c9ffb700 1 -- 172.21.15.73:0/1977050210 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc014420 con 0x7f14d414a600 2023-11-30T23:12:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14db94b700 1 -- 172.21.15.73:0/1977050210 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d4143140 con 0x7f14d414a600 2023-11-30T23:12:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14c9ffb700 1 -- 172.21.15.73:0/1977050210 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0147d0 con 0x7f14d414a600 2023-11-30T23:12:57.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.815+0000 7f14db94b700 1 -- 172.21.15.73:0/1977050210 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d4141a60 con 0x7f14d414a600 2023-11-30T23:12:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.819+0000 7f14c9ffb700 1 -- 172.21.15.73:0/1977050210 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f14cc014930 con 0x7f14d414a600 2023-11-30T23:12:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.819+0000 7f14db94b700 1 -- 172.21.15.73:0/1977050210 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d4143900 con 0x7f14d414a600 2023-11-30T23:12:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.819+0000 7f14c9ffb700 1 --2- 172.21.15.73:0/1977050210 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f14b8065b00 0x7f14b8067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.819+0000 7f14c9ffb700 1 -- 172.21.15.73:0/1977050210 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14cc083690 con 0x7f14d414a600 2023-11-30T23:12:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.819+0000 7f14d96e7700 1 --2- 172.21.15.73:0/1977050210 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f14b8065b00 0x7f14b8067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.819+0000 7f14d96e7700 1 --2- 172.21.15.73:0/1977050210 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f14b8065b00 0x7f14b8067fc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14c4000f60 tx=0x7f14c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:57.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.827+0000 7f14c9ffb700 1 -- 172.21.15.73:0/1977050210 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f14cc0510e0 con 0x7f14d414a600 2023-11-30T23:12:57.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.991+0000 7f14db94b700 1 -- 172.21.15.73:0/1977050210 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14d404ed80 con 0x7f14d414a600 2023-11-30T23:12:57.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.991+0000 7f14c9ffb700 1 -- 172.21.15.73:0/1977050210 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f14cc054700 con 0x7f14d414a600 2023-11-30T23:12:57.997 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-11-30T23:12:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.995+0000 7f14db94b700 1 -- 172.21.15.73:0/1977050210 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f14b8065b00 msgr2=0x7f14b8067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.995+0000 7f14db94b700 1 --2- 172.21.15.73:0/1977050210 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f14b8065b00 0x7f14b8067fc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14c4000f60 tx=0x7f14c4009040 comp rx=0 tx=0).stop 2023-11-30T23:12:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.995+0000 7f14db94b700 1 -- 172.21.15.73:0/1977050210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14d414a600 msgr2=0x7f14d41445c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.995+0000 7f14db94b700 1 --2- 172.21.15.73:0/1977050210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14d414a600 0x7f14d41445c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f14cc007e60 tx=0x7f14cc00e3c0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.995+0000 7f14db94b700 1 -- 172.21.15.73:0/1977050210 shutdown_connections 2023-11-30T23:12:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.995+0000 7f14db94b700 1 --2- 172.21.15.73:0/1977050210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14d414a600 0x7f14d41445c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.995+0000 7f14db94b700 1 --2- 172.21.15.73:0/1977050210 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14d40bca60 0x7f14d4141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.995+0000 7f14db94b700 1 --2- 172.21.15.73:0/1977050210 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f14b8065b00 0x7f14b8067fc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.995+0000 7f14db94b700 1 --2- 172.21.15.73:0/1977050210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14d40b4470 0x7f14d40bb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.995+0000 7f14db94b700 1 -- 172.21.15.73:0/1977050210 >> 172.21.15.73:0/1977050210 conn(0x7f14d4071fd0 msgr2=0x7f14d40b9040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.995+0000 7f14db94b700 1 -- 172.21.15.73:0/1977050210 shutdown_connections 2023-11-30T23:12:58.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:57.995+0000 7f14db94b700 1 -- 172.21.15.73:0/1977050210 wait complete. 2023-11-30T23:12:58.012 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T23:12:58.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.119+0000 7f02a2b90700 1 Processor -- start 2023-11-30T23:12:58.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.119+0000 7f02a2b90700 1 -- start start 2023-11-30T23:12:58.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.119+0000 7f02a2b90700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c0bc8b0 0x7f029c140340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a2b90700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f029c14a490 0x7f029c150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a2b90700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029c0b4e70 con 0x7f029c140880 2023-11-30T23:12:58.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a2b90700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029c0b5da0 con 0x7f029c14a490 2023-11-30T23:12:58.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a2b90700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c140ce0 con 0x7f029c0bc8b0 2023-11-30T23:12:58.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a138d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f029c140880 0x7f029c149d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38254/0 (socket says 172.21.15.73:38254) 2023-11-30T23:12:58.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a138d700 1 -- 172.21.15.73:0/335919159 learned_addr learned my addr 172.21.15.73:0/335919159 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:58.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a238f700 1 --2- 172.21.15.73:0/335919159 >> v2:172.21.15.156:3300/0 conn(0x7f029c14a490 0x7f029c150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a1b8e700 1 --2- 172.21.15.73:0/335919159 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c0bc8b0 0x7f029c140340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 -- 172.21.15.73:0/335919159 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994552287 0 0) 0x7f029c0b4e70 con 0x7f029c140880 2023-11-30T23:12:58.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 -- 172.21.15.73:0/335919159 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02880035d0 con 0x7f029c140880 2023-11-30T23:12:58.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 -- 172.21.15.73:0/335919159 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2334523810 0 0) 0x7f02880035d0 con 0x7f029c140880 2023-11-30T23:12:58.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 -- 172.21.15.73:0/335919159 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c0bc8b0 msgr2=0x7f029c140340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:58.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 --2- 172.21.15.73:0/335919159 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c0bc8b0 0x7f029c140340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 -- 172.21.15.73:0/335919159 >> v2:172.21.15.156:3300/0 conn(0x7f029c14a490 msgr2=0x7f029c150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:58.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 --2- 172.21.15.73:0/335919159 >> v2:172.21.15.156:3300/0 conn(0x7f029c14a490 0x7f029c150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 -- 172.21.15.73:0/335919159 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c0bcc90 con 0x7f029c140880 2023-11-30T23:12:58.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 -- 172.21.15.73:0/335919159 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3856460137 0 0) 0x7f0298001670 con 0x7f029c140880 2023-11-30T23:12:58.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 -- 172.21.15.73:0/335919159 >> v1:172.21.15.73:6789/0 conn(0x7f029c140880 legacy=0x7f029c149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 --2- 172.21.15.73:0/335919159 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c0bc8b0 0x7f0288003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 --2- 172.21.15.73:0/335919159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0288003fa0 0x7f0288004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 --2- 172.21.15.73:0/335919159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0288004db0 0x7f0288005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 -- 172.21.15.73:0/335919159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c140ce0 con 0x7f0288003fa0 2023-11-30T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 -- 172.21.15.73:0/335919159 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028800ba30 con 0x7f0288004db0 2023-11-30T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 -- 172.21.15.73:0/335919159 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028800bbc0 con 0x7f029c0bc8b0 2023-11-30T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a138d700 1 --2- 172.21.15.73:0/335919159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0288003fa0 0x7f0288004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a238f700 1 --2- 172.21.15.73:0/335919159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0288004db0 0x7f0288005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a1b8e700 1 --2- 172.21.15.73:0/335919159 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c0bc8b0 0x7f0288003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a138d700 1 -- 172.21.15.73:0/335919159 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c0bc8b0 msgr2=0x7f0288003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a138d700 1 --2- 172.21.15.73:0/335919159 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f029c0bc8b0 0x7f0288003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a138d700 1 -- 172.21.15.73:0/335919159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0288004db0 msgr2=0x7f0288005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a138d700 1 --2- 172.21.15.73:0/335919159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0288004db0 0x7f0288005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a138d700 1 -- 172.21.15.73:0/335919159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02880035d0 con 0x7f0288003fa0 2023-11-30T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a238f700 1 --2- 172.21.15.73:0/335919159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0288004db0 0x7f0288005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a138d700 1 --2- 172.21.15.73:0/335919159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0288003fa0 0x7f0288004870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f029800c320 tx=0x7f02880058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b463f5694c41e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:58.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 -- 172.21.15.73:0/335919159 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029800ce20 con 0x7f0288003fa0 2023-11-30T23:12:58.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 -- 172.21.15.73:0/335919159 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0298005980 con 0x7f0288003fa0 2023-11-30T23:12:58.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a0b8c700 1 -- 172.21.15.73:0/335919159 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298005d30 con 0x7f0288003fa0 2023-11-30T23:12:58.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a2b90700 1 -- 172.21.15.73:0/335919159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0288003fa0 msgr2=0x7f0288004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a2b90700 1 --2- 172.21.15.73:0/335919159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0288003fa0 0x7f0288004870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f029800c320 tx=0x7f02880058a0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a238f700 1 -- 172.21.15.73:0/335919159 reap_dead start 2023-11-30T23:12:58.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a2b90700 1 -- 172.21.15.73:0/335919159 shutdown_connections 2023-11-30T23:12:58.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a2b90700 1 -- 172.21.15.73:0/335919159 >> 172.21.15.73:0/335919159 conn(0x7f029c071ee0 msgr2=0x7f029c0bbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:58.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a2b90700 1 -- 172.21.15.73:0/335919159 shutdown_connections 2023-11-30T23:12:58.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.123+0000 7f02a2b90700 1 -- 172.21.15.73:0/335919159 wait complete. 2023-11-30T23:12:58.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.127+0000 7f02a2b90700 1 Processor -- start 2023-11-30T23:12:58.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.127+0000 7f02a2b90700 1 -- start start 2023-11-30T23:12:58.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.127+0000 7f02a2b90700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0288003fa0 0x7f029c147f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.127+0000 7f02a2b90700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f029c1db830 0x7f029c1dbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.127+0000 7f02a2b90700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f029c138170 0x7f029c1385f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.127+0000 7f02a2b90700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c141510 con 0x7f029c138170 2023-11-30T23:12:58.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.127+0000 7f02a2b90700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c1dc1f0 con 0x7f029c1db830 2023-11-30T23:12:58.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.127+0000 7f02a2b90700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c1490b0 con 0x7f0288003fa0 2023-11-30T23:12:58.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.127+0000 7f02a238f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f029c138170 0x7f029c1385f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.127+0000 7f02a238f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f029c138170 0x7f029c1385f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38584/0 (socket says 172.21.15.73:38584) 2023-11-30T23:12:58.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.127+0000 7f02a238f700 1 -- 172.21.15.73:0/3317455090 learned_addr learned my addr 172.21.15.73:0/3317455090 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:58.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.127+0000 7f02a138d700 1 --2- 172.21.15.73:0/3317455090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f029c1db830 0x7f029c1dbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.127+0000 7f02a1b8e700 1 --2- 172.21.15.73:0/3317455090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0288003fa0 0x7f029c147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.127+0000 7f02a238f700 1 -- 172.21.15.73:0/3317455090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0288003fa0 msgr2=0x7f029c147f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.127+0000 7f02a238f700 1 --2- 172.21.15.73:0/3317455090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0288003fa0 0x7f029c147f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.127+0000 7f02a238f700 1 -- 172.21.15.73:0/3317455090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f029c1db830 msgr2=0x7f029c1dbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.127+0000 7f02a238f700 1 --2- 172.21.15.73:0/3317455090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f029c1db830 0x7f029c1dbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.127+0000 7f02a238f700 1 -- 172.21.15.73:0/3317455090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c138b30 con 0x7f029c138170 2023-11-30T23:12:58.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.131+0000 7f02a238f700 1 --2- 172.21.15.73:0/3317455090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f029c138170 0x7f029c1385f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f029c14a870 tx=0x7f02940104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:58.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.131+0000 7f02927fc700 1 -- 172.21.15.73:0/3317455090 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029400e050 con 0x7f029c138170 2023-11-30T23:12:58.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.131+0000 7f02927fc700 1 -- 172.21.15.73:0/3317455090 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029400f040 con 0x7f029c138170 2023-11-30T23:12:58.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.131+0000 7f02a2b90700 1 -- 172.21.15.73:0/3317455090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029c141780 con 0x7f029c138170 2023-11-30T23:12:58.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.131+0000 7f02927fc700 1 -- 172.21.15.73:0/3317455090 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294007ea0 con 0x7f029c138170 2023-11-30T23:12:58.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.131+0000 7f02a2b90700 1 -- 172.21.15.73:0/3317455090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029c149350 con 0x7f029c138170 2023-11-30T23:12:58.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.131+0000 7f02a2b90700 1 -- 172.21.15.73:0/3317455090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029c0681c0 con 0x7f029c138170 2023-11-30T23:12:58.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.131+0000 7f02927fc700 1 -- 172.21.15.73:0/3317455090 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0294010d00 con 0x7f029c138170 2023-11-30T23:12:58.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.131+0000 7f02927fc700 1 --2- 172.21.15.73:0/3317455090 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0280065b00 0x7f0280067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.131+0000 7f02927fc700 1 -- 172.21.15.73:0/3317455090 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02940831d0 con 0x7f029c138170 2023-11-30T23:12:58.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.131+0000 7f02a1b8e700 1 --2- 172.21.15.73:0/3317455090 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0280065b00 0x7f0280067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.131+0000 7f02a1b8e700 1 --2- 172.21.15.73:0/3317455090 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0280065b00 0x7f0280067fc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f028c009a90 tx=0x7f028c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:58.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.139+0000 7f02927fc700 1 -- 172.21.15.73:0/3317455090 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f0294050b80 con 0x7f029c138170 2023-11-30T23:12:58.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.303+0000 7f02a2b90700 1 -- 172.21.15.73:0/3317455090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f029c1db580 con 0x7f029c138170 2023-11-30T23:12:58.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.303+0000 7f02927fc700 1 -- 172.21.15.73:0/3317455090 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f02940541a0 con 0x7f029c138170 2023-11-30T23:12:58.307 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-11-30T23:12:58.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.303+0000 7f02a2b90700 1 -- 172.21.15.73:0/3317455090 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0280065b00 msgr2=0x7f0280067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.303+0000 7f02a2b90700 1 --2- 172.21.15.73:0/3317455090 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0280065b00 0x7f0280067fc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f028c009a90 tx=0x7f028c008040 comp rx=0 tx=0).stop 2023-11-30T23:12:58.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.303+0000 7f02a2b90700 1 -- 172.21.15.73:0/3317455090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f029c138170 msgr2=0x7f029c1385f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.303+0000 7f02a2b90700 1 --2- 172.21.15.73:0/3317455090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f029c138170 0x7f029c1385f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f029c14a870 tx=0x7f02940104a0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.303+0000 7f02a2b90700 1 -- 172.21.15.73:0/3317455090 shutdown_connections 2023-11-30T23:12:58.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.303+0000 7f02a2b90700 1 --2- 172.21.15.73:0/3317455090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f029c138170 0x7f029c1385f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.303+0000 7f02a2b90700 1 --2- 172.21.15.73:0/3317455090 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0280065b00 0x7f0280067fc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.303+0000 7f02a2b90700 1 --2- 172.21.15.73:0/3317455090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f029c1db830 0x7f029c1dbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.303+0000 7f02a2b90700 1 --2- 172.21.15.73:0/3317455090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f0288003fa0 0x7f029c147f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.303+0000 7f02a2b90700 1 -- 172.21.15.73:0/3317455090 >> 172.21.15.73:0/3317455090 conn(0x7f029c071ee0 msgr2=0x7f029c145b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:58.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.307+0000 7f02a2b90700 1 -- 172.21.15.73:0/3317455090 shutdown_connections 2023-11-30T23:12:58.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.307+0000 7f02a2b90700 1 -- 172.21.15.73:0/3317455090 wait complete. 2023-11-30T23:12:58.322 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T23:12:58.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f326d099700 1 Processor -- start 2023-11-30T23:12:58.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f326d099700 1 -- start start 2023-11-30T23:12:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f326d099700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f326806f440 0x7f3268146600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f326d099700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32680b8050 0x7f32680710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f326d099700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3268147470 con 0x7f32680715f0 2023-11-30T23:12:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f326d099700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3268071a80 con 0x7f326806f440 2023-11-30T23:12:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f326d099700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326806f820 con 0x7f32680b8050 2023-11-30T23:12:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f326c898700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f32680715f0 0x7f3268140330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38260/0 (socket says 172.21.15.73:38260) 2023-11-30T23:12:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f326c898700 1 -- 172.21.15.73:0/3592041254 learned_addr learned my addr 172.21.15.73:0/3592041254 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f3267fff700 1 --2- 172.21.15.73:0/3592041254 >> v2:172.21.15.73:3300/0 conn(0x7f326806f440 0x7f3268146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f32677fe700 1 --2- 172.21.15.73:0/3592041254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32680b8050 0x7f32680710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f3266ffd700 1 -- 172.21.15.73:0/3592041254 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987124204 0 0) 0x7f3268147470 con 0x7f32680715f0 2023-11-30T23:12:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f3266ffd700 1 -- 172.21.15.73:0/3592041254 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32540035d0 con 0x7f32680715f0 2023-11-30T23:12:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f3267fff700 1 -- 172.21.15.73:0/3592041254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32680b8050 msgr2=0x7f32680710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f3267fff700 1 --2- 172.21.15.73:0/3592041254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32680b8050 0x7f32680710b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f3267fff700 1 -- 172.21.15.73:0/3592041254 >> v1:172.21.15.73:6789/0 conn(0x7f32680715f0 legacy=0x7f3268140330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f3267fff700 1 -- 172.21.15.73:0/3592041254 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3268146e20 con 0x7f326806f440 2023-11-30T23:12:58.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f3267fff700 1 --2- 172.21.15.73:0/3592041254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f326806f440 0x7f3268146600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3250009850 tx=0x7f3250009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4d224830d7c4a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:58.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f3266ffd700 1 -- 172.21.15.73:0/3592041254 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250011830 con 0x7f326806f440 2023-11-30T23:12:58.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f3266ffd700 1 -- 172.21.15.73:0/3592041254 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3250011990 con 0x7f326806f440 2023-11-30T23:12:58.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f3266ffd700 1 -- 172.21.15.73:0/3592041254 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250011d00 con 0x7f326806f440 2023-11-30T23:12:58.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f326d099700 1 -- 172.21.15.73:0/3592041254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f326806f440 msgr2=0x7f3268146600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.431+0000 7f326d099700 1 --2- 172.21.15.73:0/3592041254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f326806f440 0x7f3268146600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3250009850 tx=0x7f3250009b60 comp rx=0 tx=0).stop 2023-11-30T23:12:58.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.435+0000 7f326d099700 1 -- 172.21.15.73:0/3592041254 shutdown_connections 2023-11-30T23:12:58.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.435+0000 7f326d099700 1 --2- 172.21.15.73:0/3592041254 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f32680b8050 0x7f32680710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.435+0000 7f326d099700 1 --2- 172.21.15.73:0/3592041254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f326806f440 0x7f3268146600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.435+0000 7f326d099700 1 -- 172.21.15.73:0/3592041254 >> 172.21.15.73:0/3592041254 conn(0x7f32680b8c60 msgr2=0x7f32680b9070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:58.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.435+0000 7f326d099700 1 -- 172.21.15.73:0/3592041254 shutdown_connections 2023-11-30T23:12:58.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.435+0000 7f326d099700 1 -- 172.21.15.73:0/3592041254 wait complete. 2023-11-30T23:12:58.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.435+0000 7f326d099700 1 Processor -- start 2023-11-30T23:12:58.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.435+0000 7f326d099700 1 -- start start 2023-11-30T23:12:58.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.435+0000 7f326d099700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f326806f440 0x7f32680b7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.435+0000 7f326d099700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32680715f0 0x7f32681dc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.435+0000 7f326d099700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32680b8050 0x7f32681df440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.435+0000 7f326d099700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326813d250 con 0x7f32680715f0 2023-11-30T23:12:58.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.435+0000 7f326d099700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32681dbe10 con 0x7f32680b8050 2023-11-30T23:12:58.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.435+0000 7f326d099700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32680b2c30 con 0x7f326806f440 2023-11-30T23:12:58.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.435+0000 7f32677fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32680715f0 0x7f32681dc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.435+0000 7f32677fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32680715f0 0x7f32681dc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38602/0 (socket says 172.21.15.73:38602) 2023-11-30T23:12:58.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.435+0000 7f32677fe700 1 -- 172.21.15.73:0/4245223052 learned_addr learned my addr 172.21.15.73:0/4245223052 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:58.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.439+0000 7f3267fff700 1 --2- 172.21.15.73:0/4245223052 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f326806f440 0x7f32680b7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.439+0000 7f32677fe700 1 -- 172.21.15.73:0/4245223052 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f326806f440 msgr2=0x7f32680b7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.439+0000 7f32677fe700 1 --2- 172.21.15.73:0/4245223052 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f326806f440 0x7f32680b7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.439+0000 7f32677fe700 1 -- 172.21.15.73:0/4245223052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32680b8050 msgr2=0x7f32681df440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.439+0000 7f32677fe700 1 --2- 172.21.15.73:0/4245223052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32680b8050 0x7f32681df440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.439+0000 7f32677fe700 1 -- 172.21.15.73:0/4245223052 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32500094b0 con 0x7f32680715f0 2023-11-30T23:12:58.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.439+0000 7f3267fff700 1 --2- 172.21.15.73:0/4245223052 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f326806f440 0x7f32680b7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-30T23:12:58.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.439+0000 7f32677fe700 1 --2- 172.21.15.73:0/4245223052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32680715f0 0x7f32681dc2a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3258009d10 tx=0x7f325800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:58.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.439+0000 7f3264ff9700 1 -- 172.21.15.73:0/4245223052 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258009b80 con 0x7f32680715f0 2023-11-30T23:12:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.439+0000 7f3264ff9700 1 -- 172.21.15.73:0/4245223052 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325800f040 con 0x7f32680715f0 2023-11-30T23:12:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.439+0000 7f326d099700 1 -- 172.21.15.73:0/4245223052 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32681dbaa0 con 0x7f32680715f0 2023-11-30T23:12:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.439+0000 7f3264ff9700 1 -- 172.21.15.73:0/4245223052 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258014480 con 0x7f32680715f0 2023-11-30T23:12:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.439+0000 7f326d099700 1 -- 172.21.15.73:0/4245223052 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32681dc7e0 con 0x7f32680715f0 2023-11-30T23:12:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.439+0000 7f3264ff9700 1 -- 172.21.15.73:0/4245223052 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f32580145e0 con 0x7f32680715f0 2023-11-30T23:12:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.439+0000 7f326d099700 1 -- 172.21.15.73:0/4245223052 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32680681c0 con 0x7f32680715f0 2023-11-30T23:12:58.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.439+0000 7f3264ff9700 1 --2- 172.21.15.73:0/4245223052 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3248065ad0 0x7f3248067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.439+0000 7f3267fff700 1 --2- 172.21.15.73:0/4245223052 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3248065ad0 0x7f3248067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.443+0000 7f3264ff9700 1 -- 172.21.15.73:0/4245223052 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3258083a30 con 0x7f32680715f0 2023-11-30T23:12:58.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.443+0000 7f3267fff700 1 --2- 172.21.15.73:0/4245223052 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3248065ad0 0x7f3248067f90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f32500090b0 tx=0x7f3250008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:58.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.447+0000 7f3264ff9700 1 -- 172.21.15.73:0/4245223052 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f3258051400 con 0x7f32680715f0 2023-11-30T23:12:58.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.611+0000 7f326d099700 1 -- 172.21.15.73:0/4245223052 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3268072c00 con 0x7f32680715f0 2023-11-30T23:12:58.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.611+0000 7f3264ff9700 1 -- 172.21.15.73:0/4245223052 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3258054a20 con 0x7f32680715f0 2023-11-30T23:12:58.615 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-11-30T23:12:58.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.611+0000 7f326d099700 1 -- 172.21.15.73:0/4245223052 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3248065ad0 msgr2=0x7f3248067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.611+0000 7f326d099700 1 --2- 172.21.15.73:0/4245223052 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3248065ad0 0x7f3248067f90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f32500090b0 tx=0x7f3250008030 comp rx=0 tx=0).stop 2023-11-30T23:12:58.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.611+0000 7f326d099700 1 -- 172.21.15.73:0/4245223052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32680715f0 msgr2=0x7f32681dc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.611+0000 7f326d099700 1 --2- 172.21.15.73:0/4245223052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32680715f0 0x7f32681dc2a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3258009d10 tx=0x7f325800c3a0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.611+0000 7f326d099700 1 -- 172.21.15.73:0/4245223052 shutdown_connections 2023-11-30T23:12:58.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.611+0000 7f326d099700 1 --2- 172.21.15.73:0/4245223052 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3248065ad0 0x7f3248067f90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.611+0000 7f326d099700 1 --2- 172.21.15.73:0/4245223052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32680b8050 0x7f32681df440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.611+0000 7f326d099700 1 --2- 172.21.15.73:0/4245223052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32680715f0 0x7f32681dc2a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.611+0000 7f326d099700 1 --2- 172.21.15.73:0/4245223052 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f326806f440 0x7f32680b7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.611+0000 7f326d099700 1 -- 172.21.15.73:0/4245223052 >> 172.21.15.73:0/4245223052 conn(0x7f32680b8c60 msgr2=0x7f32680b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:58.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.611+0000 7f326d099700 1 -- 172.21.15.73:0/4245223052 shutdown_connections 2023-11-30T23:12:58.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.611+0000 7f326d099700 1 -- 172.21.15.73:0/4245223052 wait complete. 2023-11-30T23:12:58.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T23:12:58.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.735+0000 7f650359e700 1 Processor -- start 2023-11-30T23:12:58.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.735+0000 7f650359e700 1 -- start start 2023-11-30T23:12:58.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f650359e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f65040b24a0 0x7f6504144e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f650359e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65040b0fb0 con 0x7f65040afcc0 2023-11-30T23:12:58.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f650359e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65040b1c80 con 0x7f650414e1f0 2023-11-30T23:12:58.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f650359e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65040af5e0 con 0x7f65040b24a0 2023-11-30T23:12:58.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f6501d9b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f65040afcc0 0x7f65041532a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38274/0 (socket says 172.21.15.73:38274) 2023-11-30T23:12:58.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f6502d9d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f65040b24a0 0x7f6504144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f6501d9b700 1 -- 172.21.15.73:0/1090413013 learned_addr learned my addr 172.21.15.73:0/1090413013 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:58.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f6502d9d700 1 -- 172.21.15.73:0/1090413013 >> v1:172.21.15.156:6789/0 conn(0x7f650414e1f0 legacy=0x7f6504144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:58.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f6502d9d700 1 -- 172.21.15.73:0/1090413013 >> v1:172.21.15.73:6789/0 conn(0x7f65040afcc0 legacy=0x7f65041532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f6502d9d700 1 -- 172.21.15.73:0/1090413013 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650414e5d0 con 0x7f65040b24a0 2023-11-30T23:12:58.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f650159a700 1 -- 172.21.15.73:0/1090413013 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808363615 0 0) 0x7f65040b0fb0 con 0x7f65040afcc0 2023-11-30T23:12:58.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f6502d9d700 1 --2- 172.21.15.73:0/1090413013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65040b24a0 0x7f6504144e10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009880 tx=0x7f64fc009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4fe7428873b4a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:58.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f650159a700 1 -- 172.21.15.73:0/1090413013 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc004230 con 0x7f65040b24a0 2023-11-30T23:12:58.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f650159a700 1 -- 172.21.15.73:0/1090413013 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc004390 con 0x7f65040b24a0 2023-11-30T23:12:58.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f650159a700 1 -- 172.21.15.73:0/1090413013 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0036c0 con 0x7f65040b24a0 2023-11-30T23:12:58.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f650359e700 1 -- 172.21.15.73:0/1090413013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65040b24a0 msgr2=0x7f6504144e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f650359e700 1 --2- 172.21.15.73:0/1090413013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65040b24a0 0x7f6504144e10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009880 tx=0x7f64fc009b90 comp rx=0 tx=0).stop 2023-11-30T23:12:58.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f650359e700 1 -- 172.21.15.73:0/1090413013 shutdown_connections 2023-11-30T23:12:58.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f650359e700 1 --2- 172.21.15.73:0/1090413013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65040b24a0 0x7f6504144e10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f650359e700 1 -- 172.21.15.73:0/1090413013 >> 172.21.15.73:0/1090413013 conn(0x7f65040b45a0 msgr2=0x7f65040b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:58.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f650359e700 1 -- 172.21.15.73:0/1090413013 shutdown_connections 2023-11-30T23:12:58.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.739+0000 7f650359e700 1 -- 172.21.15.73:0/1090413013 wait complete. 2023-11-30T23:12:58.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f650359e700 1 Processor -- start 2023-11-30T23:12:58.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f650359e700 1 -- start start 2023-11-30T23:12:58.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f650359e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f65040afcc0 0x7f650414adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f650359e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65040b24a0 0x7f65041e00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f650359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f650414e1f0 0x7f65041e05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f650359e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65041d4c40 con 0x7f650414e1f0 2023-11-30T23:12:58.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f650359e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65041d3c30 con 0x7f65040b24a0 2023-11-30T23:12:58.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f650359e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65041d3870 con 0x7f65040afcc0 2023-11-30T23:12:58.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f6502d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f650414e1f0 0x7f65041e05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f6501d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65040b24a0 0x7f65041e00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f650259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f65040afcc0 0x7f650414adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f6501d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65040b24a0 0x7f65041e00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59766/0 (socket says 172.21.15.73:59766) 2023-11-30T23:12:58.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f6501d9b700 1 -- 172.21.15.73:0/457573054 learned_addr learned my addr 172.21.15.73:0/457573054 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:58.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f650259c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f65040afcc0 0x7f650414adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:43434/0 (socket says 172.21.15.73:43434) 2023-11-30T23:12:58.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f6502d9d700 1 -- 172.21.15.73:0/457573054 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f65040afcc0 msgr2=0x7f650414adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f6502d9d700 1 --2- 172.21.15.73:0/457573054 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f65040afcc0 0x7f650414adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f6502d9d700 1 -- 172.21.15.73:0/457573054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65040b24a0 msgr2=0x7f65041e00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f6502d9d700 1 --2- 172.21.15.73:0/457573054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65040b24a0 0x7f65041e00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f6502d9d700 1 -- 172.21.15.73:0/457573054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc0094b0 con 0x7f650414e1f0 2023-11-30T23:12:58.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.743+0000 7f6501d9b700 1 --2- 172.21.15.73:0/457573054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65040b24a0 0x7f65041e00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:12:58.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.747+0000 7f6502d9d700 1 --2- 172.21.15.73:0/457573054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f650414e1f0 0x7f65041e05e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f64fc015000 tx=0x7f64fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:58.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.747+0000 7f64faffd700 1 -- 172.21.15.73:0/457573054 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc006ea0 con 0x7f650414e1f0 2023-11-30T23:12:58.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.747+0000 7f64faffd700 1 -- 172.21.15.73:0/457573054 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc01f070 con 0x7f650414e1f0 2023-11-30T23:12:58.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.747+0000 7f650359e700 1 -- 172.21.15.73:0/457573054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6504148220 con 0x7f650414e1f0 2023-11-30T23:12:58.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.747+0000 7f64faffd700 1 -- 172.21.15.73:0/457573054 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc011850 con 0x7f650414e1f0 2023-11-30T23:12:58.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.747+0000 7f650359e700 1 -- 172.21.15.73:0/457573054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6504147ed0 con 0x7f650414e1f0 2023-11-30T23:12:58.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.747+0000 7f650359e700 1 -- 172.21.15.73:0/457573054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6504148060 con 0x7f650414e1f0 2023-11-30T23:12:58.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.747+0000 7f64faffd700 1 -- 172.21.15.73:0/457573054 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f64fc021030 con 0x7f650414e1f0 2023-11-30T23:12:58.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.751+0000 7f64faffd700 1 --2- 172.21.15.73:0/457573054 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f64e4065ad0 0x7f64e4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:58.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.751+0000 7f64faffd700 1 -- 172.21.15.73:0/457573054 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64fc0846b0 con 0x7f650414e1f0 2023-11-30T23:12:58.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.751+0000 7f650259c700 1 --2- 172.21.15.73:0/457573054 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f64e4065ad0 0x7f64e4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:58.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.751+0000 7f650259c700 1 --2- 172.21.15.73:0/457573054 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f64e4065ad0 0x7f64e4067f90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f64f4005150 tx=0x7f64f4007ee0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:58.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.755+0000 7f64faffd700 1 -- 172.21.15.73:0/457573054 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f64fc052100 con 0x7f650414e1f0 2023-11-30T23:12:58.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.959+0000 7f650359e700 1 -- 172.21.15.73:0/457573054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6504148060 con 0x7f650414e1f0 2023-11-30T23:12:58.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.959+0000 7f64faffd700 1 -- 172.21.15.73:0/457573054 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3133 (secure 0 0 0) 0x7f64fc055720 con 0x7f650414e1f0 2023-11-30T23:12:58.963 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:58.963 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3213239947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3213239947},{"type":"v1","addr":"172.21.15.73:6835","nonce":3213239947}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T23:12:47.481180+0000","modified":"2023-11-30T23:12:50.126014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6833/1140380051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":1140380051},{"type":"v1","addr":"172.21.15.156:6833","nonce":1140380051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-30T23:12:58.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.959+0000 7f650359e700 1 -- 172.21.15.73:0/457573054 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f64e4065ad0 msgr2=0x7f64e4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.959+0000 7f650359e700 1 --2- 172.21.15.73:0/457573054 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f64e4065ad0 0x7f64e4067f90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f64f4005150 tx=0x7f64f4007ee0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.959+0000 7f650359e700 1 -- 172.21.15.73:0/457573054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f650414e1f0 msgr2=0x7f65041e05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:58.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.959+0000 7f650359e700 1 --2- 172.21.15.73:0/457573054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f650414e1f0 0x7f65041e05e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f64fc015000 tx=0x7f64fc004770 comp rx=0 tx=0).stop 2023-11-30T23:12:58.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.959+0000 7f650359e700 1 -- 172.21.15.73:0/457573054 shutdown_connections 2023-11-30T23:12:58.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.959+0000 7f650359e700 1 --2- 172.21.15.73:0/457573054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f650414e1f0 0x7f65041e05e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.959+0000 7f650359e700 1 --2- 172.21.15.73:0/457573054 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f64e4065ad0 0x7f64e4067f90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.959+0000 7f650359e700 1 --2- 172.21.15.73:0/457573054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65040b24a0 0x7f65041e00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.959+0000 7f650359e700 1 --2- 172.21.15.73:0/457573054 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f65040afcc0 0x7f650414adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:58.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.959+0000 7f650359e700 1 -- 172.21.15.73:0/457573054 >> 172.21.15.73:0/457573054 conn(0x7f65040b45a0 msgr2=0x7f650414c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:58.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.959+0000 7f650359e700 1 -- 172.21.15.73:0/457573054 shutdown_connections 2023-11-30T23:12:58.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:58.959+0000 7f650359e700 1 -- 172.21.15.73:0/457573054 wait complete. 2023-11-30T23:12:58.966 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 7 2023-11-30T23:12:58.981 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T23:12:59.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.091+0000 7f14af4ca700 1 Processor -- start 2023-11-30T23:12:59.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.091+0000 7f14af4ca700 1 -- start start 2023-11-30T23:12:59.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.091+0000 7f14af4ca700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f14a80b2710 0x7f14a80aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:59.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.091+0000 7f14af4ca700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14a8146a20 0x7f14a8146e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:59.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.091+0000 7f14af4ca700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a806f280 con 0x7f14a813cf00 2023-11-30T23:12:59.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.091+0000 7f14af4ca700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a806e5b0 con 0x7f14a80b2710 2023-11-30T23:12:59.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.091+0000 7f14af4ca700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80b2af0 con 0x7f14a8146a20 2023-11-30T23:12:59.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.091+0000 7f14adcc7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14a8146a20 0x7f14a8146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:59.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.091+0000 7f14ae4c8700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f14a80b2710 0x7f14a80aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:59.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.091+0000 7f14adcc7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14a8146a20 0x7f14a8146e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:43438/0 (socket says 172.21.15.73:43438) 2023-11-30T23:12:59.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.091+0000 7f14adcc7700 1 -- 172.21.15.73:0/640399371 learned_addr learned my addr 172.21.15.73:0/640399371 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:59.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14adcc7700 1 -- 172.21.15.73:0/640399371 >> v2:172.21.15.156:3300/0 conn(0x7f14a80b2710 msgr2=0x7f14a80aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:59.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14adcc7700 1 --2- 172.21.15.73:0/640399371 >> v2:172.21.15.156:3300/0 conn(0x7f14a80b2710 0x7f14a80aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14adcc7700 1 -- 172.21.15.73:0/640399371 >> v1:172.21.15.156:6789/0 conn(0x7f14a813cf00 legacy=0x7f14a813d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:59.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14adcc7700 1 -- 172.21.15.73:0/640399371 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a81473a0 con 0x7f14a8146a20 2023-11-30T23:12:59.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14adcc7700 1 --2- 172.21.15.73:0/640399371 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14a8146a20 0x7f14a8146e60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f14a400bef0 tx=0x7f14a40093b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fff3a67faaa579ae server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:59.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14ad4c6700 1 -- 172.21.15.73:0/640399371 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a400b4e0 con 0x7f14a8146a20 2023-11-30T23:12:59.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14ad4c6700 1 -- 172.21.15.73:0/640399371 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a400c950 con 0x7f14a8146a20 2023-11-30T23:12:59.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14ad4c6700 1 -- 172.21.15.73:0/640399371 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a400cd00 con 0x7f14a8146a20 2023-11-30T23:12:59.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14af4ca700 1 -- 172.21.15.73:0/640399371 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14a8146a20 msgr2=0x7f14a8146e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:59.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14af4ca700 1 --2- 172.21.15.73:0/640399371 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14a8146a20 0x7f14a8146e60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f14a400bef0 tx=0x7f14a40093b0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14af4ca700 1 -- 172.21.15.73:0/640399371 shutdown_connections 2023-11-30T23:12:59.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14af4ca700 1 --2- 172.21.15.73:0/640399371 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14a8146a20 0x7f14a8146e60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14af4ca700 1 --2- 172.21.15.73:0/640399371 >> v2:172.21.15.156:3300/0 conn(0x7f14a80b2710 0x7f14a80aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14af4ca700 1 -- 172.21.15.73:0/640399371 >> 172.21.15.73:0/640399371 conn(0x7f14a80b45a0 msgr2=0x7f14a80b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:59.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14af4ca700 1 -- 172.21.15.73:0/640399371 shutdown_connections 2023-11-30T23:12:59.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14af4ca700 1 -- 172.21.15.73:0/640399371 wait complete. 2023-11-30T23:12:59.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14af4ca700 1 Processor -- start 2023-11-30T23:12:59.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14af4ca700 1 -- start start 2023-11-30T23:12:59.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14af4ca700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14a80b2710 0x7f14a813e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:59.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14af4ca700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14a813cf00 0x7f14a8142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:59.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14af4ca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a8146a20 0x7f14a8139c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:59.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14af4ca700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a813e610 con 0x7f14a8146a20 2023-11-30T23:12:59.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14af4ca700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a81daeb0 con 0x7f14a80b2710 2023-11-30T23:12:59.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.095+0000 7f14af4ca700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a81da860 con 0x7f14a813cf00 2023-11-30T23:12:59.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.099+0000 7f14aecc9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a8146a20 0x7f14a8139c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:59.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.099+0000 7f14adcc7700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14a813cf00 0x7f14a8142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:59.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.099+0000 7f14aecc9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a8146a20 0x7f14a8139c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38620/0 (socket says 172.21.15.73:38620) 2023-11-30T23:12:59.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.099+0000 7f14aecc9700 1 -- 172.21.15.73:0/1077818600 learned_addr learned my addr 172.21.15.73:0/1077818600 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:59.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.099+0000 7f14ae4c8700 1 --2- 172.21.15.73:0/1077818600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14a80b2710 0x7f14a813e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:59.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.099+0000 7f14aecc9700 1 -- 172.21.15.73:0/1077818600 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14a813cf00 msgr2=0x7f14a8142fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:59.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.099+0000 7f14aecc9700 1 --2- 172.21.15.73:0/1077818600 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14a813cf00 0x7f14a8142fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.099+0000 7f14aecc9700 1 -- 172.21.15.73:0/1077818600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14a80b2710 msgr2=0x7f14a813e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:59.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.099+0000 7f14aecc9700 1 --2- 172.21.15.73:0/1077818600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14a80b2710 0x7f14a813e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.099+0000 7f14aecc9700 1 -- 172.21.15.73:0/1077818600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a400bb50 con 0x7f14a8146a20 2023-11-30T23:12:59.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.099+0000 7f14aecc9700 1 --2- 172.21.15.73:0/1077818600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a8146a20 0x7f14a8139c10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f14a000c480 tx=0x7f14a000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:59.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.099+0000 7f149effd700 1 -- 172.21.15.73:0/1077818600 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a00052d0 con 0x7f14a8146a20 2023-11-30T23:12:59.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.099+0000 7f149effd700 1 -- 172.21.15.73:0/1077818600 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a000ce90 con 0x7f14a8146a20 2023-11-30T23:12:59.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.099+0000 7f14af4ca700 1 -- 172.21.15.73:0/1077818600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a81dab40 con 0x7f14a8146a20 2023-11-30T23:12:59.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.099+0000 7f149effd700 1 -- 172.21.15.73:0/1077818600 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a00036a0 con 0x7f14a8146a20 2023-11-30T23:12:59.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.099+0000 7f14af4ca700 1 -- 172.21.15.73:0/1077818600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a81da4f0 con 0x7f14a8146a20 2023-11-30T23:12:59.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.099+0000 7f14af4ca700 1 -- 172.21.15.73:0/1077818600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a81db040 con 0x7f14a8146a20 2023-11-30T23:12:59.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.103+0000 7f149effd700 1 -- 172.21.15.73:0/1077818600 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f14a0003800 con 0x7f14a8146a20 2023-11-30T23:12:59.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.103+0000 7f149effd700 1 --2- 172.21.15.73:0/1077818600 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f148c065b00 0x7f148c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:59.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.103+0000 7f14ae4c8700 1 --2- 172.21.15.73:0/1077818600 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f148c065b00 0x7f148c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:59.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.103+0000 7f149effd700 1 -- 172.21.15.73:0/1077818600 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14a00823f0 con 0x7f14a8146a20 2023-11-30T23:12:59.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.103+0000 7f14ae4c8700 1 --2- 172.21.15.73:0/1077818600 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f148c065b00 0x7f148c067fc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1498015230 tx=0x7f149800f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:59.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.111+0000 7f149effd700 1 -- 172.21.15.73:0/1077818600 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f14a004fe40 con 0x7f14a8146a20 2023-11-30T23:12:59.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.275+0000 7f14af4ca700 1 -- 172.21.15.73:0/1077818600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14a804ed80 con 0x7f14a8146a20 2023-11-30T23:12:59.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.279+0000 7f149effd700 1 -- 172.21.15.73:0/1077818600 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f14a0053460 con 0x7f14a8146a20 2023-11-30T23:12:59.282 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:12:59.282 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"a677cb6a-4a54-4567-a30d-f0fa4bc22b17","created":"2023-11-30T23:12:23.260968+0000","modified":"2023-11-30T23:12:48.484283+0000","last_up_change":"2023-11-30T23:12:33.649318+0000","last_in_change":"2023-11-30T23:12:25.326689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-30T23:12:34.413317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-30T23:12:45.403156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-30T23:12:46.475384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbf1c93f-0775-4780-8524-cf25792d9aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36686},{"type":"v1","addr":"172.21.15.73:6817","nonce":36686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36686},{"type":"v1","addr":"172.21.15.73:6819","nonce":36686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36686},{"type":"v1","addr":"172.21.15.73:6823","nonce":36686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36686},{"type":"v1","addr":"172.21.15.73:6821","nonce":36686}]},"public_addr":"172.21.15.73:6817/36686","cluster_addr":"172.21.15.73:6819/36686","heartbeat_back_addr":"172.21.15.73:6823/36686","heartbeat_front_addr":"172.21.15.73:6821/36686","state":["exists","up"]},{"osd":1,"uuid":"9d9dd122-9a42-4588-a0d2-50d13b13eba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36687},{"type":"v1","addr":"172.21.15.73:6809","nonce":36687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":36687},{"type":"v1","addr":"172.21.15.73:6811","nonce":36687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36687},{"type":"v1","addr":"172.21.15.73:6815","nonce":36687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36687},{"type":"v1","addr":"172.21.15.73:6813","nonce":36687}]},"public_addr":"172.21.15.73:6809/36687","cluster_addr":"172.21.15.73:6811/36687","heartbeat_back_addr":"172.21.15.73:6815/36687","heartbeat_front_addr":"172.21.15.73:6813/36687","state":["exists","up"]},{"osd":2,"uuid":"68ff4f1e-ec45-42e0-bb83-fe03598e4940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36688},{"type":"v1","addr":"172.21.15.73:6825","nonce":36688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36688},{"type":"v1","addr":"172.21.15.73:6827","nonce":36688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36688},{"type":"v1","addr":"172.21.15.73:6831","nonce":36688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36688},{"type":"v1","addr":"172.21.15.73:6829","nonce":36688}]},"public_addr":"172.21.15.73:6825/36688","cluster_addr":"172.21.15.73:6827/36688","heartbeat_back_addr":"172.21.15.73:6831/36688","heartbeat_front_addr":"172.21.15.73:6829/36688","state":["exists","up"]},{"osd":3,"uuid":"e4b08c98-6a4d-4ec8-a245-59a35f70a16f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36685},{"type":"v1","addr":"172.21.15.73:6801","nonce":36685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36685},{"type":"v1","addr":"172.21.15.73:6803","nonce":36685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":36685},{"type":"v1","addr":"172.21.15.73:6807","nonce":36685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36685},{"type":"v1","addr":"172.21.15.73:6805","nonce":36685}]},"public_addr":"172.21.15.73:6801/36685","cluster_addr":"172.21.15.73:6803/36685","heartbeat_back_addr":"172.21.15.73:6807/36685","heartbeat_front_addr":"172.21.15.73:6805/36685","state":["exists","up"]},{"osd":4,"uuid":"d0922b0e-5170-474d-b270-ddb5adc858cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":36908},{"type":"v1","addr":"172.21.15.156:6801","nonce":36908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":36908},{"type":"v1","addr":"172.21.15.156:6803","nonce":36908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":36908},{"type":"v1","addr":"172.21.15.156:6807","nonce":36908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":36908},{"type":"v1","addr":"172.21.15.156:6805","nonce":36908}]},"public_addr":"172.21.15.156:6801/36908","cluster_addr":"172.21.15.156:6803/36908","heartbeat_back_addr":"172.21.15.156:6807/36908","heartbeat_front_addr":"172.21.15.156:6805/36908","state":["exists","up"]},{"osd":5,"uuid":"f2791a77-db25-479c-95d5-ea7f77458685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":36909},{"type":"v1","addr":"172.21.15.156:6809","nonce":36909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":36909},{"type":"v1","addr":"172.21.15.156:6811","nonce":36909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":36909},{"type":"v1","addr":"172.21.15.156:6815","nonce":36909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":36909},{"type":"v1","addr":"172.21.15.156:6813","nonce":36909}]},"public_addr":"172.21.15.156:6809/36909","cluster_addr":"172.21.15.156:6811/36909","heartbeat_back_addr":"172.21.15.156:6815/36909","heartbeat_front_addr":"172.21.15.156:6813/36909","state":["exists","up"]},{"osd":6,"uuid":"f86c2fe9-ec8b-406e-af26-5dc65c926382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":36910},{"type":"v1","addr":"172.21.15.156:6817","nonce":36910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":36910},{"type":"v1","addr":"172.21.15.156:6819","nonce":36910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":36910},{"type":"v1","addr":"172.21.15.156:6823","nonce":36910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":36910},{"type":"v1","addr":"172.21.15.156:6821","nonce":36910}]},"public_addr":"172.21.15.156:6817/36910","cluster_addr":"172.21.15.156:6819/36910","heartbeat_back_addr":"172.21.15.156:6823/36910","heartbeat_front_addr":"172.21.15.156:6821/36910","state":["exists","up"]},{"osd":7,"uuid":"56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":36911},{"type":"v1","addr":"172.21.15.156:6825","nonce":36911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":36911},{"type":"v1","addr":"172.21.15.156:6827","nonce":36911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":36911},{"type":"v1","addr":"172.21.15.156:6831","nonce":36911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":36911},{"type":"v1","addr":"172.21.15.156:6829","nonce":36911}]},"public_addr":"172.21.15.156:6825/36911","cluster_addr":"172.21.15.156:6827/36911","heartbeat_back_addr":"172.21.15.156:6831/36911","heartbeat_front_addr":"172.21.15.156:6829/36911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.597534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.505493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.811871+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.586741+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.366817+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.101605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.627496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.829046+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T23:12:59.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.279+0000 7f14af4ca700 1 -- 172.21.15.73:0/1077818600 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f148c065b00 msgr2=0x7f148c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:59.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.279+0000 7f14af4ca700 1 --2- 172.21.15.73:0/1077818600 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f148c065b00 0x7f148c067fc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1498015230 tx=0x7f149800f040 comp rx=0 tx=0).stop 2023-11-30T23:12:59.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.279+0000 7f14af4ca700 1 -- 172.21.15.73:0/1077818600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a8146a20 msgr2=0x7f14a8139c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:59.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.279+0000 7f14af4ca700 1 --2- 172.21.15.73:0/1077818600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a8146a20 0x7f14a8139c10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f14a000c480 tx=0x7f14a000c790 comp rx=0 tx=0).stop 2023-11-30T23:12:59.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.279+0000 7f14af4ca700 1 -- 172.21.15.73:0/1077818600 shutdown_connections 2023-11-30T23:12:59.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.279+0000 7f14af4ca700 1 --2- 172.21.15.73:0/1077818600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a8146a20 0x7f14a8139c10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.279+0000 7f14af4ca700 1 --2- 172.21.15.73:0/1077818600 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f14a813cf00 0x7f14a8142fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.279+0000 7f14af4ca700 1 --2- 172.21.15.73:0/1077818600 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f148c065b00 0x7f148c067fc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.279+0000 7f14af4ca700 1 --2- 172.21.15.73:0/1077818600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14a80b2710 0x7f14a813e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.279+0000 7f14af4ca700 1 -- 172.21.15.73:0/1077818600 >> 172.21.15.73:0/1077818600 conn(0x7f14a80b45a0 msgr2=0x7f14a813ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:59.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.279+0000 7f14af4ca700 1 -- 172.21.15.73:0/1077818600 shutdown_connections 2023-11-30T23:12:59.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.279+0000 7f14af4ca700 1 -- 172.21.15.73:0/1077818600 wait complete. 2023-11-30T23:12:59.298 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-30T23:12:34.413317+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T23:12:45.403156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T23:12:46.475384+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-30T23:12:59.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-30T23:12:59.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.407+0000 7fc1601dc700 1 Processor -- start 2023-11-30T23:12:59.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.407+0000 7fc1601dc700 1 -- start start 2023-11-30T23:12:59.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.407+0000 7fc1601dc700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc1580b1820 0x7fc15813e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:59.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.407+0000 7fc1601dc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1580b38f0 con 0x7fc15806e4b0 2023-11-30T23:12:59.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.407+0000 7fc1601dc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc15813ee50 con 0x7fc15813e9e0 2023-11-30T23:12:59.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.407+0000 7fc1601dc700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1580b4620 con 0x7fc1580b1820 2023-11-30T23:12:59.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.407+0000 7fc15df78700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc15806e4b0 0x7fc158147c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38276/0 (socket says 172.21.15.73:38276) 2023-11-30T23:12:59.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.407+0000 7fc15df78700 1 -- 172.21.15.73:0/1077834466 learned_addr learned my addr 172.21.15.73:0/1077834466 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:12:59.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.407+0000 7fc15d777700 1 --2- 172.21.15.73:0/1077834466 >> v2:172.21.15.156:3300/0 conn(0x7fc1580b1820 0x7fc15813e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:59.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.407+0000 7fc15cf76700 1 -- 172.21.15.73:0/1077834466 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213299117 0 0) 0x7fc1580b38f0 con 0x7fc15806e4b0 2023-11-30T23:12:59.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.407+0000 7fc15cf76700 1 -- 172.21.15.73:0/1077834466 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1440035d0 con 0x7fc15806e4b0 2023-11-30T23:12:59.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.407+0000 7fc15d777700 1 -- 172.21.15.73:0/1077834466 >> v1:172.21.15.156:6789/0 conn(0x7fc15813e9e0 legacy=0x7fc15814efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:59.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.407+0000 7fc15d777700 1 -- 172.21.15.73:0/1077834466 >> v1:172.21.15.73:6789/0 conn(0x7fc15806e4b0 legacy=0x7fc158147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:59.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.407+0000 7fc15cf76700 1 -- 172.21.15.73:0/1077834466 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972884878 0 0) 0x7fc15813ee50 con 0x7fc15813e9e0 2023-11-30T23:12:59.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.407+0000 7fc15d777700 1 -- 172.21.15.73:0/1077834466 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15806e890 con 0x7fc1580b1820 2023-11-30T23:12:59.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.407+0000 7fc15d777700 1 --2- 172.21.15.73:0/1077834466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1580b1820 0x7fc15813e4a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc148009850 tx=0x7fc148009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2557a706a600c33 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:59.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc15cf76700 1 -- 172.21.15.73:0/1077834466 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc148011830 con 0x7fc1580b1820 2023-11-30T23:12:59.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc15cf76700 1 -- 172.21.15.73:0/1077834466 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc148011990 con 0x7fc1580b1820 2023-11-30T23:12:59.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc15cf76700 1 -- 172.21.15.73:0/1077834466 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc148011d40 con 0x7fc1580b1820 2023-11-30T23:12:59.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc1601dc700 1 -- 172.21.15.73:0/1077834466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1580b1820 msgr2=0x7fc15813e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:59.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc1601dc700 1 --2- 172.21.15.73:0/1077834466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1580b1820 0x7fc15813e4a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc148009850 tx=0x7fc148009b60 comp rx=0 tx=0).stop 2023-11-30T23:12:59.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc1601dc700 1 -- 172.21.15.73:0/1077834466 shutdown_connections 2023-11-30T23:12:59.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc1601dc700 1 --2- 172.21.15.73:0/1077834466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1580b1820 0x7fc15813e4a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc1601dc700 1 -- 172.21.15.73:0/1077834466 >> 172.21.15.73:0/1077834466 conn(0x7fc15806a180 msgr2=0x7fc15806a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:59.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc1601dc700 1 -- 172.21.15.73:0/1077834466 shutdown_connections 2023-11-30T23:12:59.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc1601dc700 1 -- 172.21.15.73:0/1077834466 wait complete. 2023-11-30T23:12:59.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc1601dc700 1 Processor -- start 2023-11-30T23:12:59.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc1601dc700 1 -- start start 2023-11-30T23:12:59.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc1601dc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc15806e4b0 0x7fc158146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:59.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc1601dc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1580b1820 0x7fc1580b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:59.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc1601dc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc15813e9e0 0x7fc1580ad790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:59.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc1601dc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1580acf70 con 0x7fc15806e4b0 2023-11-30T23:12:59.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc1601dc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1580b0f60 con 0x7fc1580b1820 2023-11-30T23:12:59.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc1601dc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1580afb20 con 0x7fc15813e9e0 2023-11-30T23:12:59.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.411+0000 7fc15df78700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc15806e4b0 0x7fc158146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:59.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.415+0000 7fc15df78700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc15806e4b0 0x7fc158146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38628/0 (socket says 172.21.15.73:38628) 2023-11-30T23:12:59.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.415+0000 7fc15df78700 1 -- 172.21.15.73:0/1381225072 learned_addr learned my addr 172.21.15.73:0/1381225072 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:59.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.415+0000 7fc15d777700 1 --2- 172.21.15.73:0/1381225072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1580b1820 0x7fc1580b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:59.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.415+0000 7fc15e779700 1 --2- 172.21.15.73:0/1381225072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc15813e9e0 0x7fc1580ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:59.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.415+0000 7fc15df78700 1 -- 172.21.15.73:0/1381225072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc15813e9e0 msgr2=0x7fc1580ad790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:59.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.415+0000 7fc15df78700 1 --2- 172.21.15.73:0/1381225072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc15813e9e0 0x7fc1580ad790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.415+0000 7fc15df78700 1 -- 172.21.15.73:0/1381225072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1580b1820 msgr2=0x7fc1580b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:59.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.415+0000 7fc15df78700 1 --2- 172.21.15.73:0/1381225072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1580b1820 0x7fc1580b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.415+0000 7fc15df78700 1 -- 172.21.15.73:0/1381225072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1480094b0 con 0x7fc15806e4b0 2023-11-30T23:12:59.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.415+0000 7fc15df78700 1 --2- 172.21.15.73:0/1381225072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc15806e4b0 0x7fc158146490 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc15400c520 tx=0x7fc15400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:59.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.415+0000 7fc14e7fc700 1 -- 172.21.15.73:0/1381225072 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154005d90 con 0x7fc15806e4b0 2023-11-30T23:12:59.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.415+0000 7fc14e7fc700 1 -- 172.21.15.73:0/1381225072 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15400ce90 con 0x7fc15806e4b0 2023-11-30T23:12:59.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.415+0000 7fc14e7fc700 1 -- 172.21.15.73:0/1381225072 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1540072d0 con 0x7fc15806e4b0 2023-11-30T23:12:59.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.415+0000 7fc1601dc700 1 -- 172.21.15.73:0/1381225072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1580ad390 con 0x7fc15806e4b0 2023-11-30T23:12:59.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.415+0000 7fc1601dc700 1 -- 172.21.15.73:0/1381225072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1580b0050 con 0x7fc15806e4b0 2023-11-30T23:12:59.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.415+0000 7fc1601dc700 1 -- 172.21.15.73:0/1381225072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc15804ed80 con 0x7fc15806e4b0 2023-11-30T23:12:59.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.415+0000 7fc14e7fc700 1 -- 172.21.15.73:0/1381225072 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc154007430 con 0x7fc15806e4b0 2023-11-30T23:12:59.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.419+0000 7fc14e7fc700 1 --2- 172.21.15.73:0/1381225072 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc13c065ad0 0x7fc13c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:59.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.419+0000 7fc15d777700 1 --2- 172.21.15.73:0/1381225072 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc13c065ad0 0x7fc13c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:59.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.419+0000 7fc14e7fc700 1 -- 172.21.15.73:0/1381225072 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc154082340 con 0x7fc15806e4b0 2023-11-30T23:12:59.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.419+0000 7fc15d777700 1 --2- 172.21.15.73:0/1381225072 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc13c065ad0 0x7fc13c067f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc1580b1c70 tx=0x7fc148008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:59.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.427+0000 7fc14e7fc700 1 -- 172.21.15.73:0/1381225072 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fc15404fe40 con 0x7fc15806e4b0 2023-11-30T23:12:59.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.587+0000 7fc1601dc700 1 -- 172.21.15.73:0/1381225072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1580ae970 con 0x7fc15806e4b0 2023-11-30T23:12:59.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.587+0000 7fc14e7fc700 1 -- 172.21.15.73:0/1381225072 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc154053460 con 0x7fc15806e4b0 2023-11-30T23:12:59.593 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-11-30T23:12:59.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.591+0000 7fc1601dc700 1 -- 172.21.15.73:0/1381225072 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc13c065ad0 msgr2=0x7fc13c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:59.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.591+0000 7fc1601dc700 1 --2- 172.21.15.73:0/1381225072 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc13c065ad0 0x7fc13c067f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc1580b1c70 tx=0x7fc148008030 comp rx=0 tx=0).stop 2023-11-30T23:12:59.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.591+0000 7fc1601dc700 1 -- 172.21.15.73:0/1381225072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc15806e4b0 msgr2=0x7fc158146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:59.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.591+0000 7fc1601dc700 1 --2- 172.21.15.73:0/1381225072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc15806e4b0 0x7fc158146490 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc15400c520 tx=0x7fc15400c830 comp rx=0 tx=0).stop 2023-11-30T23:12:59.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.591+0000 7fc1601dc700 1 -- 172.21.15.73:0/1381225072 shutdown_connections 2023-11-30T23:12:59.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.591+0000 7fc1601dc700 1 --2- 172.21.15.73:0/1381225072 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc15813e9e0 0x7fc1580ad790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.591+0000 7fc1601dc700 1 --2- 172.21.15.73:0/1381225072 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc13c065ad0 0x7fc13c067f90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.591+0000 7fc1601dc700 1 --2- 172.21.15.73:0/1381225072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc1580b1820 0x7fc1580b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.591+0000 7fc1601dc700 1 --2- 172.21.15.73:0/1381225072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc15806e4b0 0x7fc158146490 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.591+0000 7fc1601dc700 1 -- 172.21.15.73:0/1381225072 >> 172.21.15.73:0/1381225072 conn(0x7fc15806a180 msgr2=0x7fc15806aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:59.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.591+0000 7fc1601dc700 1 -- 172.21.15.73:0/1381225072 shutdown_connections 2023-11-30T23:12:59.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.591+0000 7fc1601dc700 1 -- 172.21.15.73:0/1381225072 wait complete. 2023-11-30T23:12:59.607 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T23:12:59.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f2427f53700 1 Processor -- start 2023-11-30T23:12:59.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f2427f53700 1 -- start start 2023-11-30T23:12:59.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f2427f53700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24200bca60 0x7f2420149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:59.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f2427f53700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f24200b4470 0x7f242014a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:59.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f2427f53700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2420140430 0x7f2420140880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:59.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f2427f53700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24200b6120 con 0x7f24200b4470 2023-11-30T23:12:59.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f2427f53700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24200b5eb0 con 0x7f2420140430 2023-11-30T23:12:59.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f2427f53700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24200bce40 con 0x7f24200bca60 2023-11-30T23:12:59.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f24254ee700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f24200b4470 0x7f242014a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:59.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f24254ee700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f24200b4470 0x7f242014a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38630/0 (socket says 172.21.15.73:38630) 2023-11-30T23:12:59.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f24254ee700 1 -- 172.21.15.73:0/3850702217 learned_addr learned my addr 172.21.15.73:0/3850702217 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:59.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f24264f0700 1 --2- 172.21.15.73:0/3850702217 >> v2:172.21.15.156:3300/0 conn(0x7f2420140430 0x7f2420140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:59.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f2425cef700 1 --2- 172.21.15.73:0/3850702217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24200bca60 0x7f2420149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:59.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f24254ee700 1 -- 172.21.15.73:0/3850702217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24200bca60 msgr2=0x7f2420149ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:59.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f24254ee700 1 --2- 172.21.15.73:0/3850702217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24200bca60 0x7f2420149ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f24254ee700 1 -- 172.21.15.73:0/3850702217 >> v2:172.21.15.156:3300/0 conn(0x7f2420140430 msgr2=0x7f2420140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:12:59.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f24254ee700 1 --2- 172.21.15.73:0/3850702217 >> v2:172.21.15.156:3300/0 conn(0x7f2420140430 0x7f2420140880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f24254ee700 1 -- 172.21.15.73:0/3850702217 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24200b4ba0 con 0x7f24200b4470 2023-11-30T23:12:59.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f24254ee700 1 --2- 172.21.15.73:0/3850702217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24200b4470 0x7f242014a430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2420074110 tx=0x7f241c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc13ca17fe25810c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:59.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f2424ced700 1 -- 172.21.15.73:0/3850702217 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c011830 con 0x7f24200b4470 2023-11-30T23:12:59.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f2424ced700 1 -- 172.21.15.73:0/3850702217 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c011990 con 0x7f24200b4470 2023-11-30T23:12:59.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.727+0000 7f2424ced700 1 -- 172.21.15.73:0/3850702217 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c011d20 con 0x7f24200b4470 2023-11-30T23:12:59.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2427f53700 1 -- 172.21.15.73:0/3850702217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24200b4470 msgr2=0x7f242014a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:59.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2427f53700 1 --2- 172.21.15.73:0/3850702217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24200b4470 0x7f242014a430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2420074110 tx=0x7f241c009bf0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2427f53700 1 -- 172.21.15.73:0/3850702217 shutdown_connections 2023-11-30T23:12:59.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2427f53700 1 --2- 172.21.15.73:0/3850702217 >> v2:172.21.15.156:3300/0 conn(0x7f2420140430 0x7f2420140880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2427f53700 1 --2- 172.21.15.73:0/3850702217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24200b4470 0x7f242014a430 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2427f53700 1 --2- 172.21.15.73:0/3850702217 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f24200bca60 0x7f2420149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2427f53700 1 -- 172.21.15.73:0/3850702217 >> 172.21.15.73:0/3850702217 conn(0x7f2420071fd0 msgr2=0x7f24200bc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:59.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2427f53700 1 -- 172.21.15.73:0/3850702217 shutdown_connections 2023-11-30T23:12:59.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2427f53700 1 -- 172.21.15.73:0/3850702217 wait complete. 2023-11-30T23:12:59.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2427f53700 1 Processor -- start 2023-11-30T23:12:59.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2427f53700 1 -- start start 2023-11-30T23:12:59.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2427f53700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24200b4470 0x7f24201439e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:59.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2427f53700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24200bca60 0x7f2420141840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:59.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2427f53700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2420140430 0x7f2420141d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:59.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2427f53700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24201dbe50 con 0x7f24200b4470 2023-11-30T23:12:59.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2427f53700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2420142d20 con 0x7f24200bca60 2023-11-30T23:12:59.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2427f53700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2420143250 con 0x7f2420140430 2023-11-30T23:12:59.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2425cef700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24200b4470 0x7f24201439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:59.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2425cef700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24200b4470 0x7f24201439e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38636/0 (socket says 172.21.15.73:38636) 2023-11-30T23:12:59.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2425cef700 1 -- 172.21.15.73:0/2713836504 learned_addr learned my addr 172.21.15.73:0/2713836504 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:12:59.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f24254ee700 1 --2- 172.21.15.73:0/2713836504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24200bca60 0x7f2420141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:59.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f24264f0700 1 --2- 172.21.15.73:0/2713836504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2420140430 0x7f2420141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:59.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2425cef700 1 -- 172.21.15.73:0/2713836504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2420140430 msgr2=0x7f2420141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:59.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2425cef700 1 --2- 172.21.15.73:0/2713836504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2420140430 0x7f2420141d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2425cef700 1 -- 172.21.15.73:0/2713836504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24200bca60 msgr2=0x7f2420141840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:59.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2425cef700 1 --2- 172.21.15.73:0/2713836504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24200bca60 0x7f2420141840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.731+0000 7f2425cef700 1 -- 172.21.15.73:0/2713836504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c009570 con 0x7f24200b4470 2023-11-30T23:12:59.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.735+0000 7f2425cef700 1 --2- 172.21.15.73:0/2713836504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24200b4470 0x7f24201439e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f241000e870 tx=0x7f241000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:59.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.735+0000 7f24167fc700 1 -- 172.21.15.73:0/2713836504 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24100095a0 con 0x7f24200b4470 2023-11-30T23:12:59.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.735+0000 7f24167fc700 1 -- 172.21.15.73:0/2713836504 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2410013680 con 0x7f24200b4470 2023-11-30T23:12:59.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.735+0000 7f2427f53700 1 -- 172.21.15.73:0/2713836504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2420146d90 con 0x7f24200b4470 2023-11-30T23:12:59.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.735+0000 7f24167fc700 1 -- 172.21.15.73:0/2713836504 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24100139f0 con 0x7f24200b4470 2023-11-30T23:12:59.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.735+0000 7f2427f53700 1 -- 172.21.15.73:0/2713836504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2420147350 con 0x7f24200b4470 2023-11-30T23:12:59.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.735+0000 7f2427f53700 1 -- 172.21.15.73:0/2713836504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2420140d40 con 0x7f24200b4470 2023-11-30T23:12:59.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.735+0000 7f24167fc700 1 -- 172.21.15.73:0/2713836504 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2410013b50 con 0x7f24200b4470 2023-11-30T23:12:59.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.735+0000 7f24167fc700 1 --2- 172.21.15.73:0/2713836504 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f2404065ad0 0x7f2404067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:12:59.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.735+0000 7f24167fc700 1 -- 172.21.15.73:0/2713836504 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2410082ee0 con 0x7f24200b4470 2023-11-30T23:12:59.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.735+0000 7f24254ee700 1 --2- 172.21.15.73:0/2713836504 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f2404065ad0 0x7f2404067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:12:59.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.739+0000 7f24254ee700 1 --2- 172.21.15.73:0/2713836504 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f2404065ad0 0x7f2404067f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f241c000c00 tx=0x7f241c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:12:59.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.743+0000 7f24167fc700 1 -- 172.21.15.73:0/2713836504 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f2410050930 con 0x7f24200b4470 2023-11-30T23:12:59.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.911+0000 7f2427f53700 1 -- 172.21.15.73:0/2713836504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f242004ed80 con 0x7f24200b4470 2023-11-30T23:12:59.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.911+0000 7f24167fc700 1 -- 172.21.15.73:0/2713836504 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2410053f50 con 0x7f24200b4470 2023-11-30T23:12:59.914 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-11-30T23:12:59.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.911+0000 7f2427f53700 1 -- 172.21.15.73:0/2713836504 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f2404065ad0 msgr2=0x7f2404067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:59.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.911+0000 7f2427f53700 1 --2- 172.21.15.73:0/2713836504 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f2404065ad0 0x7f2404067f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f241c000c00 tx=0x7f241c008030 comp rx=0 tx=0).stop 2023-11-30T23:12:59.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.911+0000 7f2427f53700 1 -- 172.21.15.73:0/2713836504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24200b4470 msgr2=0x7f24201439e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:12:59.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.911+0000 7f2427f53700 1 --2- 172.21.15.73:0/2713836504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24200b4470 0x7f24201439e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f241000e870 tx=0x7f241000eb80 comp rx=0 tx=0).stop 2023-11-30T23:12:59.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.911+0000 7f2427f53700 1 -- 172.21.15.73:0/2713836504 shutdown_connections 2023-11-30T23:12:59.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.911+0000 7f2427f53700 1 --2- 172.21.15.73:0/2713836504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f2420140430 0x7f2420141d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.911+0000 7f2427f53700 1 --2- 172.21.15.73:0/2713836504 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f2404065ad0 0x7f2404067f90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.911+0000 7f2427f53700 1 --2- 172.21.15.73:0/2713836504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24200bca60 0x7f2420141840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.911+0000 7f2427f53700 1 --2- 172.21.15.73:0/2713836504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24200b4470 0x7f24201439e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:12:59.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.911+0000 7f2427f53700 1 -- 172.21.15.73:0/2713836504 >> 172.21.15.73:0/2713836504 conn(0x7f2420071fd0 msgr2=0x7f2420147b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:12:59.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.911+0000 7f2427f53700 1 -- 172.21.15.73:0/2713836504 shutdown_connections 2023-11-30T23:12:59.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:12:59.911+0000 7f2427f53700 1 -- 172.21.15.73:0/2713836504 wait complete. 2023-11-30T23:12:59.929 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T23:13:00.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.051+0000 7f77a4fd0700 1 Processor -- start 2023-11-30T23:13:00.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.051+0000 7f77a4fd0700 1 -- start start 2023-11-30T23:13:00.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.051+0000 7f77a4fd0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a00afba0 0x7f77a013d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.051+0000 7f77a4fd0700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f77a013d8b0 0x7f77a014dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.051+0000 7f77a4fd0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a006f390 con 0x7f77a00b7de0 2023-11-30T23:13:00.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.051+0000 7f77a4fd0700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a0070e40 con 0x7f77a013d8b0 2023-11-30T23:13:00.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.051+0000 7f77a4fd0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a0147070 con 0x7f77a00afba0 2023-11-30T23:13:00.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.051+0000 7f779f7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f77a00b7de0 0x7f77a0146960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38278/0 (socket says 172.21.15.73:38278) 2023-11-30T23:13:00.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.051+0000 7f779f7fe700 1 -- 172.21.15.73:0/586336700 learned_addr learned my addr 172.21.15.73:0/586336700 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:13:00.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779effd700 1 --2- 172.21.15.73:0/586336700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a00afba0 0x7f77a013d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779ffff700 1 --2- 172.21.15.73:0/586336700 >> v2:172.21.15.156:3300/0 conn(0x7f77a013d8b0 0x7f77a014dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 -- 172.21.15.73:0/586336700 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783793793 0 0) 0x7f77a006f390 con 0x7f77a00b7de0 2023-11-30T23:13:00.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 -- 172.21.15.73:0/586336700 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77880035d0 con 0x7f77a00b7de0 2023-11-30T23:13:00.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 -- 172.21.15.73:0/586336700 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1723942143 0 0) 0x7f77880035d0 con 0x7f77a00b7de0 2023-11-30T23:13:00.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 -- 172.21.15.73:0/586336700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a00afba0 msgr2=0x7f77a013d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:13:00.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 --2- 172.21.15.73:0/586336700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a00afba0 0x7f77a013d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 -- 172.21.15.73:0/586336700 >> v2:172.21.15.156:3300/0 conn(0x7f77a013d8b0 msgr2=0x7f77a014dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:13:00.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 --2- 172.21.15.73:0/586336700 >> v2:172.21.15.156:3300/0 conn(0x7f77a013d8b0 0x7f77a014dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 -- 172.21.15.73:0/586336700 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a00b81c0 con 0x7f77a00b7de0 2023-11-30T23:13:00.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 -- 172.21.15.73:0/586336700 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3856460137 0 0) 0x7f7790001670 con 0x7f77a00b7de0 2023-11-30T23:13:00.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 -- 172.21.15.73:0/586336700 >> v1:172.21.15.73:6789/0 conn(0x7f77a00b7de0 legacy=0x7f77a0146960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 --2- 172.21.15.73:0/586336700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a00afba0 0x7f7788003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 --2- 172.21.15.73:0/586336700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7788003fa0 0x7f7788004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 --2- 172.21.15.73:0/586336700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7788004db0 0x7f7788005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 -- 172.21.15.73:0/586336700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a0147070 con 0x7f7788003fa0 2023-11-30T23:13:00.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 -- 172.21.15.73:0/586336700 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778800ba90 con 0x7f7788004db0 2023-11-30T23:13:00.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 -- 172.21.15.73:0/586336700 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778800de60 con 0x7f77a00afba0 2023-11-30T23:13:00.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779effd700 1 --2- 172.21.15.73:0/586336700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7788003fa0 0x7f7788004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779f7fe700 1 --2- 172.21.15.73:0/586336700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a00afba0 0x7f7788003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779ffff700 1 --2- 172.21.15.73:0/586336700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7788004db0 0x7f7788005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779effd700 1 -- 172.21.15.73:0/586336700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a00afba0 msgr2=0x7f7788003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:13:00.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779effd700 1 --2- 172.21.15.73:0/586336700 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a00afba0 0x7f7788003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779effd700 1 -- 172.21.15.73:0/586336700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7788004db0 msgr2=0x7f7788005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:13:00.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779effd700 1 --2- 172.21.15.73:0/586336700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7788004db0 0x7f7788005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779effd700 1 -- 172.21.15.73:0/586336700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77880035d0 con 0x7f7788003fa0 2023-11-30T23:13:00.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779effd700 1 --2- 172.21.15.73:0/586336700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7788003fa0 0x7f7788004870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7794009b40 tx=0x7f77880058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f45baf3b8d44edb server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:00.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 -- 172.21.15.73:0/586336700 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779400e6c0 con 0x7f7788003fa0 2023-11-30T23:13:00.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 -- 172.21.15.73:0/586336700 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779400e820 con 0x7f7788003fa0 2023-11-30T23:13:00.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779e7fc700 1 -- 172.21.15.73:0/586336700 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779400eb90 con 0x7f7788003fa0 2023-11-30T23:13:00.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f77a4fd0700 1 -- 172.21.15.73:0/586336700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7788003fa0 msgr2=0x7f7788004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f77a4fd0700 1 --2- 172.21.15.73:0/586336700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7788003fa0 0x7f7788004870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7794009b40 tx=0x7f77880058a0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f779ffff700 1 -- 172.21.15.73:0/586336700 reap_dead start 2023-11-30T23:13:00.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f77a4fd0700 1 -- 172.21.15.73:0/586336700 shutdown_connections 2023-11-30T23:13:00.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f77a4fd0700 1 -- 172.21.15.73:0/586336700 >> 172.21.15.73:0/586336700 conn(0x7f77a00b8c60 msgr2=0x7f77a00b9070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:13:00.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f77a4fd0700 1 -- 172.21.15.73:0/586336700 shutdown_connections 2023-11-30T23:13:00.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.055+0000 7f77a4fd0700 1 -- 172.21.15.73:0/586336700 wait complete. 2023-11-30T23:13:00.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f77a4fd0700 1 Processor -- start 2023-11-30T23:13:00.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f77a4fd0700 1 -- start start 2023-11-30T23:13:00.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f77a4fd0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7788003fa0 0x7f77a006bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f77a4fd0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77a013f970 0x7f77a01da970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f77a4fd0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a01daeb0 0x7f77a00b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f77a4fd0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a01408d0 con 0x7f77a013f970 2023-11-30T23:13:00.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f77a4fd0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00b05a0 con 0x7f7788003fa0 2023-11-30T23:13:00.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f77a4fd0700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a0141200 con 0x7f77a01daeb0 2023-11-30T23:13:00.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f779effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77a013f970 0x7f77a01da970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f779effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77a013f970 0x7f77a01da970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38648/0 (socket says 172.21.15.73:38648) 2023-11-30T23:13:00.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f779effd700 1 -- 172.21.15.73:0/3927823368 learned_addr learned my addr 172.21.15.73:0/3927823368 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:13:00.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f779ffff700 1 --2- 172.21.15.73:0/3927823368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a01daeb0 0x7f77a00b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f779f7fe700 1 --2- 172.21.15.73:0/3927823368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7788003fa0 0x7f77a006bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f779effd700 1 -- 172.21.15.73:0/3927823368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a01daeb0 msgr2=0x7f77a00b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f779effd700 1 --2- 172.21.15.73:0/3927823368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a01daeb0 0x7f77a00b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f779effd700 1 -- 172.21.15.73:0/3927823368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7788003fa0 msgr2=0x7f77a006bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f779effd700 1 --2- 172.21.15.73:0/3927823368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7788003fa0 0x7f77a006bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f779effd700 1 -- 172.21.15.73:0/3927823368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a0140210 con 0x7f77a013f970 2023-11-30T23:13:00.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f779effd700 1 --2- 172.21.15.73:0/3927823368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77a013f970 0x7f77a01da970 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f778800ba60 tx=0x7f77940047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:00.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f7787fff700 1 -- 172.21.15.73:0/3927823368 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779400e6c0 con 0x7f77a013f970 2023-11-30T23:13:00.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f7787fff700 1 -- 172.21.15.73:0/3927823368 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7794013e00 con 0x7f77a013f970 2023-11-30T23:13:00.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f77a4fd0700 1 -- 172.21.15.73:0/3927823368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a01404f0 con 0x7f77a013f970 2023-11-30T23:13:00.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f7787fff700 1 -- 172.21.15.73:0/3927823368 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794004270 con 0x7f77a013f970 2023-11-30T23:13:00.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.059+0000 7f77a4fd0700 1 -- 172.21.15.73:0/3927823368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a006c7b0 con 0x7f77a013f970 2023-11-30T23:13:00.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.063+0000 7f77a4fd0700 1 -- 172.21.15.73:0/3927823368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a006c9a0 con 0x7f77a013f970 2023-11-30T23:13:00.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.063+0000 7f7787fff700 1 -- 172.21.15.73:0/3927823368 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f77940043d0 con 0x7f77a013f970 2023-11-30T23:13:00.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.063+0000 7f7787fff700 1 --2- 172.21.15.73:0/3927823368 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f778c065ad0 0x7f778c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.063+0000 7f779f7fe700 1 --2- 172.21.15.73:0/3927823368 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f778c065ad0 0x7f778c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.063+0000 7f7787fff700 1 -- 172.21.15.73:0/3927823368 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77940849d0 con 0x7f77a013f970 2023-11-30T23:13:00.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.063+0000 7f779f7fe700 1 --2- 172.21.15.73:0/3927823368 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f778c065ad0 0x7f778c067f90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7790000c00 tx=0x7f7790009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:00.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.067+0000 7f7787fff700 1 -- 172.21.15.73:0/3927823368 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f77940524c0 con 0x7f77a013f970 2023-11-30T23:13:00.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.227+0000 7f77a4fd0700 1 -- 172.21.15.73:0/3927823368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77a0140ed0 con 0x7f77a013f970 2023-11-30T23:13:00.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.227+0000 7f7787fff700 1 -- 172.21.15.73:0/3927823368 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7794055ae0 con 0x7f77a013f970 2023-11-30T23:13:00.232 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-11-30T23:13:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.231+0000 7f77a4fd0700 1 -- 172.21.15.73:0/3927823368 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f778c065ad0 msgr2=0x7f778c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.231+0000 7f77a4fd0700 1 --2- 172.21.15.73:0/3927823368 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f778c065ad0 0x7f778c067f90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7790000c00 tx=0x7f7790009040 comp rx=0 tx=0).stop 2023-11-30T23:13:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.231+0000 7f77a4fd0700 1 -- 172.21.15.73:0/3927823368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77a013f970 msgr2=0x7f77a01da970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.231+0000 7f77a4fd0700 1 --2- 172.21.15.73:0/3927823368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77a013f970 0x7f77a01da970 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f778800ba60 tx=0x7f77940047e0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.231+0000 7f77a4fd0700 1 -- 172.21.15.73:0/3927823368 shutdown_connections 2023-11-30T23:13:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.231+0000 7f77a4fd0700 1 --2- 172.21.15.73:0/3927823368 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f77a01daeb0 0x7f77a00b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.231+0000 7f77a4fd0700 1 --2- 172.21.15.73:0/3927823368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77a013f970 0x7f77a01da970 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.231+0000 7f77a4fd0700 1 --2- 172.21.15.73:0/3927823368 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f778c065ad0 0x7f778c067f90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.231+0000 7f77a4fd0700 1 --2- 172.21.15.73:0/3927823368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7788003fa0 0x7f77a006bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.231+0000 7f77a4fd0700 1 -- 172.21.15.73:0/3927823368 >> 172.21.15.73:0/3927823368 conn(0x7f77a00b8c60 msgr2=0x7f77a013a660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:13:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.231+0000 7f77a4fd0700 1 -- 172.21.15.73:0/3927823368 shutdown_connections 2023-11-30T23:13:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.231+0000 7f77a4fd0700 1 -- 172.21.15.73:0/3927823368 wait complete. 2023-11-30T23:13:00.247 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T23:13:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.347+0000 7fcca6ba5700 1 Processor -- start 2023-11-30T23:13:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.347+0000 7fcca6ba5700 1 -- start start 2023-11-30T23:13:00.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.347+0000 7fcca6ba5700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcca00b4dc0 0x7fcca01405e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.347+0000 7fcca6ba5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcca0140b20 0x7fcca0151050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.347+0000 7fcca6ba5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca006a590 con 0x7fcca006f420 2023-11-30T23:13:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.347+0000 7fcca6ba5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca006f800 con 0x7fcca0140b20 2023-11-30T23:13:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.347+0000 7fcca6ba5700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca006a220 con 0x7fcca00b4dc0 2023-11-30T23:13:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.347+0000 7fcca63a4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcca0140b20 0x7fcca0151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.347+0000 7fcca63a4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcca0140b20 0x7fcca0151050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38660/0 (socket says 172.21.15.73:38660) 2023-11-30T23:13:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.347+0000 7fcca63a4700 1 -- 172.21.15.73:0/1842563670 learned_addr learned my addr 172.21.15.73:0/1842563670 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:13:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.347+0000 7fcca5ba3700 1 --1- 172.21.15.73:0/1842563670 >> v1:172.21.15.73:6789/0 conn(0x7fcca006f420 0x7fcca0146790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38290/0 (socket says 172.21.15.73:38290) 2023-11-30T23:13:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.347+0000 7fcca53a2700 1 --2- 172.21.15.73:0/1842563670 >> v2:172.21.15.156:3300/0 conn(0x7fcca00b4dc0 0x7fcca01405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.347+0000 7fcca63a4700 1 -- 172.21.15.73:0/1842563670 >> v2:172.21.15.156:3300/0 conn(0x7fcca00b4dc0 msgr2=0x7fcca01405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:13:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.347+0000 7fcca63a4700 1 --2- 172.21.15.73:0/1842563670 >> v2:172.21.15.156:3300/0 conn(0x7fcca00b4dc0 0x7fcca01405e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.347+0000 7fcca63a4700 1 -- 172.21.15.73:0/1842563670 >> v1:172.21.15.73:6789/0 conn(0x7fcca006f420 legacy=0x7fcca0146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.347+0000 7fcca63a4700 1 -- 172.21.15.73:0/1842563670 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca006afc0 con 0x7fcca0140b20 2023-11-30T23:13:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.347+0000 7fcca53a2700 1 --2- 172.21.15.73:0/1842563670 >> v2:172.21.15.156:3300/0 conn(0x7fcca00b4dc0 0x7fcca01405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-30T23:13:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.351+0000 7fcca63a4700 1 --2- 172.21.15.73:0/1842563670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca0140b20 0x7fcca0151050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcca00b67d0 tx=0x7fcc9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2512bec75484e server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.351+0000 7fcca4ba1700 1 -- 172.21.15.73:0/1842563670 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9800e070 con 0x7fcca0140b20 2023-11-30T23:13:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.351+0000 7fcca4ba1700 1 -- 172.21.15.73:0/1842563670 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9800b9c0 con 0x7fcca0140b20 2023-11-30T23:13:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.351+0000 7fcca4ba1700 1 -- 172.21.15.73:0/1842563670 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9800bd70 con 0x7fcca0140b20 2023-11-30T23:13:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.351+0000 7fcca6ba5700 1 -- 172.21.15.73:0/1842563670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca0140b20 msgr2=0x7fcca0151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.351+0000 7fcca6ba5700 1 --2- 172.21.15.73:0/1842563670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca0140b20 0x7fcca0151050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcca00b67d0 tx=0x7fcc9800b330 comp rx=0 tx=0).stop 2023-11-30T23:13:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.351+0000 7fcca6ba5700 1 -- 172.21.15.73:0/1842563670 shutdown_connections 2023-11-30T23:13:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.351+0000 7fcca6ba5700 1 --2- 172.21.15.73:0/1842563670 >> v2:172.21.15.156:3300/0 conn(0x7fcca00b4dc0 0x7fcca01405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.351+0000 7fcca6ba5700 1 --2- 172.21.15.73:0/1842563670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca0140b20 0x7fcca0151050 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.351+0000 7fcca6ba5700 1 -- 172.21.15.73:0/1842563670 >> 172.21.15.73:0/1842563670 conn(0x7fcca006b290 msgr2=0x7fcca006b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:13:00.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.351+0000 7fcca6ba5700 1 -- 172.21.15.73:0/1842563670 shutdown_connections 2023-11-30T23:13:00.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.351+0000 7fcca6ba5700 1 -- 172.21.15.73:0/1842563670 wait complete. 2023-11-30T23:13:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.351+0000 7fcca6ba5700 1 Processor -- start 2023-11-30T23:13:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.351+0000 7fcca6ba5700 1 -- start start 2023-11-30T23:13:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.351+0000 7fcca6ba5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca006f420 0x7fcca00ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.351+0000 7fcca6ba5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca00b4dc0 0x7fcca00afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca6ba5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcca0140b20 0x7fcca00b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca6ba5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca0147ef0 con 0x7fcca00b4dc0 2023-11-30T23:13:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca6ba5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00b2310 con 0x7fcca006f420 2023-11-30T23:13:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca6ba5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00b2580 con 0x7fcca0140b20 2023-11-30T23:13:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca53a2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca00b4dc0 0x7fcca00afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca53a2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca00b4dc0 0x7fcca00afd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38668/0 (socket says 172.21.15.73:38668) 2023-11-30T23:13:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca53a2700 1 -- 172.21.15.73:0/431929928 learned_addr learned my addr 172.21.15.73:0/431929928 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:13:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca5ba3700 1 --2- 172.21.15.73:0/431929928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca006f420 0x7fcca00ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca63a4700 1 --2- 172.21.15.73:0/431929928 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcca0140b20 0x7fcca00b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca53a2700 1 -- 172.21.15.73:0/431929928 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcca0140b20 msgr2=0x7fcca00b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca53a2700 1 --2- 172.21.15.73:0/431929928 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcca0140b20 0x7fcca00b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca53a2700 1 -- 172.21.15.73:0/431929928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca006f420 msgr2=0x7fcca00ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca53a2700 1 --2- 172.21.15.73:0/431929928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca006f420 0x7fcca00ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca53a2700 1 -- 172.21.15.73:0/431929928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc98009b30 con 0x7fcca00b4dc0 2023-11-30T23:13:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca5ba3700 1 --2- 172.21.15.73:0/431929928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca006f420 0x7fcca00ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-30T23:13:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca63a4700 1 --2- 172.21.15.73:0/431929928 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcca0140b20 0x7fcca00b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-30T23:13:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca53a2700 1 --2- 172.21.15.73:0/431929928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca00b4dc0 0x7fcca00afd30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000c7f0 tx=0x7fcc9000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcc967fc700 1 -- 172.21.15.73:0/431929928 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90004220 con 0x7fcca00b4dc0 2023-11-30T23:13:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcc967fc700 1 -- 172.21.15.73:0/431929928 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc90004380 con 0x7fcca00b4dc0 2023-11-30T23:13:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca6ba5700 1 -- 172.21.15.73:0/431929928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca00b2860 con 0x7fcca00b4dc0 2023-11-30T23:13:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcc967fc700 1 -- 172.21.15.73:0/431929928 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc900036c0 con 0x7fcca00b4dc0 2023-11-30T23:13:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca6ba5700 1 -- 172.21.15.73:0/431929928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca01478f0 con 0x7fcca00b4dc0 2023-11-30T23:13:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcca6ba5700 1 -- 172.21.15.73:0/431929928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca00b29f0 con 0x7fcca00b4dc0 2023-11-30T23:13:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.355+0000 7fcc967fc700 1 -- 172.21.15.73:0/431929928 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcc90003820 con 0x7fcca00b4dc0 2023-11-30T23:13:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.359+0000 7fcc967fc700 1 --2- 172.21.15.73:0/431929928 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fcc84065ad0 0x7fcc84067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.359+0000 7fcc967fc700 1 -- 172.21.15.73:0/431929928 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc90082db0 con 0x7fcca00b4dc0 2023-11-30T23:13:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.359+0000 7fcca5ba3700 1 --2- 172.21.15.73:0/431929928 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fcc84065ad0 0x7fcc84067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.359+0000 7fcca5ba3700 1 --2- 172.21.15.73:0/431929928 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fcc84065ad0 0x7fcc84067f90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c000f60 tx=0x7fcc9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.363+0000 7fcc967fc700 1 -- 172.21.15.73:0/431929928 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fcc90050780 con 0x7fcca00b4dc0 2023-11-30T23:13:00.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.555+0000 7fcca6ba5700 1 -- 172.21.15.73:0/431929928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcca004ed80 con 0x7fcca00b4dc0 2023-11-30T23:13:00.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.559+0000 7fcc967fc700 1 -- 172.21.15.73:0/431929928 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3133 (secure 0 0 0) 0x7fcc9001ec50 con 0x7fcca00b4dc0 2023-11-30T23:13:00.562 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:13:00.563 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3213239947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3213239947},{"type":"v1","addr":"172.21.15.73:6835","nonce":3213239947}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T23:12:47.481180+0000","modified":"2023-11-30T23:12:50.126014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6833/1140380051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":1140380051},{"type":"v1","addr":"172.21.15.156:6833","nonce":1140380051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-30T23:13:00.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.559+0000 7fcca6ba5700 1 -- 172.21.15.73:0/431929928 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fcc84065ad0 msgr2=0x7fcc84067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.559+0000 7fcca6ba5700 1 --2- 172.21.15.73:0/431929928 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fcc84065ad0 0x7fcc84067f90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c000f60 tx=0x7fcc9c009040 comp rx=0 tx=0).stop 2023-11-30T23:13:00.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.559+0000 7fcca6ba5700 1 -- 172.21.15.73:0/431929928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca00b4dc0 msgr2=0x7fcca00afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.559+0000 7fcca6ba5700 1 --2- 172.21.15.73:0/431929928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca00b4dc0 0x7fcca00afd30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000c7f0 tx=0x7fcc9000cbb0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.559+0000 7fcca6ba5700 1 -- 172.21.15.73:0/431929928 shutdown_connections 2023-11-30T23:13:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.559+0000 7fcca6ba5700 1 --2- 172.21.15.73:0/431929928 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fcca0140b20 0x7fcca00b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.559+0000 7fcca6ba5700 1 --2- 172.21.15.73:0/431929928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcca00b4dc0 0x7fcca00afd30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.559+0000 7fcca6ba5700 1 --2- 172.21.15.73:0/431929928 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fcc84065ad0 0x7fcc84067f90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.559+0000 7fcca6ba5700 1 --2- 172.21.15.73:0/431929928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca006f420 0x7fcca00ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.559+0000 7fcca6ba5700 1 -- 172.21.15.73:0/431929928 >> 172.21.15.73:0/431929928 conn(0x7fcca006b290 msgr2=0x7fcca006bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:13:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.559+0000 7fcca6ba5700 1 -- 172.21.15.73:0/431929928 shutdown_connections 2023-11-30T23:13:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.559+0000 7fcca6ba5700 1 -- 172.21.15.73:0/431929928 wait complete. 2023-11-30T23:13:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 7 2023-11-30T23:13:00.581 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T23:13:00.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.687+0000 7f88a886b700 1 Processor -- start 2023-11-30T23:13:00.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.687+0000 7f88a886b700 1 -- start start 2023-11-30T23:13:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.687+0000 7f88a886b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88a40b3f10 0x7f88a4147090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.687+0000 7f88a886b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f88a40b4ee0 0x7f88a4149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.687+0000 7f88a886b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a41475d0 con 0x7f88a40b6910 2023-11-30T23:13:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.687+0000 7f88a886b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a40b5e70 con 0x7f88a40b4ee0 2023-11-30T23:13:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.687+0000 7f88a886b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40b5c00 con 0x7f88a40b3f10 2023-11-30T23:13:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.687+0000 7f889a59c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f88a40b4ee0 0x7f88a4149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.687+0000 7f889a59c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f88a40b4ee0 0x7f88a4149ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38674/0 (socket says 172.21.15.73:38674) 2023-11-30T23:13:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.687+0000 7f889a59c700 1 -- 172.21.15.73:0/3657596270 learned_addr learned my addr 172.21.15.73:0/3657596270 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:13:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.687+0000 7f88a2d9d700 1 --2- 172.21.15.73:0/3657596270 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88a40b3f10 0x7f88a4147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.687+0000 7f889a59c700 1 -- 172.21.15.73:0/3657596270 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88a40b3f10 msgr2=0x7f88a4147090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:13:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.687+0000 7f889a59c700 1 --2- 172.21.15.73:0/3657596270 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88a40b3f10 0x7f88a4147090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.687+0000 7f889a59c700 1 -- 172.21.15.73:0/3657596270 >> v1:172.21.15.73:6789/0 conn(0x7f88a40b6910 legacy=0x7f88a414a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.687+0000 7f889a59c700 1 -- 172.21.15.73:0/3657596270 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a40b42f0 con 0x7f88a40b4ee0 2023-11-30T23:13:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.687+0000 7f889a59c700 1 --2- 172.21.15.73:0/3657596270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88a40b4ee0 0x7f88a4149ba0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f888c009910 tx=0x7f888c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54a2f695db8c07 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a259c700 1 -- 172.21.15.73:0/3657596270 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c00ba60 con 0x7f88a40b4ee0 2023-11-30T23:13:00.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a259c700 1 -- 172.21.15.73:0/3657596270 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c00bbc0 con 0x7f88a40b4ee0 2023-11-30T23:13:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a259c700 1 -- 172.21.15.73:0/3657596270 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c009e60 con 0x7f88a40b4ee0 2023-11-30T23:13:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a886b700 1 -- 172.21.15.73:0/3657596270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88a40b4ee0 msgr2=0x7f88a4149ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a886b700 1 --2- 172.21.15.73:0/3657596270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88a40b4ee0 0x7f88a4149ba0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f888c009910 tx=0x7f888c009c20 comp rx=0 tx=0).stop 2023-11-30T23:13:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a886b700 1 -- 172.21.15.73:0/3657596270 shutdown_connections 2023-11-30T23:13:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a886b700 1 --2- 172.21.15.73:0/3657596270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88a40b4ee0 0x7f88a4149ba0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a886b700 1 --2- 172.21.15.73:0/3657596270 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88a40b3f10 0x7f88a4147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a886b700 1 -- 172.21.15.73:0/3657596270 >> 172.21.15.73:0/3657596270 conn(0x7f88a40b8a10 msgr2=0x7f88a40b8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:13:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a886b700 1 -- 172.21.15.73:0/3657596270 shutdown_connections 2023-11-30T23:13:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a886b700 1 -- 172.21.15.73:0/3657596270 wait complete. 2023-11-30T23:13:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a886b700 1 Processor -- start 2023-11-30T23:13:00.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a886b700 1 -- start start 2023-11-30T23:13:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a886b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88a40b3f10 0x7f88a4143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a886b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88a40b4ee0 0x7f88a41ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a886b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88a40b6910 0x7f88a41ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a886b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a41d0e40 con 0x7f88a40b3f10 2023-11-30T23:13:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a886b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a41d00c0 con 0x7f88a40b6910 2023-11-30T23:13:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a886b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a41d1370 con 0x7f88a40b4ee0 2023-11-30T23:13:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a2d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88a40b3f10 0x7f88a4143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a2d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88a40b3f10 0x7f88a4143440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38688/0 (socket says 172.21.15.73:38688) 2023-11-30T23:13:00.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a2d9d700 1 -- 172.21.15.73:0/1066544586 learned_addr learned my addr 172.21.15.73:0/1066544586 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:13:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f889a59c700 1 --2- 172.21.15.73:0/1066544586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88a40b4ee0 0x7f88a41ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a359e700 1 --2- 172.21.15.73:0/1066544586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88a40b6910 0x7f88a41ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a2d9d700 1 -- 172.21.15.73:0/1066544586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88a40b4ee0 msgr2=0x7f88a41ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a2d9d700 1 --2- 172.21.15.73:0/1066544586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88a40b4ee0 0x7f88a41ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a2d9d700 1 -- 172.21.15.73:0/1066544586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88a40b6910 msgr2=0x7f88a41ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a2d9d700 1 --2- 172.21.15.73:0/1066544586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88a40b6910 0x7f88a41ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a2d9d700 1 -- 172.21.15.73:0/1066544586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c009570 con 0x7f88a40b3f10 2023-11-30T23:13:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a359e700 1 --2- 172.21.15.73:0/1066544586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88a40b6910 0x7f88a41ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-30T23:13:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a2d9d700 1 --2- 172.21.15.73:0/1066544586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88a40b3f10 0x7f88a4143440 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f889400e790 tx=0x7f889400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f889bfff700 1 -- 172.21.15.73:0/1066544586 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894013610 con 0x7f88a40b3f10 2023-11-30T23:13:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f889bfff700 1 -- 172.21.15.73:0/1066544586 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8894013770 con 0x7f88a40b3f10 2023-11-30T23:13:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a886b700 1 -- 172.21.15.73:0/1066544586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a41cfa70 con 0x7f88a40b3f10 2023-11-30T23:13:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f889bfff700 1 -- 172.21.15.73:0/1066544586 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894013ae0 con 0x7f88a40b3f10 2023-11-30T23:13:00.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.691+0000 7f88a886b700 1 -- 172.21.15.73:0/1066544586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a41d1090 con 0x7f88a40b3f10 2023-11-30T23:13:00.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.695+0000 7f88a886b700 1 -- 172.21.15.73:0/1066544586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a404ed80 con 0x7f88a40b3f10 2023-11-30T23:13:00.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.695+0000 7f889bfff700 1 -- 172.21.15.73:0/1066544586 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8894013c40 con 0x7f88a40b3f10 2023-11-30T23:13:00.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.695+0000 7f889bfff700 1 --2- 172.21.15.73:0/1066544586 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8884065ad0 0x7f8884067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.695+0000 7f889bfff700 1 -- 172.21.15.73:0/1066544586 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8894082e30 con 0x7f88a40b3f10 2023-11-30T23:13:00.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.695+0000 7f889a59c700 1 --2- 172.21.15.73:0/1066544586 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8884065ad0 0x7f8884067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.695+0000 7f889a59c700 1 --2- 172.21.15.73:0/1066544586 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8884065ad0 0x7f8884067f90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f88a40b52c0 tx=0x7f888c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:00.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.699+0000 7f889bfff700 1 -- 172.21.15.73:0/1066544586 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f8894050800 con 0x7f88a40b3f10 2023-11-30T23:13:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.855+0000 7f88a886b700 1 -- 172.21.15.73:0/1066544586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88a40681c0 con 0x7f88a40b3f10 2023-11-30T23:13:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.855+0000 7f889bfff700 1 -- 172.21.15.73:0/1066544586 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f8894053e20 con 0x7f88a40b3f10 2023-11-30T23:13:00.861 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:13:00.861 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"a677cb6a-4a54-4567-a30d-f0fa4bc22b17","created":"2023-11-30T23:12:23.260968+0000","modified":"2023-11-30T23:12:48.484283+0000","last_up_change":"2023-11-30T23:12:33.649318+0000","last_in_change":"2023-11-30T23:12:25.326689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-30T23:12:34.413317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-30T23:12:45.403156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-30T23:12:46.475384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbf1c93f-0775-4780-8524-cf25792d9aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36686},{"type":"v1","addr":"172.21.15.73:6817","nonce":36686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36686},{"type":"v1","addr":"172.21.15.73:6819","nonce":36686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36686},{"type":"v1","addr":"172.21.15.73:6823","nonce":36686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36686},{"type":"v1","addr":"172.21.15.73:6821","nonce":36686}]},"public_addr":"172.21.15.73:6817/36686","cluster_addr":"172.21.15.73:6819/36686","heartbeat_back_addr":"172.21.15.73:6823/36686","heartbeat_front_addr":"172.21.15.73:6821/36686","state":["exists","up"]},{"osd":1,"uuid":"9d9dd122-9a42-4588-a0d2-50d13b13eba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36687},{"type":"v1","addr":"172.21.15.73:6809","nonce":36687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":36687},{"type":"v1","addr":"172.21.15.73:6811","nonce":36687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36687},{"type":"v1","addr":"172.21.15.73:6815","nonce":36687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36687},{"type":"v1","addr":"172.21.15.73:6813","nonce":36687}]},"public_addr":"172.21.15.73:6809/36687","cluster_addr":"172.21.15.73:6811/36687","heartbeat_back_addr":"172.21.15.73:6815/36687","heartbeat_front_addr":"172.21.15.73:6813/36687","state":["exists","up"]},{"osd":2,"uuid":"68ff4f1e-ec45-42e0-bb83-fe03598e4940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36688},{"type":"v1","addr":"172.21.15.73:6825","nonce":36688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36688},{"type":"v1","addr":"172.21.15.73:6827","nonce":36688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36688},{"type":"v1","addr":"172.21.15.73:6831","nonce":36688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36688},{"type":"v1","addr":"172.21.15.73:6829","nonce":36688}]},"public_addr":"172.21.15.73:6825/36688","cluster_addr":"172.21.15.73:6827/36688","heartbeat_back_addr":"172.21.15.73:6831/36688","heartbeat_front_addr":"172.21.15.73:6829/36688","state":["exists","up"]},{"osd":3,"uuid":"e4b08c98-6a4d-4ec8-a245-59a35f70a16f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36685},{"type":"v1","addr":"172.21.15.73:6801","nonce":36685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36685},{"type":"v1","addr":"172.21.15.73:6803","nonce":36685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":36685},{"type":"v1","addr":"172.21.15.73:6807","nonce":36685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36685},{"type":"v1","addr":"172.21.15.73:6805","nonce":36685}]},"public_addr":"172.21.15.73:6801/36685","cluster_addr":"172.21.15.73:6803/36685","heartbeat_back_addr":"172.21.15.73:6807/36685","heartbeat_front_addr":"172.21.15.73:6805/36685","state":["exists","up"]},{"osd":4,"uuid":"d0922b0e-5170-474d-b270-ddb5adc858cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":36908},{"type":"v1","addr":"172.21.15.156:6801","nonce":36908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":36908},{"type":"v1","addr":"172.21.15.156:6803","nonce":36908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":36908},{"type":"v1","addr":"172.21.15.156:6807","nonce":36908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":36908},{"type":"v1","addr":"172.21.15.156:6805","nonce":36908}]},"public_addr":"172.21.15.156:6801/36908","cluster_addr":"172.21.15.156:6803/36908","heartbeat_back_addr":"172.21.15.156:6807/36908","heartbeat_front_addr":"172.21.15.156:6805/36908","state":["exists","up"]},{"osd":5,"uuid":"f2791a77-db25-479c-95d5-ea7f77458685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":36909},{"type":"v1","addr":"172.21.15.156:6809","nonce":36909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":36909},{"type":"v1","addr":"172.21.15.156:6811","nonce":36909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":36909},{"type":"v1","addr":"172.21.15.156:6815","nonce":36909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":36909},{"type":"v1","addr":"172.21.15.156:6813","nonce":36909}]},"public_addr":"172.21.15.156:6809/36909","cluster_addr":"172.21.15.156:6811/36909","heartbeat_back_addr":"172.21.15.156:6815/36909","heartbeat_front_addr":"172.21.15.156:6813/36909","state":["exists","up"]},{"osd":6,"uuid":"f86c2fe9-ec8b-406e-af26-5dc65c926382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":36910},{"type":"v1","addr":"172.21.15.156:6817","nonce":36910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":36910},{"type":"v1","addr":"172.21.15.156:6819","nonce":36910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":36910},{"type":"v1","addr":"172.21.15.156:6823","nonce":36910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":36910},{"type":"v1","addr":"172.21.15.156:6821","nonce":36910}]},"public_addr":"172.21.15.156:6817/36910","cluster_addr":"172.21.15.156:6819/36910","heartbeat_back_addr":"172.21.15.156:6823/36910","heartbeat_front_addr":"172.21.15.156:6821/36910","state":["exists","up"]},{"osd":7,"uuid":"56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":36911},{"type":"v1","addr":"172.21.15.156:6825","nonce":36911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":36911},{"type":"v1","addr":"172.21.15.156:6827","nonce":36911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":36911},{"type":"v1","addr":"172.21.15.156:6831","nonce":36911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":36911},{"type":"v1","addr":"172.21.15.156:6829","nonce":36911}]},"public_addr":"172.21.15.156:6825/36911","cluster_addr":"172.21.15.156:6827/36911","heartbeat_back_addr":"172.21.15.156:6831/36911","heartbeat_front_addr":"172.21.15.156:6829/36911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.597534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.505493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.811871+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.586741+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.366817+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.101605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.627496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.829046+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T23:13:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.859+0000 7f88a886b700 1 -- 172.21.15.73:0/1066544586 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8884065ad0 msgr2=0x7f8884067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.859+0000 7f88a886b700 1 --2- 172.21.15.73:0/1066544586 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8884065ad0 0x7f8884067f90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f88a40b52c0 tx=0x7f888c008030 comp rx=0 tx=0).stop 2023-11-30T23:13:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.859+0000 7f88a886b700 1 -- 172.21.15.73:0/1066544586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88a40b3f10 msgr2=0x7f88a4143440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.859+0000 7f88a886b700 1 --2- 172.21.15.73:0/1066544586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88a40b3f10 0x7f88a4143440 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f889400e790 tx=0x7f889400eb50 comp rx=0 tx=0).stop 2023-11-30T23:13:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.859+0000 7f88a886b700 1 -- 172.21.15.73:0/1066544586 shutdown_connections 2023-11-30T23:13:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.859+0000 7f88a886b700 1 --2- 172.21.15.73:0/1066544586 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8884065ad0 0x7f8884067f90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.859+0000 7f88a886b700 1 --2- 172.21.15.73:0/1066544586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f88a40b6910 0x7f88a41ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.859+0000 7f88a886b700 1 --2- 172.21.15.73:0/1066544586 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88a40b4ee0 0x7f88a41ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.859+0000 7f88a886b700 1 --2- 172.21.15.73:0/1066544586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88a40b3f10 0x7f88a4143440 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.859+0000 7f88a886b700 1 -- 172.21.15.73:0/1066544586 >> 172.21.15.73:0/1066544586 conn(0x7f88a40b8a10 msgr2=0x7f88a40b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:13:00.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.859+0000 7f88a886b700 1 -- 172.21.15.73:0/1066544586 shutdown_connections 2023-11-30T23:13:00.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.859+0000 7f88a886b700 1 -- 172.21.15.73:0/1066544586 wait complete. 2023-11-30T23:13:00.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T23:13:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.975+0000 7fdd0ffff700 1 Processor -- start 2023-11-30T23:13:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.975+0000 7fdd0ffff700 1 -- start start 2023-11-30T23:13:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.975+0000 7fdd0ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdd100b2710 0x7fdd100aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.975+0000 7fdd0ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd1013d070 0x7fdd1013d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.975+0000 7fdd0ffff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1006f210 con 0x7fdd10146990 2023-11-30T23:13:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.975+0000 7fdd0ffff700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd100afe30 con 0x7fdd100b2710 2023-11-30T23:13:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.975+0000 7fdd0ffff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd100af4e0 con 0x7fdd1013d070 2023-11-30T23:13:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0e7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd1013d070 0x7fdd1013d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0effd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdd100b2710 0x7fdd100aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0e7fc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd1013d070 0x7fdd1013d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:43548/0 (socket says 172.21.15.73:43548) 2023-11-30T23:13:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0effd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdd100b2710 0x7fdd100aefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:59864/0 (socket says 172.21.15.73:59864) 2023-11-30T23:13:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0e7fc700 1 -- 172.21.15.73:0/3757451497 learned_addr learned my addr 172.21.15.73:0/3757451497 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:13:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0e7fc700 1 -- 172.21.15.73:0/3757451497 >> v2:172.21.15.156:3300/0 conn(0x7fdd100b2710 msgr2=0x7fdd100aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:13:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0e7fc700 1 --2- 172.21.15.73:0/3757451497 >> v2:172.21.15.156:3300/0 conn(0x7fdd100b2710 0x7fdd100aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0e7fc700 1 -- 172.21.15.73:0/3757451497 >> v1:172.21.15.156:6789/0 conn(0x7fdd10146990 legacy=0x7fdd10146e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0e7fc700 1 -- 172.21.15.73:0/3757451497 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd100b2af0 con 0x7fdd1013d070 2023-11-30T23:13:00.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0e7fc700 1 --2- 172.21.15.73:0/3757451497 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd1013d070 0x7fdd1013d4d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdd00009910 tx=0x7fdd00009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d621df99bb39dca7 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:00.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0dffb700 1 -- 172.21.15.73:0/3757451497 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00011830 con 0x7fdd1013d070 2023-11-30T23:13:00.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0dffb700 1 -- 172.21.15.73:0/3757451497 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd00011990 con 0x7fdd1013d070 2023-11-30T23:13:00.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0dffb700 1 -- 172.21.15.73:0/3757451497 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00011d40 con 0x7fdd1013d070 2023-11-30T23:13:00.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0ffff700 1 -- 172.21.15.73:0/3757451497 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd1013d070 msgr2=0x7fdd1013d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0ffff700 1 --2- 172.21.15.73:0/3757451497 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd1013d070 0x7fdd1013d4d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdd00009910 tx=0x7fdd00009c20 comp rx=0 tx=0).stop 2023-11-30T23:13:00.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0ffff700 1 -- 172.21.15.73:0/3757451497 shutdown_connections 2023-11-30T23:13:00.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0ffff700 1 --2- 172.21.15.73:0/3757451497 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd1013d070 0x7fdd1013d4d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0ffff700 1 --2- 172.21.15.73:0/3757451497 >> v2:172.21.15.156:3300/0 conn(0x7fdd100b2710 0x7fdd100aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0ffff700 1 -- 172.21.15.73:0/3757451497 >> 172.21.15.73:0/3757451497 conn(0x7fdd100b45a0 msgr2=0x7fdd100b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:13:00.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0ffff700 1 -- 172.21.15.73:0/3757451497 shutdown_connections 2023-11-30T23:13:00.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.979+0000 7fdd0ffff700 1 -- 172.21.15.73:0/3757451497 wait complete. 2023-11-30T23:13:00.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.983+0000 7fdd0ffff700 1 Processor -- start 2023-11-30T23:13:00.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.983+0000 7fdd0ffff700 1 -- start start 2023-11-30T23:13:00.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.983+0000 7fdd0ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd100b2710 0x7fdd100b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.983+0000 7fdd0ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd1013d070 0x7fdd100b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.983+0000 7fdd0ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd10146990 0x7fdd100b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.983+0000 7fdd0ffff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd100723f0 con 0x7fdd100b2710 2023-11-30T23:13:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.983+0000 7fdd0ffff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd100b5a60 con 0x7fdd10146990 2023-11-30T23:13:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.983+0000 7fdd0ffff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd100b7880 con 0x7fdd1013d070 2023-11-30T23:13:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.983+0000 7fdd0effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd100b2710 0x7fdd100b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.983+0000 7fdd0effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd100b2710 0x7fdd100b82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38690/0 (socket says 172.21.15.73:38690) 2023-11-30T23:13:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.983+0000 7fdd0effd700 1 -- 172.21.15.73:0/3723001504 learned_addr learned my addr 172.21.15.73:0/3723001504 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:13:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.983+0000 7fdd0e7fc700 1 --2- 172.21.15.73:0/3723001504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd1013d070 0x7fdd100b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.983+0000 7fdd0f7fe700 1 --2- 172.21.15.73:0/3723001504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd10146990 0x7fdd100b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.983+0000 7fdd0effd700 1 -- 172.21.15.73:0/3723001504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd1013d070 msgr2=0x7fdd100b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.983+0000 7fdd0effd700 1 --2- 172.21.15.73:0/3723001504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd1013d070 0x7fdd100b6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.983+0000 7fdd0effd700 1 -- 172.21.15.73:0/3723001504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd10146990 msgr2=0x7fdd100b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:00.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.983+0000 7fdd0effd700 1 --2- 172.21.15.73:0/3723001504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd10146990 0x7fdd100b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:00.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.983+0000 7fdd0effd700 1 -- 172.21.15.73:0/3723001504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd00009570 con 0x7fdd100b2710 2023-11-30T23:13:00.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.987+0000 7fdd0effd700 1 --2- 172.21.15.73:0/3723001504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd100b2710 0x7fdd100b82d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdd0400e9d0 tx=0x7fdd0400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:00.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.987+0000 7fdcf7fff700 1 -- 172.21.15.73:0/3723001504 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04009720 con 0x7fdd100b2710 2023-11-30T23:13:00.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.987+0000 7fdcf7fff700 1 -- 172.21.15.73:0/3723001504 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0400ee70 con 0x7fdd100b2710 2023-11-30T23:13:00.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.987+0000 7fdd0ffff700 1 -- 172.21.15.73:0/3723001504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd100b7b60 con 0x7fdd100b2710 2023-11-30T23:13:00.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.987+0000 7fdcf7fff700 1 -- 172.21.15.73:0/3723001504 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0400ca50 con 0x7fdd100b2710 2023-11-30T23:13:00.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.987+0000 7fdd0ffff700 1 -- 172.21.15.73:0/3723001504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd100b72d0 con 0x7fdd100b2710 2023-11-30T23:13:00.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.987+0000 7fdd0ffff700 1 -- 172.21.15.73:0/3723001504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1006ed00 con 0x7fdd100b2710 2023-11-30T23:13:00.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.987+0000 7fdcf7fff700 1 -- 172.21.15.73:0/3723001504 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdd0400cbb0 con 0x7fdd100b2710 2023-11-30T23:13:00.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.991+0000 7fdcf7fff700 1 --2- 172.21.15.73:0/3723001504 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fdcfc065b00 0x7fdcfc067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:00.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.991+0000 7fdcf7fff700 1 -- 172.21.15.73:0/3723001504 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd04083100 con 0x7fdd100b2710 2023-11-30T23:13:00.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.991+0000 7fdd0e7fc700 1 --2- 172.21.15.73:0/3723001504 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fdcfc065b00 0x7fdcfc067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:00.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.991+0000 7fdd0e7fc700 1 --2- 172.21.15.73:0/3723001504 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fdcfc065b00 0x7fdcfc067fc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdd00009c60 tx=0x7fdd00008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:01.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:00.999+0000 7fdcf7fff700 1 -- 172.21.15.73:0/3723001504 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fdd04050b50 con 0x7fdd100b2710 2023-11-30T23:13:01.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.183+0000 7fdd0ffff700 1 -- 172.21.15.73:0/3723001504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd1004ed80 con 0x7fdd100b2710 2023-11-30T23:13:01.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.183+0000 7fdcf7fff700 1 -- 172.21.15.73:0/3723001504 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3133 (secure 0 0 0) 0x7fdd04017c50 con 0x7fdd100b2710 2023-11-30T23:13:01.189 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:13:01.190 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3213239947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3213239947},{"type":"v1","addr":"172.21.15.73:6835","nonce":3213239947}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T23:12:47.481180+0000","modified":"2023-11-30T23:12:50.126014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6833/1140380051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":1140380051},{"type":"v1","addr":"172.21.15.156:6833","nonce":1140380051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-30T23:13:01.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.187+0000 7fdd0ffff700 1 -- 172.21.15.73:0/3723001504 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fdcfc065b00 msgr2=0x7fdcfc067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:01.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.187+0000 7fdd0ffff700 1 --2- 172.21.15.73:0/3723001504 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fdcfc065b00 0x7fdcfc067fc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdd00009c60 tx=0x7fdd00008030 comp rx=0 tx=0).stop 2023-11-30T23:13:01.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.187+0000 7fdd0ffff700 1 -- 172.21.15.73:0/3723001504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd100b2710 msgr2=0x7fdd100b82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:01.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.187+0000 7fdd0ffff700 1 --2- 172.21.15.73:0/3723001504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd100b2710 0x7fdd100b82d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdd0400e9d0 tx=0x7fdd0400ece0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.187+0000 7fdd0ffff700 1 -- 172.21.15.73:0/3723001504 shutdown_connections 2023-11-30T23:13:01.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.187+0000 7fdd0ffff700 1 --2- 172.21.15.73:0/3723001504 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fdcfc065b00 0x7fdcfc067fc0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.187+0000 7fdd0ffff700 1 --2- 172.21.15.73:0/3723001504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd10146990 0x7fdd100b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.187+0000 7fdd0ffff700 1 --2- 172.21.15.73:0/3723001504 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fdd1013d070 0x7fdd100b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.187+0000 7fdd0ffff700 1 --2- 172.21.15.73:0/3723001504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd100b2710 0x7fdd100b82d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.187+0000 7fdd0ffff700 1 -- 172.21.15.73:0/3723001504 >> 172.21.15.73:0/3723001504 conn(0x7fdd100b45a0 msgr2=0x7fdd1013c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:13:01.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.191+0000 7fdd0ffff700 1 -- 172.21.15.73:0/3723001504 shutdown_connections 2023-11-30T23:13:01.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.191+0000 7fdd0ffff700 1 -- 172.21.15.73:0/3723001504 wait complete. 2023-11-30T23:13:01.195 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 7 2023-11-30T23:13:01.414 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-30T23:12:47.481180+0000', 'modified': '2023-11-30T23:12:50.126014+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.156:6833/1140380051', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6832', 'nonce': 1140380051}, {'type': 'v1', 'addr': '172.21.15.156:6833', 'nonce': 1140380051}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-30T23:13:01.414 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-30T23:13:01.414 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-30T23:13:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f63518cc700 1 Processor -- start 2023-11-30T23:13:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f63518cc700 1 -- start start 2023-11-30T23:13:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f63518cc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f634c14dca0 0x7f634c150090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f63518cc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634c06ee70 con 0x7f634c0b1420 2023-11-30T23:13:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f63518cc700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634c070050 con 0x7f634c13e210 2023-11-30T23:13:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f63518cc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0b40c0 con 0x7f634c14dca0 2023-11-30T23:13:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f63508ca700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f634c0b1420 0x7f634c147970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38308/0 (socket says 172.21.15.73:38308) 2023-11-30T23:13:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f63508ca700 1 -- 172.21.15.73:0/3049296691 learned_addr learned my addr 172.21.15.73:0/3049296691 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:13:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f63510cb700 1 --2- 172.21.15.73:0/3049296691 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f634c14dca0 0x7f634c150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f634b7fe700 1 -- 172.21.15.73:0/3049296691 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574551575 0 0) 0x7f634c06ee70 con 0x7f634c0b1420 2023-11-30T23:13:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f634b7fe700 1 -- 172.21.15.73:0/3049296691 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f632c0035d0 con 0x7f634c0b1420 2023-11-30T23:13:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f634b7fe700 1 -- 172.21.15.73:0/3049296691 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3378938982 0 0) 0x7f632c0035d0 con 0x7f634c0b1420 2023-11-30T23:13:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f634b7fe700 1 -- 172.21.15.73:0/3049296691 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f634c14dca0 msgr2=0x7f634c150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:13:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f634b7fe700 1 --2- 172.21.15.73:0/3049296691 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f634c14dca0 0x7f634c150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f634b7fe700 1 -- 172.21.15.73:0/3049296691 >> v1:172.21.15.156:6789/0 conn(0x7f634c13e210 legacy=0x7f634c13e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f634b7fe700 1 -- 172.21.15.73:0/3049296691 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c06f300 con 0x7f634c0b1420 2023-11-30T23:13:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f634b7fe700 1 -- 172.21.15.73:0/3049296691 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3856460137 0 0) 0x7f633c001670 con 0x7f634c0b1420 2023-11-30T23:13:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f634b7fe700 1 -- 172.21.15.73:0/3049296691 >> v1:172.21.15.73:6789/0 conn(0x7f634c0b1420 legacy=0x7f634c147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f634b7fe700 1 --2- 172.21.15.73:0/3049296691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f632c003a50 0x7f632c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f634b7fe700 1 --2- 172.21.15.73:0/3049296691 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f634c14dca0 0x7f632c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f634b7fe700 1 --2- 172.21.15.73:0/3049296691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f632c004db0 0x7f632c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f634b7fe700 1 -- 172.21.15.73:0/3049296691 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0b40c0 con 0x7f632c004db0 2023-11-30T23:13:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f634b7fe700 1 -- 172.21.15.73:0/3049296691 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c00bb60 con 0x7f632c003a50 2023-11-30T23:13:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f634b7fe700 1 -- 172.21.15.73:0/3049296691 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632c00bd20 con 0x7f634c14dca0 2023-11-30T23:13:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f63510cb700 1 --2- 172.21.15.73:0/3049296691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f632c004db0 0x7f632c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f63508ca700 1 --2- 172.21.15.73:0/3049296691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f632c003a50 0x7f632c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.531+0000 7f634bfff700 1 --2- 172.21.15.73:0/3049296691 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f634c14dca0 0x7f632c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63510cb700 1 -- 172.21.15.73:0/3049296691 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f634c14dca0 msgr2=0x7f632c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:13:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63510cb700 1 --2- 172.21.15.73:0/3049296691 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f634c14dca0 0x7f632c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63510cb700 1 -- 172.21.15.73:0/3049296691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f632c003a50 msgr2=0x7f632c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:13:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63510cb700 1 --2- 172.21.15.73:0/3049296691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f632c003a50 0x7f632c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63510cb700 1 -- 172.21.15.73:0/3049296691 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c0035d0 con 0x7f632c004db0 2023-11-30T23:13:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63510cb700 1 --2- 172.21.15.73:0/3049296691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f632c004db0 0x7f632c005230 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f634c0aedf0 tx=0x7f632c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858421bd3577cc21 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f634b7fe700 1 -- 172.21.15.73:0/3049296691 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634400ebd0 con 0x7f632c004db0 2023-11-30T23:13:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f634b7fe700 1 -- 172.21.15.73:0/3049296691 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634400f040 con 0x7f632c004db0 2023-11-30T23:13:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f634b7fe700 1 -- 172.21.15.73:0/3049296691 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344014480 con 0x7f632c004db0 2023-11-30T23:13:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63518cc700 1 -- 172.21.15.73:0/3049296691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f632c004db0 msgr2=0x7f632c005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63518cc700 1 --2- 172.21.15.73:0/3049296691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f632c004db0 0x7f632c005230 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f634c0aedf0 tx=0x7f632c0058a0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63510cb700 1 -- 172.21.15.73:0/3049296691 reap_dead start 2023-11-30T23:13:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63518cc700 1 -- 172.21.15.73:0/3049296691 shutdown_connections 2023-11-30T23:13:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63518cc700 1 -- 172.21.15.73:0/3049296691 >> 172.21.15.73:0/3049296691 conn(0x7f634c0b45a0 msgr2=0x7f634c0b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:13:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63518cc700 1 -- 172.21.15.73:0/3049296691 shutdown_connections 2023-11-30T23:13:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63518cc700 1 -- 172.21.15.73:0/3049296691 wait complete. 2023-11-30T23:13:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63518cc700 1 Processor -- start 2023-11-30T23:13:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63518cc700 1 -- start start 2023-11-30T23:13:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63518cc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f632c004db0 0x7f634c1482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63518cc700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f634c146140 0x7f634c1465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63518cc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f634c1dd470 0x7f634c1dd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63518cc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c1d9f00 con 0x7f632c004db0 2023-11-30T23:13:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63518cc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c13a3d0 con 0x7f634c1dd470 2023-11-30T23:13:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63518cc700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c147870 con 0x7f634c146140 2023-11-30T23:13:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63508ca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f632c004db0 0x7f634c1482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63508ca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f632c004db0 0x7f634c1482e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38708/0 (socket says 172.21.15.73:38708) 2023-11-30T23:13:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63508ca700 1 -- 172.21.15.73:0/2491280829 learned_addr learned my addr 172.21.15.73:0/2491280829 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:13:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f634bfff700 1 --2- 172.21.15.73:0/2491280829 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f634c146140 0x7f634c1465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63510cb700 1 --2- 172.21.15.73:0/2491280829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f634c1dd470 0x7f634c1dd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63508ca700 1 -- 172.21.15.73:0/2491280829 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f634c146140 msgr2=0x7f634c1465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63508ca700 1 --2- 172.21.15.73:0/2491280829 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f634c146140 0x7f634c1465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63508ca700 1 -- 172.21.15.73:0/2491280829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f634c1dd470 msgr2=0x7f634c1dd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63508ca700 1 --2- 172.21.15.73:0/2491280829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f634c1dd470 0x7f634c1dd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.535+0000 7f63508ca700 1 -- 172.21.15.73:0/2491280829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c147b50 con 0x7f632c004db0 2023-11-30T23:13:01.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.539+0000 7f63508ca700 1 --2- 172.21.15.73:0/2491280829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f632c004db0 0x7f634c1482e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f633c00eb20 tx=0x7f633c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:01.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.539+0000 7f63497fa700 1 -- 172.21.15.73:0/2491280829 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c005e20 con 0x7f632c004db0 2023-11-30T23:13:01.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.539+0000 7f63518cc700 1 -- 172.21.15.73:0/2491280829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634c13a620 con 0x7f632c004db0 2023-11-30T23:13:01.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.539+0000 7f63497fa700 1 -- 172.21.15.73:0/2491280829 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c00c7e0 con 0x7f632c004db0 2023-11-30T23:13:01.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.539+0000 7f63497fa700 1 -- 172.21.15.73:0/2491280829 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c00cb50 con 0x7f632c004db0 2023-11-30T23:13:01.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.539+0000 7f63518cc700 1 -- 172.21.15.73:0/2491280829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c13abe0 con 0x7f632c004db0 2023-11-30T23:13:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.539+0000 7f63497fa700 1 -- 172.21.15.73:0/2491280829 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f633c00ccb0 con 0x7f632c004db0 2023-11-30T23:13:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.539+0000 7f6355db4740 1 Processor -- start 2023-11-30T23:13:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.539+0000 7f6355db4740 1 -- start start 2023-11-30T23:13:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f63497fa700 1 --2- 172.21.15.73:0/2491280829 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6330065b00 0x7f6330067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f63497fa700 1 -- 172.21.15.73:0/2491280829 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f633c082ef0 con 0x7f632c004db0 2023-11-30T23:13:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f63510cb700 1 --2- 172.21.15.73:0/2491280829 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6330065b00 0x7f6330067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2604920 0x2676520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x269eea0 0x2699d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x269f280 0x269a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2588dd0 con 0x2604920 2023-11-30T23:13:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x25e25b0 con 0x269f280 2023-11-30T23:13:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x25dfd40 con 0x269eea0 2023-11-30T23:13:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f63508ca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2604920 0x2676520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f63508ca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2604920 0x2676520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38720/0 (socket says 172.21.15.73:38720) 2023-11-30T23:13:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f63508ca700 1 -- 172.21.15.73:0/806129553 learned_addr learned my addr 172.21.15.73:0/806129553 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:13:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f634bfff700 1 --2- 172.21.15.73:0/806129553 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x269eea0 0x2699d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f63510cb700 1 --2- 172.21.15.73:0/806129553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x269f280 0x269a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f63508ca700 1 -- 172.21.15.73:0/806129553 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x269eea0 msgr2=0x2699d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:13:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f63510cb700 1 --2- 172.21.15.73:0/2491280829 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6330065b00 0x7f6330067fc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f634c148a30 tx=0x7f6344020040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f63508ca700 1 --2- 172.21.15.73:0/806129553 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x269eea0 0x2699d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f63508ca700 1 -- 172.21.15.73:0/806129553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x269f280 msgr2=0x269a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:13:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f63508ca700 1 --2- 172.21.15.73:0/806129553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x269f280 0x269a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f63508ca700 1 -- 172.21.15.73:0/806129553 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x244e960 con 0x2604920 2023-11-30T23:13:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f634bfff700 1 --2- 172.21.15.73:0/806129553 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x269eea0 0x2699d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-30T23:13:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f63510cb700 1 --2- 172.21.15.73:0/806129553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x269f280 0x269a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-30T23:13:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f63508ca700 1 --2- 172.21.15.73:0/806129553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2604920 0x2676520 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f633c081450 tx=0x7f633c053f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e338f5ddd454e46 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f63427fc700 1 -- 172.21.15.73:0/806129553 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c058170 con 0x2604920 2023-11-30T23:13:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f63427fc700 1 -- 172.21.15.73:0/806129553 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c054580 con 0x2604920 2023-11-30T23:13:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f63427fc700 1 -- 172.21.15.73:0/806129553 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c0583b0 con 0x2604920 2023-11-30T23:13:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 -- 172.21.15.73:0/806129553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2604920 msgr2=0x2676520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 --2- 172.21.15.73:0/806129553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2604920 0x2676520 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f633c081450 tx=0x7f633c053f60 comp rx=0 tx=0).stop 2023-11-30T23:13:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 -- 172.21.15.73:0/806129553 shutdown_connections 2023-11-30T23:13:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 --2- 172.21.15.73:0/806129553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x269f280 0x269a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 --2- 172.21.15.73:0/806129553 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x269eea0 0x2699d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 --2- 172.21.15.73:0/806129553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2604920 0x2676520 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 -- 172.21.15.73:0/806129553 >> 172.21.15.73:0/806129553 conn(0x24034d0 msgr2=0x269e790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:13:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 -- 172.21.15.73:0/806129553 shutdown_connections 2023-11-30T23:13:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 -- 172.21.15.73:0/806129553 wait complete. 2023-11-30T23:13:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 -- start start 2023-11-30T23:13:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 Processor -- start 2023-11-30T23:13:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x2604920 0x26aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x269eea0 0x2673d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269f280 0x2674280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x25db630 con 0x269f280 2023-11-30T23:13:01.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x2598c80 con 0x2604920 2023-11-30T23:13:01.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x259eb00 con 0x269eea0 2023-11-30T23:13:01.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.543+0000 7f6355db4740 10 client.0 _ll_register_callbacks cb 0x25e3e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T23:13:01.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f63510cb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269f280 0x2674280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f63510cb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269f280 0x2674280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38734/0 (socket says 172.21.15.73:38734) 2023-11-30T23:13:01.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f63510cb700 1 -- 172.21.15.73:0/245441224 learned_addr learned my addr 172.21.15.73:0/245441224 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:13:01.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f63508ca700 1 --2- 172.21.15.73:0/245441224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x2604920 0x26aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f634bfff700 1 --2- 172.21.15.73:0/245441224 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x269eea0 0x2673d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f63510cb700 1 -- 172.21.15.73:0/245441224 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x269eea0 msgr2=0x2673d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:13:01.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f63510cb700 1 --2- 172.21.15.73:0/245441224 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x269eea0 0x2673d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f63510cb700 1 -- 172.21.15.73:0/245441224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x2604920 msgr2=0x26aaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:13:01.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f63510cb700 1 --2- 172.21.15.73:0/245441224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x2604920 0x26aaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f63510cb700 1 -- 172.21.15.73:0/245441224 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c13abe0 con 0x269f280 2023-11-30T23:13:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f63508ca700 1 --2- 172.21.15.73:0/245441224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x2604920 0x26aaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:13:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f63510cb700 1 --2- 172.21.15.73:0/245441224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269f280 0x2674280 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f632c00bb30 tx=0x7f6344004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43331db194f9b556 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f633b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-11-30T23:13:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f633b7fe700 1 -- 172.21.15.73:0/245441224 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344007000 con 0x269f280 2023-11-30T23:13:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f633b7fe700 1 -- 172.21.15.73:0/245441224 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6344014e20 con 0x269f280 2023-11-30T23:13:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f6355db4740 1 -- 172.21.15.73:0/245441224 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x25d46b0 con 0x269f280 2023-11-30T23:13:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f633b7fe700 1 -- 172.21.15.73:0/245441224 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6344028610 con 0x269f280 2023-11-30T23:13:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f6355db4740 10 client.4674 fetch_fsmap learned FSMap version 7 2023-11-30T23:13:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f6355db4740 1 -- 172.21.15.73:0/245441224 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x25a1770 con 0x269f280 2023-11-30T23:13:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f633b7fe700 1 -- 172.21.15.73:0/245441224 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x25d46b0 con 0x269f280 2023-11-30T23:13:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f633b7fe700 1 -- 172.21.15.73:0/245441224 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 7) v1 ==== 2016+0+0 (secure 0 0 0) 0x7f634401e400 con 0x269f280 2023-11-30T23:13:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f6355db4740 10 client.4674 fetch_fsmap finished waiting for FSMap version 7 2023-11-30T23:13:01.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f6355db4740 10 client.4674 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-30T23:13:01.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f6355db4740 20 client.4674 populate_metadata read hostname 'smithi073' 2023-11-30T23:13:01.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f6355db4740 1 --2- 172.21.15.73:0/245441224 >> [v2:172.21.15.156:6832/1140380051,v1:172.21.15.156:6833/1140380051] conn(0x26aeb80 0x2688c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f6355db4740 4 client.4674 mds_command: new command op to 4297 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-30T23:13:01.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f6355db4740 1 -- 172.21.15.73:0/245441224 --> [v2:172.21.15.156:6832/1140380051,v1:172.21.15.156:6833/1140380051] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2596a00 con 0x26aeb80 2023-11-30T23:13:01.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f63508ca700 1 --2- 172.21.15.73:0/245441224 >> [v2:172.21.15.156:6832/1140380051,v1:172.21.15.156:6833/1140380051] conn(0x26aeb80 0x2688c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f633b7fe700 10 client.4674 ms_handle_connect on v2:172.21.15.156:6832/1140380051 2023-11-30T23:13:01.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.547+0000 7f63508ca700 1 --2- 172.21.15.73:0/245441224 >> [v2:172.21.15.156:6832/1140380051,v1:172.21.15.156:6833/1140380051] conn(0x26aeb80 0x2688c80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69f148c117fb7fb4 server_cookie=da4dcc4cea0ef98 in_seq=0 out_seq=0 2023-11-30T23:13:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.551+0000 7f633b7fe700 1 -- 172.21.15.73:0/245441224 <== mds.0 v2:172.21.15.156:6832/1140380051 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x2596a00 con 0x26aeb80 2023-11-30T23:13:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.551+0000 7f633b7fe700 10 client.4674 handle_command_reply: tid=0 2023-11-30T23:13:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.551+0000 7f6355db4740 1 client.4674 shutdown 2023-11-30T23:13:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.551+0000 7f6355db4740 1 -- 172.21.15.73:0/245441224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269f280 msgr2=0x2674280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.551+0000 7f6355db4740 1 --2- 172.21.15.73:0/245441224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269f280 0x2674280 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f632c00bb30 tx=0x7f6344004b60 comp rx=0 tx=0).stop 2023-11-30T23:13:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.551+0000 7f6355db4740 1 -- 172.21.15.73:0/245441224 shutdown_connections 2023-11-30T23:13:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.551+0000 7f6355db4740 1 --2- 172.21.15.73:0/245441224 >> [v2:172.21.15.156:6832/1140380051,v1:172.21.15.156:6833/1140380051] conn(0x26aeb80 0x2688c80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.551+0000 7f6355db4740 1 --2- 172.21.15.73:0/245441224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269f280 0x2674280 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.551+0000 7f6355db4740 1 --2- 172.21.15.73:0/245441224 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x269eea0 0x2673d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.551+0000 7f6355db4740 1 --2- 172.21.15.73:0/245441224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x2604920 0x26aaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.551+0000 7f6355db4740 1 -- 172.21.15.73:0/245441224 >> 172.21.15.73:0/245441224 conn(0x24034d0 msgr2=0x2675a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:13:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.551+0000 7f633b7fe700 0 client.4674 ms_handle_reset on v2:172.21.15.156:6832/1140380051 2023-11-30T23:13:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.551+0000 7f6355db4740 1 -- 172.21.15.73:0/245441224 shutdown_connections 2023-11-30T23:13:01.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.551+0000 7f6355db4740 1 -- 172.21.15.73:0/245441224 wait complete. 2023-11-30T23:13:01.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.551+0000 7f6355db4740 20 client.4674 trim_cache size 0 max 16384 2023-11-30T23:13:01.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 Processor -- start 2023-11-30T23:13:01.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 -- start start 2023-11-30T23:13:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x2604920 0x2685690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269eea0 0x2685bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x269f280 0x2686110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2487aa0 con 0x269eea0 2023-11-30T23:13:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x25e3840 con 0x2604920 2023-11-30T23:13:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x25da4c0 con 0x269f280 2023-11-30T23:13:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f634bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269eea0 0x2685bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f634bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269eea0 0x2685bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38740/0 (socket says 172.21.15.73:38740) 2023-11-30T23:13:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f634bfff700 1 -- 172.21.15.73:0/3354345444 learned_addr learned my addr 172.21.15.73:0/3354345444 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:13:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f63510cb700 1 --2- 172.21.15.73:0/3354345444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x269f280 0x2686110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f63508ca700 1 --2- 172.21.15.73:0/3354345444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x2604920 0x2685690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f634bfff700 1 -- 172.21.15.73:0/3354345444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x269f280 msgr2=0x2686110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:13:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f634bfff700 1 --2- 172.21.15.73:0/3354345444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x269f280 0x2686110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f634bfff700 1 -- 172.21.15.73:0/3354345444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x2604920 msgr2=0x2685690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:13:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f634bfff700 1 --2- 172.21.15.73:0/3354345444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x2604920 0x2685690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f634bfff700 1 -- 172.21.15.73:0/3354345444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x25879a0 con 0x269eea0 2023-11-30T23:13:01.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f63508ca700 1 --2- 172.21.15.73:0/3354345444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x2604920 0x2685690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:13:01.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f634bfff700 1 --2- 172.21.15.73:0/3354345444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269eea0 0x2685bd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6334005530 tx=0x7f6334003980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2eba9ee30525d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:01.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6342ffd700 1 -- 172.21.15.73:0/3354345444 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6334001350 con 0x269eea0 2023-11-30T23:13:01.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6342ffd700 1 -- 172.21.15.73:0/3354345444 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63340014b0 con 0x269eea0 2023-11-30T23:13:01.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6342ffd700 1 -- 172.21.15.73:0/3354345444 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6334001860 con 0x269eea0 2023-11-30T23:13:01.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 -- 172.21.15.73:0/3354345444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269eea0 msgr2=0x2685bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:01.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 --2- 172.21.15.73:0/3354345444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269eea0 0x2685bd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6334005530 tx=0x7f6334003980 comp rx=0 tx=0).stop 2023-11-30T23:13:01.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 -- 172.21.15.73:0/3354345444 shutdown_connections 2023-11-30T23:13:01.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 --2- 172.21.15.73:0/3354345444 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x269f280 0x2686110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 --2- 172.21.15.73:0/3354345444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269eea0 0x2685bd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 --2- 172.21.15.73:0/3354345444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x2604920 0x2685690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 -- 172.21.15.73:0/3354345444 >> 172.21.15.73:0/3354345444 conn(0x24034d0 msgr2=0x26893b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:13:01.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 -- 172.21.15.73:0/3354345444 shutdown_connections 2023-11-30T23:13:01.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 -- 172.21.15.73:0/3354345444 wait complete. 2023-11-30T23:13:01.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 -- start start 2023-11-30T23:13:01.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.567+0000 7f6355db4740 1 Processor -- start 2023-11-30T23:13:01.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f6355db4740 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x2604920 0x2709250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f6355db4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269eea0 0x26ff550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f6355db4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x269f280 0x26ffa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f6355db4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x25833d0 con 0x269eea0 2023-11-30T23:13:01.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f6355db4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x259af20 con 0x269f280 2023-11-30T23:13:01.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f6355db4740 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x26aa760 con 0x2604920 2023-11-30T23:13:01.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f6355db4740 10 client.0 _ll_register_callbacks cb 0x25811d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-30T23:13:01.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f634bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269eea0 0x26ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f634bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269eea0 0x26ff550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38744/0 (socket says 172.21.15.73:38744) 2023-11-30T23:13:01.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f634bfff700 1 -- 172.21.15.73:0/1359318401 learned_addr learned my addr 172.21.15.73:0/1359318401 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:13:01.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f63510cb700 1 --2- 172.21.15.73:0/1359318401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x269f280 0x26ffa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f63508ca700 1 --2- 172.21.15.73:0/1359318401 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x2604920 0x2709250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f634bfff700 1 -- 172.21.15.73:0/1359318401 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x2604920 msgr2=0x2709250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:13:01.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f634bfff700 1 --2- 172.21.15.73:0/1359318401 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x2604920 0x2709250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f634bfff700 1 -- 172.21.15.73:0/1359318401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x269f280 msgr2=0x26ffa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:13:01.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f634bfff700 1 --2- 172.21.15.73:0/1359318401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x269f280 0x26ffa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f634bfff700 1 -- 172.21.15.73:0/1359318401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633400f040 con 0x269eea0 2023-11-30T23:13:01.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f634bfff700 1 --2- 172.21.15.73:0/1359318401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269eea0 0x26ff550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6334003cd0 tx=0x7f6334001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f4baf68a6dfc27 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:13:01.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f633b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-11-30T23:13:01.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f633b7fe700 1 -- 172.21.15.73:0/1359318401 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6334026070 con 0x269eea0 2023-11-30T23:13:01.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f633b7fe700 1 -- 172.21.15.73:0/1359318401 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6334017640 con 0x269eea0 2023-11-30T23:13:01.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f6355db4740 1 -- 172.21.15.73:0/1359318401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x268ae10 con 0x269eea0 2023-11-30T23:13:01.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f633b7fe700 1 -- 172.21.15.73:0/1359318401 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6334005100 con 0x269eea0 2023-11-30T23:13:01.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f6355db4740 10 client.4680 fetch_fsmap learned FSMap version 7 2023-11-30T23:13:01.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f6355db4740 1 -- 172.21.15.73:0/1359318401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x257bc70 con 0x269eea0 2023-11-30T23:13:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f633b7fe700 1 -- 172.21.15.73:0/1359318401 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x268ae10 con 0x269eea0 2023-11-30T23:13:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f633b7fe700 1 -- 172.21.15.73:0/1359318401 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 7) v1 ==== 2016+0+0 (secure 0 0 0) 0x7f633402bc60 con 0x269eea0 2023-11-30T23:13:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f6355db4740 10 client.4680 fetch_fsmap finished waiting for FSMap version 7 2023-11-30T23:13:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f6355db4740 10 client.4680 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-30T23:13:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f6355db4740 20 client.4680 populate_metadata read hostname 'smithi073' 2023-11-30T23:13:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f6355db4740 1 --2- 172.21.15.73:0/1359318401 >> [v2:172.21.15.156:6832/1140380051,v1:172.21.15.156:6833/1140380051] conn(0x2709790 0x2672ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:13:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f6355db4740 4 client.4680 mds_command: new command op to 4297 tid=0[{"prefix": "status"}] 2023-11-30T23:13:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f6355db4740 1 -- 172.21.15.73:0/1359318401 --> [v2:172.21.15.156:6832/1140380051,v1:172.21.15.156:6833/1140380051] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f633c054580 con 0x2709790 2023-11-30T23:13:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f63508ca700 1 --2- 172.21.15.73:0/1359318401 >> [v2:172.21.15.156:6832/1140380051,v1:172.21.15.156:6833/1140380051] conn(0x2709790 0x2672ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:13:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f633b7fe700 10 client.4680 ms_handle_connect on v2:172.21.15.156:6832/1140380051 2023-11-30T23:13:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f63508ca700 1 --2- 172.21.15.73:0/1359318401 >> [v2:172.21.15.156:6832/1140380051,v1:172.21.15.156:6833/1140380051] conn(0x2709790 0x2672ac0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b6788aae6df6d61 server_cookie=40918f1ba64fb947 in_seq=0 out_seq=0 2023-11-30T23:13:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f633b7fe700 1 -- 172.21.15.73:0/1359318401 <== mds.0 v2:172.21.15.156:6832/1140380051 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x7f633c054580 con 0x2709790 2023-11-30T23:13:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f633b7fe700 10 client.4680 handle_command_reply: tid=0 2023-11-30T23:13:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.571+0000 7f6355db4740 1 client.4680 shutdown 2023-11-30T23:13:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f6355db4740 1 -- 172.21.15.73:0/1359318401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269eea0 msgr2=0x26ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f6355db4740 1 --2- 172.21.15.73:0/1359318401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269eea0 0x26ff550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6334003cd0 tx=0x7f6334001190 comp rx=0 tx=0).stop 2023-11-30T23:13:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f6355db4740 1 -- 172.21.15.73:0/1359318401 shutdown_connections 2023-11-30T23:13:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f6355db4740 1 --2- 172.21.15.73:0/1359318401 >> [v2:172.21.15.156:6832/1140380051,v1:172.21.15.156:6833/1140380051] conn(0x2709790 0x2672ac0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f6355db4740 1 --2- 172.21.15.73:0/1359318401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x269f280 0x26ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f633b7fe700 0 client.4680 ms_handle_reset on v2:172.21.15.156:6832/1140380051 2023-11-30T23:13:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f6355db4740 1 --2- 172.21.15.73:0/1359318401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x269eea0 0x26ff550 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f6355db4740 1 --2- 172.21.15.73:0/1359318401 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x2604920 0x2709250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f6355db4740 1 -- 172.21.15.73:0/1359318401 >> 172.21.15.73:0/1359318401 conn(0x24034d0 msgr2=0x26a9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:13:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f6355db4740 1 -- 172.21.15.73:0/1359318401 shutdown_connections 2023-11-30T23:13:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f6355db4740 1 -- 172.21.15.73:0/1359318401 wait complete. 2023-11-30T23:13:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f6355db4740 20 client.4680 trim_cache size 0 max 16384 2023-11-30T23:13:01.587 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-30T23:13:01.587 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "a677cb6a-4a54-4567-a30d-f0fa4bc22b17", 2023-11-30T23:13:01.587 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2023-11-30T23:13:01.587 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4297, 2023-11-30T23:13:01.587 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-11-30T23:13:01.587 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-11-30T23:13:01.587 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-11-30T23:13:01.587 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 14.091308360999999, 2023-11-30T23:13:01.587 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 7, 2023-11-30T23:13:01.587 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 20, 2023-11-30T23:13:01.587 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 20, 2023-11-30T23:13:01.587 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 20.704666168999999 2023-11-30T23:13:01.587 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-30T23:13:01.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f63518cc700 1 -- 172.21.15.73:0/2491280829 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6330065b00 msgr2=0x7f6330067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:01.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f63518cc700 1 --2- 172.21.15.73:0/2491280829 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6330065b00 0x7f6330067fc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f634c148a30 tx=0x7f6344020040 comp rx=0 tx=0).stop 2023-11-30T23:13:01.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f63518cc700 1 -- 172.21.15.73:0/2491280829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f632c004db0 msgr2=0x7f634c1482e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:13:01.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f63518cc700 1 --2- 172.21.15.73:0/2491280829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f632c004db0 0x7f634c1482e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f633c00eb20 tx=0x7f633c00ee30 comp rx=0 tx=0).stop 2023-11-30T23:13:01.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f63518cc700 1 -- 172.21.15.73:0/2491280829 shutdown_connections 2023-11-30T23:13:01.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f63518cc700 1 --2- 172.21.15.73:0/2491280829 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6330065b00 0x7f6330067fc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f63518cc700 1 --2- 172.21.15.73:0/2491280829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f634c1dd470 0x7f634c1dd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f63518cc700 1 --2- 172.21.15.73:0/2491280829 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f634c146140 0x7f634c1465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f63518cc700 1 --2- 172.21.15.73:0/2491280829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f632c004db0 0x7f634c1482e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:13:01.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f63518cc700 1 -- 172.21.15.73:0/2491280829 >> 172.21.15.73:0/2491280829 conn(0x7f634c0b45a0 msgr2=0x7f634c13c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:13:01.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f63518cc700 1 -- 172.21.15.73:0/2491280829 shutdown_connections 2023-11-30T23:13:01.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:13:01.575+0000 7f63518cc700 1 -- 172.21.15.73:0/2491280829 wait complete. 2023-11-30T23:13:01.596 INFO:teuthology.run_tasks:Running task check-counter... 2023-11-30T23:13:01.670 INFO:teuthology.run_tasks:Running task workunit... 2023-11-30T23:13:01.736 INFO:tasks.workunit:Pulling workunits from ref a6f82997ac57b70a895455dfed6256360a1e4c32 2023-11-30T23:13:01.736 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-11-30T23:13:01.737 DEBUG:teuthology.orchestra.run.smithi073:> stat -- /home/ubuntu/cephtest/mnt.0 2023-11-30T23:13:01.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T23:13:01.744 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-30T23:13:01.745 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-11-30T23:13:01.751 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-11-30T23:13:01.751 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-11-30T23:13:01.760 INFO:tasks.workunit:timeout=3h 2023-11-30T23:13:01.760 INFO:tasks.workunit:cleanup=True 2023-11-30T23:13:01.761 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a6f82997ac57b70a895455dfed6256360a1e4c32 2023-11-30T23:13:01.810 INFO:tasks.workunit.client.0.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-11-30T23:13:21.750 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:13:21.753 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:13:51.827 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:13:51.829 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:13:59.445 INFO:tasks.workunit.client.0.smithi073.stderr:Note: switching to 'a6f82997ac57b70a895455dfed6256360a1e4c32'. 2023-11-30T23:13:59.446 INFO:tasks.workunit.client.0.smithi073.stderr: 2023-11-30T23:13:59.446 INFO:tasks.workunit.client.0.smithi073.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-30T23:13:59.446 INFO:tasks.workunit.client.0.smithi073.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-30T23:13:59.446 INFO:tasks.workunit.client.0.smithi073.stderr:state without impacting any branches by switching back to a branch. 2023-11-30T23:13:59.446 INFO:tasks.workunit.client.0.smithi073.stderr: 2023-11-30T23:13:59.446 INFO:tasks.workunit.client.0.smithi073.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-30T23:13:59.446 INFO:tasks.workunit.client.0.smithi073.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-30T23:13:59.446 INFO:tasks.workunit.client.0.smithi073.stderr: 2023-11-30T23:13:59.446 INFO:tasks.workunit.client.0.smithi073.stderr: git switch -c 2023-11-30T23:13:59.446 INFO:tasks.workunit.client.0.smithi073.stderr: 2023-11-30T23:13:59.447 INFO:tasks.workunit.client.0.smithi073.stderr:Or undo this operation with: 2023-11-30T23:13:59.447 INFO:tasks.workunit.client.0.smithi073.stderr: 2023-11-30T23:13:59.447 INFO:tasks.workunit.client.0.smithi073.stderr: git switch - 2023-11-30T23:13:59.447 INFO:tasks.workunit.client.0.smithi073.stderr: 2023-11-30T23:13:59.447 INFO:tasks.workunit.client.0.smithi073.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-30T23:13:59.447 INFO:tasks.workunit.client.0.smithi073.stderr: 2023-11-30T23:13:59.447 INFO:tasks.workunit.client.0.smithi073.stderr:HEAD is now at a6f82997ac5 qa/cephfs: try usual umount if client blocklisting cannot be inferred 2023-11-30T23:13:59.450 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-11-30T23:13:59.476 INFO:tasks.workunit.client.0.smithi073.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-11-30T23:13:59.479 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-30T23:13:59.479 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-11-30T23:14:00.352 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-11-30T23:14:00.446 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-11-30T23:14:00.497 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-30T23:14:00.499 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-30T23:14:00.499 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-11-30T23:14:00.551 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-30T23:14:00.557 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-11-30T23:14:00.557 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-11-30T23:14:00.565 INFO:tasks.workunit:Running workunits matching libcephfs/test.sh on client.0... 2023-11-30T23:14:00.567 INFO:tasks.workunit:Running workunit libcephfs/test.sh... 2023-11-30T23:14:00.567 DEBUG:teuthology.orchestra.run.smithi073:workunit test libcephfs/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a6f82997ac57b70a895455dfed6256360a1e4c32 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh 2023-11-30T23:14:00.675 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 133 tests from 4 test suites. 2023-11-30T23:14:00.676 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2023-11-30T23:14:00.676 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 124 tests from LibCephFS 2023-11-30T23:14:00.676 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.OpenEmptyComponent 2023-11-30T23:14:00.796 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.OpenEmptyComponent (119 ms) 2023-11-30T23:14:00.796 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.OpenReadTruncate 2023-11-30T23:14:00.889 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.OpenReadTruncate (94 ms) 2023-11-30T23:14:00.889 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.OpenReadWrite 2023-11-30T23:14:01.921 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.OpenReadWrite (1032 ms) 2023-11-30T23:14:01.921 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.MountNonExist 2023-11-30T23:14:01.956 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.MountNonExist (35 ms) 2023-11-30T23:14:01.956 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.MountDouble 2023-11-30T23:14:02.986 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.MountDouble (1031 ms) 2023-11-30T23:14:02.987 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.MountRemount 2023-11-30T23:14:05.036 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.MountRemount (2049 ms) 2023-11-30T23:14:05.036 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.UnmountUnmounted 2023-11-30T23:14:05.049 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.UnmountUnmounted (14 ms) 2023-11-30T23:14:05.049 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ReleaseUnmounted 2023-11-30T23:14:05.059 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ReleaseUnmounted (9 ms) 2023-11-30T23:14:05.059 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ReleaseMounted 2023-11-30T23:14:05.089 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ReleaseMounted (31 ms) 2023-11-30T23:14:05.089 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.UnmountRelease 2023-11-30T23:14:06.122 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.UnmountRelease (1032 ms) 2023-11-30T23:14:06.122 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Mount 2023-11-30T23:14:08.186 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Mount (2064 ms) 2023-11-30T23:14:08.186 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.OpenLayout 2023-11-30T23:14:08.277 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.OpenLayout (91 ms) 2023-11-30T23:14:08.277 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.DirLs 2023-11-30T23:14:13.421 INFO:tasks.workunit.client.0.smithi073.stdout:rand: 701 2023-11-30T23:14:13.421 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.DirLs (5144 ms) 2023-11-30T23:14:13.421 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ManyNestedDirs 2023-11-30T23:14:14.233 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ManyNestedDirs (812 ms) 2023-11-30T23:14:14.233 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Xattrs 2023-11-30T23:14:14.326 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_a 2023-11-30T23:14:14.326 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_b 2023-11-30T23:14:14.326 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_c 2023-11-30T23:14:14.326 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_d 2023-11-30T23:14:14.326 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_e 2023-11-30T23:14:14.326 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_f 2023-11-30T23:14:14.326 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_g 2023-11-30T23:14:14.326 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_h 2023-11-30T23:14:14.326 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_i 2023-11-30T23:14:14.326 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_j 2023-11-30T23:14:14.327 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_k 2023-11-30T23:14:14.327 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_l 2023-11-30T23:14:14.327 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_m 2023-11-30T23:14:14.327 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_n 2023-11-30T23:14:14.327 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_o 2023-11-30T23:14:14.327 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_p 2023-11-30T23:14:14.327 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_q 2023-11-30T23:14:14.327 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_r 2023-11-30T23:14:14.327 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_s 2023-11-30T23:14:14.327 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_t 2023-11-30T23:14:14.327 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_u 2023-11-30T23:14:14.327 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_v 2023-11-30T23:14:14.327 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_w 2023-11-30T23:14:14.327 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_x 2023-11-30T23:14:14.327 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_y 2023-11-30T23:14:14.328 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_z 2023-11-30T23:14:14.379 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Xattrs (147 ms) 2023-11-30T23:14:14.380 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Xattrs_ll 2023-11-30T23:14:14.422 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Xattrs_ll (43 ms) 2023-11-30T23:14:14.423 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LstatSlashdot 2023-11-30T23:14:14.460 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LstatSlashdot (35 ms) 2023-11-30T23:14:14.460 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.StatDirNlink 2023-11-30T23:14:14.543 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.StatDirNlink (85 ms) 2023-11-30T23:14:14.543 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.DoubleChmod 2023-11-30T23:14:14.600 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.DoubleChmod (58 ms) 2023-11-30T23:14:14.601 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Fchmod 2023-11-30T23:14:14.648 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Fchmod (47 ms) 2023-11-30T23:14:14.648 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Lchmod 2023-11-30T23:14:14.709 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Lchmod (61 ms) 2023-11-30T23:14:14.709 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Fchown 2023-11-30T23:14:14.759 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Fchown (50 ms) 2023-11-30T23:14:14.759 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.FlagO_PATH 2023-11-30T23:14:14.806 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.FlagO_PATH (47 ms) 2023-11-30T23:14:14.806 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Symlinks 2023-11-30T23:14:14.907 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Symlinks (101 ms) 2023-11-30T23:14:14.907 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.DirSyms 2023-11-30T23:14:14.983 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.DirSyms (76 ms) 2023-11-30T23:14:14.983 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LoopSyms 2023-11-30T23:14:15.029 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LoopSyms (46 ms) 2023-11-30T23:14:15.029 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.HardlinkNoOriginal 2023-11-30T23:14:15.171 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.HardlinkNoOriginal (142 ms) 2023-11-30T23:14:15.171 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.BadArgument 2023-11-30T23:14:15.224 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.BadArgument (53 ms) 2023-11-30T23:14:15.224 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.BadFileDesc 2023-11-30T23:14:15.259 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.BadFileDesc (35 ms) 2023-11-30T23:14:15.259 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ReadEmptyFile 2023-11-30T23:14:15.311 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ReadEmptyFile (53 ms) 2023-11-30T23:14:15.311 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.PreadvPwritev 2023-11-30T23:14:15.365 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.PreadvPwritev (53 ms) 2023-11-30T23:14:15.365 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LlreadvLlwritev 2023-11-30T23:14:15.421 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LlreadvLlwritev (56 ms) 2023-11-30T23:14:15.421 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.StripeUnitGran 2023-11-30T23:14:15.456 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.StripeUnitGran (35 ms) 2023-11-30T23:14:15.456 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Rename 2023-11-30T23:14:15.518 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Rename (62 ms) 2023-11-30T23:14:15.518 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.UseUnmounted 2023-11-30T23:14:15.531 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.UseUnmounted (13 ms) 2023-11-30T23:14:15.531 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.GetPoolId 2023-11-30T23:14:15.559 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.GetPoolId (28 ms) 2023-11-30T23:14:15.559 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.GetPoolReplication 2023-11-30T23:14:16.587 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.GetPoolReplication (1028 ms) 2023-11-30T23:14:16.587 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.GetExtentOsds 2023-11-30T23:14:16.634 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.GetExtentOsds (47 ms) 2023-11-30T23:14:16.634 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.GetOsdCrushLocation 2023-11-30T23:14:16.678 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.GetOsdCrushLocation (45 ms) 2023-11-30T23:14:16.678 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.GetOsdAddr 2023-11-30T23:14:16.715 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.GetOsdAddr (36 ms) 2023-11-30T23:14:16.715 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.OpenNoClose 2023-11-30T23:14:16.800 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.OpenNoClose (85 ms) 2023-11-30T23:14:16.800 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Nlink 2023-11-30T23:14:16.879 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Nlink (80 ms) 2023-11-30T23:14:16.880 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SlashDotDot 2023-11-30T23:14:18.931 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SlashDotDot (2051 ms) 2023-11-30T23:14:18.931 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Btime 2023-11-30T23:14:19.983 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Btime (1052 ms) 2023-11-30T23:14:19.983 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SetBtime 2023-11-30T23:14:20.032 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SetBtime (49 ms) 2023-11-30T23:14:20.032 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LazyStatx 2023-11-30T23:14:21.119 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LazyStatx (1088 ms) 2023-11-30T23:14:21.119 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ChangeAttr 2023-11-30T23:14:21.180 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ChangeAttr (60 ms) 2023-11-30T23:14:21.180 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.DirChangeAttrCreateFile 2023-11-30T23:14:21.286 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.DirChangeAttrCreateFile (107 ms) 2023-11-30T23:14:21.286 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.DirChangeAttrRenameFile 2023-11-30T23:14:21.391 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.DirChangeAttrRenameFile (104 ms) 2023-11-30T23:14:21.391 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.DirChangeAttrRemoveFile 2023-11-30T23:14:21.485 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.DirChangeAttrRemoveFile (94 ms) 2023-11-30T23:14:21.485 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SetSize 2023-11-30T23:14:21.518 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SetSize (31 ms) 2023-11-30T23:14:21.518 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.OperationsOnRoot 2023-11-30T23:14:21.551 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.OperationsOnRoot (36 ms) 2023-11-30T23:14:21.552 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ShutdownRace 2023-11-30T23:14:21.552 INFO:tasks.workunit.client.0.smithi073.stdout:Setting RLIMIT_NOFILE from 1024 to 16384 2023-11-30T23:14:21.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:14:21.913 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:14:51.972 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:14:51.974 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:14:52.517 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ShutdownRace (30965 ms) 2023-11-30T23:14:52.517 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.TestUtime 2023-11-30T23:14:52.577 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.TestUtime (60 ms) 2023-11-30T23:14:52.577 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.TestUtimes 2023-11-30T23:14:52.643 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.TestUtimes (66 ms) 2023-11-30T23:14:52.643 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.TestFutimens 2023-11-30T23:14:52.695 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.TestFutimens (52 ms) 2023-11-30T23:14:52.695 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.OperationsOnDotDot 2023-11-30T23:14:52.760 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.OperationsOnDotDot (65 ms) 2023-11-30T23:14:52.761 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Caps_vxattr 2023-11-30T23:14:52.807 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Caps_vxattr (48 ms) 2023-11-30T23:14:52.807 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapXattrs 2023-11-30T23:14:53.842 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapXattrs (1034 ms) 2023-11-30T23:14:53.842 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Lseek 2023-11-30T23:14:53.893 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Lseek (52 ms) 2023-11-30T23:14:53.894 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapInfoOnNonSnapshot 2023-11-30T23:14:53.931 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapInfoOnNonSnapshot (37 ms) 2023-11-30T23:14:53.931 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.EmptySnapInfo 2023-11-30T23:14:54.965 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.EmptySnapInfo (1034 ms) 2023-11-30T23:14:54.965 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapInfo 2023-11-30T23:14:56.000 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapInfo (1035 ms) 2023-11-30T23:14:56.000 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LookupInoMDSDir 2023-11-30T23:14:56.037 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LookupInoMDSDir (37 ms) 2023-11-30T23:14:56.037 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LookupVino 2023-11-30T23:14:58.151 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LookupVino (2114 ms) 2023-11-30T23:14:58.151 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Openat 2023-11-30T23:14:58.251 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Openat (101 ms) 2023-11-30T23:14:58.251 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Statxat 2023-11-30T23:14:58.369 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Statxat (117 ms) 2023-11-30T23:14:58.369 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.StatxatATFDCWD 2023-11-30T23:14:58.442 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.StatxatATFDCWD (73 ms) 2023-11-30T23:14:58.442 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Fdopendir 2023-11-30T23:14:58.527 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Fdopendir (82 ms) 2023-11-30T23:14:58.527 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.FdopendirATFDCWD 2023-11-30T23:14:58.601 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.FdopendirATFDCWD (74 ms) 2023-11-30T23:14:58.602 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.FdopendirReaddirTestWithDelete 2023-11-30T23:14:58.673 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.FdopendirReaddirTestWithDelete (76 ms) 2023-11-30T23:14:58.674 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.FdopendirOnNonDir 2023-11-30T23:14:58.760 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.FdopendirOnNonDir (87 ms) 2023-11-30T23:14:58.761 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Mkdirat 2023-11-30T23:14:58.798 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Mkdirat (38 ms) 2023-11-30T23:14:58.799 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.MkdiratATFDCWD 2023-11-30T23:14:58.854 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.MkdiratATFDCWD (55 ms) 2023-11-30T23:14:58.854 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Readlinkat 2023-11-30T23:14:58.968 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Readlinkat (114 ms) 2023-11-30T23:14:58.968 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ReadlinkatATFDCWD 2023-11-30T23:14:59.051 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ReadlinkatATFDCWD (84 ms) 2023-11-30T23:14:59.052 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Symlinkat 2023-11-30T23:14:59.156 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Symlinkat (104 ms) 2023-11-30T23:14:59.156 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SymlinkatATFDCWD 2023-11-30T23:14:59.256 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SymlinkatATFDCWD (100 ms) 2023-11-30T23:14:59.256 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Unlinkat 2023-11-30T23:14:59.347 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Unlinkat (92 ms) 2023-11-30T23:14:59.348 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.UnlinkatATFDCWD 2023-11-30T23:14:59.434 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.UnlinkatATFDCWD (86 ms) 2023-11-30T23:14:59.434 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Chownat 2023-11-30T23:14:59.502 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Chownat (67 ms) 2023-11-30T23:14:59.502 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ChownatATFDCWD 2023-11-30T23:14:59.574 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ChownatATFDCWD (73 ms) 2023-11-30T23:14:59.574 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Chmodat 2023-11-30T23:14:59.667 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Chmodat (93 ms) 2023-11-30T23:14:59.667 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ChmodatATFDCWD 2023-11-30T23:14:59.757 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ChmodatATFDCWD (90 ms) 2023-11-30T23:14:59.757 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Utimensat 2023-11-30T23:15:00.937 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Utimensat (1180 ms) 2023-11-30T23:15:00.937 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.UtimensatATFDCWD 2023-11-30T23:15:05.916 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.UtimensatATFDCWD (4977 ms) 2023-11-30T23:15:05.916 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LookupMdsPrivateInos 2023-11-30T23:15:06.489 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LookupMdsPrivateInos (575 ms) 2023-11-30T23:15:06.489 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SetMountTimeoutPostMount 2023-11-30T23:15:07.517 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SetMountTimeoutPostMount (1028 ms) 2023-11-30T23:15:07.517 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SetMountTimeout 2023-11-30T23:15:08.551 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SetMountTimeout (1034 ms) 2023-11-30T23:15:08.551 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.FsCrypt 2023-11-30T23:15:09.615 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.FsCrypt (1064 ms) 2023-11-30T23:15:09.615 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapdirAttrs 2023-11-30T23:15:10.646 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapdirAttrs (1031 ms) 2023-11-30T23:15:10.646 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapCreate 2023-11-30T23:15:11.677 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapCreate (1031 ms) 2023-11-30T23:15:11.677 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapDelete 2023-11-30T23:15:12.710 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapDelete (1033 ms) 2023-11-30T23:15:12.710 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapRename 2023-11-30T23:15:13.743 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapRename (1034 ms) 2023-11-30T23:15:13.744 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ReaddirRCB 2023-11-30T23:15:13.834 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ReaddirRCB (91 ms) 2023-11-30T23:15:13.835 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.MulticlientSimple 2023-11-30T23:15:14.004 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.MulticlientSimple (170 ms) 2023-11-30T23:15:14.004 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.MulticlientHoleEOF 2023-11-30T23:15:14.104 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.MulticlientHoleEOF (100 ms) 2023-11-30T23:15:14.104 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.MulticlientRevokeCaps 2023-11-30T23:15:22.026 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:15:22.029 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:15:52.080 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:15:52.083 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:16:14.146 INFO:tasks.workunit.client.0.smithi073.stdout: Will run test for 60 seconds! 2023-11-30T23:16:14.146 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.MulticlientRevokeCaps (60041 ms) 2023-11-30T23:16:14.146 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.BasicLocking 2023-11-30T23:16:14.214 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.BasicLocking (69 ms) 2023-11-30T23:16:14.215 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ConcurrentLocking 2023-11-30T23:16:14.309 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ConcurrentLocking (95 ms) 2023-11-30T23:16:14.310 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ThreesomeLocking 2023-11-30T23:16:14.419 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ThreesomeLocking (109 ms) 2023-11-30T23:16:14.419 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.BasicRecordLocking 2023-11-30T23:16:14.492 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.BasicRecordLocking (73 ms) 2023-11-30T23:16:14.492 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ConcurrentRecordLocking 2023-11-30T23:16:14.584 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ConcurrentRecordLocking (92 ms) 2023-11-30T23:16:14.584 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ThreesomeRecordLocking 2023-11-30T23:16:14.686 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ThreesomeRecordLocking (102 ms) 2023-11-30T23:16:14.686 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.DelegMultiClient 2023-11-30T23:16:16.206 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.DelegMultiClient (1520 ms) 2023-11-30T23:16:16.206 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.DelegSingleClient 2023-11-30T23:16:16.424 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.DelegSingleClient (218 ms) 2023-11-30T23:16:16.424 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.DelegTimeout 2023-11-30T23:16:18.510 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.DelegTimeout (2086 ms) 2023-11-30T23:16:18.510 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.RecalledGetattr 2023-11-30T23:16:18.634 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.RecalledGetattr (125 ms) 2023-11-30T23:16:18.635 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LayoutVerifyDefaultLayout 2023-11-30T23:16:18.680 INFO:tasks.workunit.client.0.smithi073.stderr:layout:{"stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_name": "cephfs_data", "pool_id": 3, "pool_namespace": "", "inheritance": "@default"} 2023-11-30T23:16:18.717 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LayoutVerifyDefaultLayout (81 ms) 2023-11-30T23:16:18.717 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LayoutSetAndVerifyNewAndInheritedLayout 2023-11-30T23:16:18.767 INFO:tasks.workunit.client.0.smithi073.stderr:layout:{"stripe_unit": 65536, "stripe_count": 1, "object_size": 65536, "pool_name": "cephfs_data", "pool_id": 3, "pool_namespace": "", "inheritance": "@set"} 2023-11-30T23:16:18.768 INFO:tasks.workunit.client.0.smithi073.stderr:layout:{"stripe_unit": 65536, "stripe_count": 1, "object_size": 65536, "pool_name": "cephfs_data", "pool_id": 3, "pool_namespace": "", "inheritance": "@inherited"} 2023-11-30T23:16:18.807 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LayoutSetAndVerifyNewAndInheritedLayout (89 ms) 2023-11-30T23:16:18.807 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LayoutSetBadJSON 2023-11-30T23:16:18.881 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LayoutSetBadJSON (76 ms) 2023-11-30T23:16:18.881 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LayoutSetBadPoolName 2023-11-30T23:16:18.959 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LayoutSetBadPoolName (76 ms) 2023-11-30T23:16:18.959 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LayoutSetBadPoolId 2023-11-30T23:16:19.033 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LayoutSetBadPoolId (76 ms) 2023-11-30T23:16:19.033 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LayoutSetInvalidFieldName 2023-11-30T23:16:19.106 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LayoutSetInvalidFieldName (73 ms) 2023-11-30T23:16:19.106 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.GetAndSetDirPin 2023-11-30T23:16:19.181 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.GetAndSetDirPin (75 ms) 2023-11-30T23:16:19.181 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.GetAndSetDirDistribution 2023-11-30T23:16:19.257 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.GetAndSetDirDistribution (77 ms) 2023-11-30T23:16:19.257 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.GetAndSetDirRandom 2023-11-30T23:16:19.331 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.GetAndSetDirRandom (73 ms) 2023-11-30T23:16:19.331 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapDiffLib 2023-11-30T23:16:19.511 INFO:tasks.workunit.client.0.smithi073.stdout:16 vs. 17 2023-11-30T23:16:19.511 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 listing verification--------- 2023-11-30T23:16:20.896 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 listing verification--------- 2023-11-30T23:16:22.153 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:16:22.156 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:16:25.895 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing for / 2023-11-30T23:16:25.905 INFO:tasks.workunit.client.0.smithi073.stdout:dirB snap 17 2023-11-30T23:16:25.905 INFO:tasks.workunit.client.0.smithi073.stdout:fileB snap 17 2023-11-30T23:16:25.905 INFO:tasks.workunit.client.0.smithi073.stdout:fileC snap 16 2023-11-30T23:16:25.905 INFO:tasks.workunit.client.0.smithi073.stdout:fileA snap 17 2023-11-30T23:16:25.905 INFO:tasks.workunit.client.0.smithi073.stdout:dirC snap 16 2023-11-30T23:16:25.906 INFO:tasks.workunit.client.0.smithi073.stdout:dirD snap 17 2023-11-30T23:16:25.907 INFO:tasks.workunit.client.0.smithi073.stdout:dirA snap 17 2023-11-30T23:16:25.907 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for / 2023-11-30T23:16:25.920 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for /dirA 2023-11-30T23:16:25.928 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for /dirB 2023-11-30T23:16:25.939 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 vs. snap1 diff listing verification for /dirC 2023-11-30T23:16:25.951 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for /dirD 2023-11-30T23:16:25.961 INFO:tasks.workunit.client.0.smithi073.stdout:---------invalid snapdiff params, the same snaps--------- 2023-11-30T23:16:25.966 INFO:tasks.workunit.client.0.smithi073.stderr: Failed to readdir snapdiff, ret:-22 , snap2 vs. snap2 2023-11-30T23:16:25.966 INFO:tasks.workunit.client.0.smithi073.stdout:---------invalid snapdiff params, no snap_other --------- 2023-11-30T23:16:25.966 INFO:tasks.workunit.client.0.smithi073.stdout:------------- closing ------------- 2023-11-30T23:16:25.966 INFO:tasks.workunit.client.0.smithi073.stderr: Failed to open snapdiff, ret:-22 2023-11-30T23:16:26.412 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapDiffLib (7082 ms) 2023-11-30T23:16:26.412 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapDiffLib2 2023-11-30T23:16:26.672 INFO:tasks.workunit.client.0.smithi073.stdout:20 vs. 21 vs. 22 2023-11-30T23:16:26.672 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 listing verification--------- 2023-11-30T23:16:30.896 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 listing verification--------- 2023-11-30T23:16:35.899 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap3 listing verification--------- 2023-11-30T23:16:35.906 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 listing verification--------- 2023-11-30T23:16:35.917 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 listing verification--------- 2023-11-30T23:16:35.927 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap3 listing verification--------- 2023-11-30T23:16:35.935 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing for / 2023-11-30T23:16:35.944 INFO:tasks.workunit.client.0.smithi073.stdout:fileG snap 21 2023-11-30T23:16:35.945 INFO:tasks.workunit.client.0.smithi073.stdout:dirB snap 21 2023-11-30T23:16:35.946 INFO:tasks.workunit.client.0.smithi073.stdout:fileB snap 21 2023-11-30T23:16:35.946 INFO:tasks.workunit.client.0.smithi073.stdout:fileC snap 20 2023-11-30T23:16:35.946 INFO:tasks.workunit.client.0.smithi073.stdout:fileA snap 21 2023-11-30T23:16:35.946 INFO:tasks.workunit.client.0.smithi073.stdout:dirC snap 20 2023-11-30T23:16:35.949 INFO:tasks.workunit.client.0.smithi073.stdout:dirD snap 21 2023-11-30T23:16:35.950 INFO:tasks.workunit.client.0.smithi073.stdout:fileF snap 20 2023-11-30T23:16:35.950 INFO:tasks.workunit.client.0.smithi073.stdout:dirA snap 21 2023-11-30T23:16:35.950 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for / 2023-11-30T23:16:35.961 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 listing verification--------- 2023-11-30T23:16:35.971 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 listing verification--------- 2023-11-30T23:16:35.981 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap3 listing verification--------- 2023-11-30T23:16:35.990 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 vs. snap1 diff listing verification for / 2023-11-30T23:16:36.004 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 listing verification--------- 2023-11-30T23:16:36.014 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 listing verification--------- 2023-11-30T23:16:36.024 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap3 listing verification--------- 2023-11-30T23:16:36.032 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap3 diff listing verification for / 2023-11-30T23:16:36.045 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 vs. snap3 diff listing verification for / 2023-11-30T23:16:36.058 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 listing verification--------- 2023-11-30T23:16:36.067 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 listing verification--------- 2023-11-30T23:16:36.078 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap3 listing verification--------- 2023-11-30T23:16:36.087 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing for /dirA 2023-11-30T23:16:36.095 INFO:tasks.workunit.client.0.smithi073.stdout:fileA snap 21 2023-11-30T23:16:36.096 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for /dirA 2023-11-30T23:16:36.104 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing for /dirB 2023-11-30T23:16:36.115 INFO:tasks.workunit.client.0.smithi073.stdout:fileb snap 21 2023-11-30T23:16:36.115 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for /dirB 2023-11-30T23:16:36.127 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing for /dirD 2023-11-30T23:16:36.137 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for /dirD 2023-11-30T23:16:36.146 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 listing verification--------- 2023-11-30T23:16:36.156 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 listing verification--------- 2023-11-30T23:16:36.166 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap3 listing verification--------- 2023-11-30T23:16:36.173 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for / 2023-11-30T23:16:36.187 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap3 vs. snap2 diff listing verification for / 2023-11-30T23:16:36.200 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap3 diff listing verification for / 2023-11-30T23:16:36.214 INFO:tasks.workunit.client.0.smithi073.stdout:------------- closing ------------- 2023-11-30T23:16:36.501 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapDiffLib2 (10088 ms) 2023-11-30T23:16:36.501 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapDiffCases1_2 2023-11-30T23:16:37.193 INFO:tasks.workunit.client.0.smithi073.stdout:26 vs. 27 2023-11-30T23:16:37.193 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing for / 2023-11-30T23:16:37.203 INFO:tasks.workunit.client.0.smithi073.stdout:C snap 26 2023-11-30T23:16:37.204 INFO:tasks.workunit.client.0.smithi073.stdout:L snap 27 2023-11-30T23:16:37.205 INFO:tasks.workunit.client.0.smithi073.stdout:S snap 27 2023-11-30T23:16:37.206 INFO:tasks.workunit.client.0.smithi073.stdout:T snap 27 2023-11-30T23:16:37.206 INFO:tasks.workunit.client.0.smithi073.stdout:d snap 27 2023-11-30T23:16:37.207 INFO:tasks.workunit.client.0.smithi073.stdout:G snap 26 2023-11-30T23:16:37.207 INFO:tasks.workunit.client.0.smithi073.stdout:l snap 27 2023-11-30T23:16:37.208 INFO:tasks.workunit.client.0.smithi073.stdout:e snap 27 2023-11-30T23:16:37.208 INFO:tasks.workunit.client.0.smithi073.stdout:~e snap 27 2023-11-30T23:16:37.208 INFO:tasks.workunit.client.0.smithi073.stdout:g snap 26 2023-11-30T23:16:37.208 INFO:tasks.workunit.client.0.smithi073.stdout:c snap 26 2023-11-30T23:16:37.208 INFO:tasks.workunit.client.0.smithi073.stdout:b snap 27 2023-11-30T23:16:37.208 INFO:tasks.workunit.client.0.smithi073.stdout:f snap 27 2023-11-30T23:16:37.208 INFO:tasks.workunit.client.0.smithi073.stdout:I snap 27 2023-11-30T23:16:37.209 INFO:tasks.workunit.client.0.smithi073.stdout:K snap 27 2023-11-30T23:16:37.209 INFO:tasks.workunit.client.0.smithi073.stdout:k snap 27 2023-11-30T23:16:37.209 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for / 2023-11-30T23:16:37.225 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for /S 2023-11-30T23:16:37.236 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for /T 2023-11-30T23:16:37.248 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 vs. snap1 diff listing verification for /C 2023-11-30T23:16:37.261 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 vs. snap1 diff listing verification for /C/CC 2023-11-30T23:16:37.276 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for /I 2023-11-30T23:16:37.288 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for /I/J 2023-11-30T23:16:37.301 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for /L 2023-11-30T23:16:37.313 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for /L/LL 2023-11-30T23:16:37.325 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for /L/LN 2023-11-30T23:16:37.336 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for /L/LM 2023-11-30T23:16:37.348 INFO:tasks.workunit.client.0.smithi073.stdout:------------- 2023-11-30T23:16:38.566 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapDiffCases1_2 (2066 ms) 2023-11-30T23:16:38.567 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapDiffCases2_3 2023-11-30T23:16:39.295 INFO:tasks.workunit.client.0.smithi073.stdout:33 vs. 34 2023-11-30T23:16:39.295 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 vs. snap3 diff listing for / 2023-11-30T23:16:39.307 INFO:tasks.workunit.client.0.smithi073.stdout:H snap 34 2023-11-30T23:16:39.308 INFO:tasks.workunit.client.0.smithi073.stdout:L snap 34 2023-11-30T23:16:39.309 INFO:tasks.workunit.client.0.smithi073.stdout:S snap 34 2023-11-30T23:16:39.309 INFO:tasks.workunit.client.0.smithi073.stdout:ff snap 33 2023-11-30T23:16:39.310 INFO:tasks.workunit.client.0.smithi073.stdout:T snap 34 2023-11-30T23:16:39.310 INFO:tasks.workunit.client.0.smithi073.stdout:d snap 34 2023-11-30T23:16:39.312 INFO:tasks.workunit.client.0.smithi073.stdout:G snap 34 2023-11-30T23:16:39.312 INFO:tasks.workunit.client.0.smithi073.stdout:e snap 33 2023-11-30T23:16:39.312 INFO:tasks.workunit.client.0.smithi073.stdout:~e snap 33 2023-11-30T23:16:39.313 INFO:tasks.workunit.client.0.smithi073.stdout:g snap 34 2023-11-30T23:16:39.313 INFO:tasks.workunit.client.0.smithi073.stdout:b snap 34 2023-11-30T23:16:39.313 INFO:tasks.workunit.client.0.smithi073.stdout:f snap 33 2023-11-30T23:16:39.313 INFO:tasks.workunit.client.0.smithi073.stdout:I snap 34 2023-11-30T23:16:39.313 INFO:tasks.workunit.client.0.smithi073.stdout:a snap 34 2023-11-30T23:16:39.313 INFO:tasks.workunit.client.0.smithi073.stdout:K snap 33 2023-11-30T23:16:39.314 INFO:tasks.workunit.client.0.smithi073.stdout:k snap 33 2023-11-30T23:16:39.314 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 vs. snap3 diff listing verification for / 2023-11-30T23:16:39.327 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 vs. snap3 diff listing verification for /S 2023-11-30T23:16:39.337 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 vs. snap3 diff listing verification for /T 2023-11-30T23:16:39.347 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 vs. snap3 diff listing verification for /G 2023-11-30T23:16:39.360 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap3 vs. snap2 diff listing verification for /K 2023-11-30T23:16:39.374 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 vs. snap3 diff listing verification for /H 2023-11-30T23:16:39.386 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 vs. snap3 diff listing verification for /I 2023-11-30T23:16:39.397 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 vs. snap3 diff listing verification for /I/J 2023-11-30T23:16:39.409 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 vs. snap3 diff listing verification for /L 2023-11-30T23:16:39.422 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 vs. snap3 diff listing verification for /L/LL 2023-11-30T23:16:39.435 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap3 vs. snap2 diff listing verification for /L/LM 2023-11-30T23:16:39.450 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap2 vs. snap3 diff listing verification for /L/LN 2023-11-30T23:16:40.629 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapDiffCases2_3 (2062 ms) 2023-11-30T23:16:40.629 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapDiffCases1_3 2023-11-30T23:16:41.333 INFO:tasks.workunit.client.0.smithi073.stdout:38 vs. 40 2023-11-30T23:16:41.334 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap3 diff listing for / 2023-11-30T23:16:41.343 INFO:tasks.workunit.client.0.smithi073.stdout:C snap 38 2023-11-30T23:16:41.344 INFO:tasks.workunit.client.0.smithi073.stdout:H snap 40 2023-11-30T23:16:41.345 INFO:tasks.workunit.client.0.smithi073.stdout:L snap 40 2023-11-30T23:16:41.347 INFO:tasks.workunit.client.0.smithi073.stdout:S snap 40 2023-11-30T23:16:41.347 INFO:tasks.workunit.client.0.smithi073.stdout:ff snap 38 2023-11-30T23:16:41.347 INFO:tasks.workunit.client.0.smithi073.stdout:T snap 40 2023-11-30T23:16:41.347 INFO:tasks.workunit.client.0.smithi073.stdout:d snap 40 2023-11-30T23:16:41.347 INFO:tasks.workunit.client.0.smithi073.stdout:G snap 38 2023-11-30T23:16:41.348 INFO:tasks.workunit.client.0.smithi073.stdout:G snap 40 2023-11-30T23:16:41.348 INFO:tasks.workunit.client.0.smithi073.stdout:l snap 40 2023-11-30T23:16:41.348 INFO:tasks.workunit.client.0.smithi073.stdout:e snap 38 2023-11-30T23:16:41.348 INFO:tasks.workunit.client.0.smithi073.stdout:~e snap 38 2023-11-30T23:16:41.349 INFO:tasks.workunit.client.0.smithi073.stdout:g snap 40 2023-11-30T23:16:41.349 INFO:tasks.workunit.client.0.smithi073.stdout:c snap 38 2023-11-30T23:16:41.349 INFO:tasks.workunit.client.0.smithi073.stdout:b snap 40 2023-11-30T23:16:41.349 INFO:tasks.workunit.client.0.smithi073.stdout:f snap 38 2023-11-30T23:16:41.349 INFO:tasks.workunit.client.0.smithi073.stdout:I snap 40 2023-11-30T23:16:41.349 INFO:tasks.workunit.client.0.smithi073.stdout:a snap 40 2023-11-30T23:16:41.349 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap3 vs. snap1 diff listing verification for / 2023-11-30T23:16:41.363 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap3 vs. snap1 diff listing verification for /S 2023-11-30T23:16:41.371 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap3 vs. snap1 diff listing verification for /T 2023-11-30T23:16:41.382 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap3 vs. snap1 diff listing verification for /C 2023-11-30T23:16:41.392 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap3 vs. snap1 diff listing verification for /C/CC 2023-11-30T23:16:41.403 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap3 diff listing verification for /G 2023-11-30T23:16:41.410 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap3 vs. snap1 diff listing verification for /G 2023-11-30T23:16:41.417 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap3 diff listing verification for /H 2023-11-30T23:16:41.426 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap3 diff listing verification for /I 2023-11-30T23:16:41.434 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap3 diff listing verification for /I/J 2023-11-30T23:16:41.444 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap3 diff listing verification for /L 2023-11-30T23:16:41.452 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap3 diff listing verification for /L/LL 2023-11-30T23:16:41.462 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap3 diff listing verification for /L/LN 2023-11-30T23:16:41.474 INFO:tasks.workunit.client.0.smithi073.stdout:------------- 2023-11-30T23:16:42.711 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapDiffCases1_3 (2082 ms) 2023-11-30T23:16:42.711 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.HugeSnapDiffSmallDelta 2023-11-30T23:16:52.568 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:16:52.572 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:17:22.637 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:17:22.640 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:17:52.979 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:17:52.982 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:18:12.298 INFO:tasks.workunit.client.0.smithi073.stdout:Seeding 10000 files... 2023-11-30T23:18:12.299 INFO:tasks.workunit.client.0.smithi073.stdout:44 vs. 45 2023-11-30T23:18:12.299 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for / 2023-11-30T23:18:13.175 INFO:tasks.workunit.client.0.smithi073.stdout:------------- closing ------------- 2023-11-30T23:18:23.035 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:18:23.038 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:18:53.075 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:18:53.078 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:19:15.991 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.HugeSnapDiffSmallDelta (153280 ms) 2023-11-30T23:19:15.992 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.HugeSnapDiffLargeDelta 2023-11-30T23:19:23.123 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:19:23.126 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:19:53.661 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:19:53.663 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:20:23.715 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:20:23.718 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:20:53.772 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:20:53.775 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:21:23.845 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:21:23.848 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:21:53.940 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:21:53.943 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:22:23.986 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:22:23.990 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:22:54.034 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:22:54.037 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:23:24.081 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:23:24.083 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:23:54.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:23:54.161 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:24:24.234 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:24:24.237 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:24:48.613 INFO:tasks.workunit.client.0.smithi073.stdout:Seeding 15100 files... 2023-11-30T23:24:48.613 INFO:tasks.workunit.client.0.smithi073.stdout:48 vs. 49 2023-11-30T23:24:48.617 INFO:tasks.workunit.client.0.smithi073.stdout:---------snap1 vs. snap2 diff listing verification for / 2023-11-30T23:24:52.568 INFO:tasks.workunit.client.0.smithi073.stdout:------------- closing ------------- 2023-11-30T23:24:54.289 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:24:54.292 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:25:24.367 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:25:24.371 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:25:54.709 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:25:54.712 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:25:54.749 INFO:tasks.ceph.mds.b.smithi156.stderr:2023-11-30T23:25:54.742+0000 7fa7292e1700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42048) UID: 0 2023-11-30T23:26:25.510 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.HugeSnapDiffLargeDelta (429512 ms) 2023-11-30T23:26:25.510 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 124 tests from LibCephFS (744827 ms total) 2023-11-30T23:26:25.510 INFO:tasks.workunit.client.0.smithi073.stdout: 2023-11-30T23:26:25.510 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 1 test from Caps 2023-11-30T23:26:25.510 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] Caps.ReadZero 2023-11-30T23:26:26.101 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] Caps.ReadZero (594 ms) 2023-11-30T23:26:26.101 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 1 test from Caps (594 ms total) 2023-11-30T23:26:26.102 INFO:tasks.workunit.client.0.smithi073.stdout: 2023-11-30T23:26:26.102 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 5 tests from ACL 2023-11-30T23:26:26.102 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ACL.SetACL 2023-11-30T23:26:26.172 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ACL.SetACL (76 ms) 2023-11-30T23:26:26.173 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ACL.Chmod 2023-11-30T23:26:26.265 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ACL.Chmod (86 ms) 2023-11-30T23:26:26.265 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ACL.DefaultACL 2023-11-30T23:26:26.389 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ACL.DefaultACL (127 ms) 2023-11-30T23:26:26.389 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ACL.Disabled 2023-11-30T23:26:26.485 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ACL.Disabled (100 ms) 2023-11-30T23:26:26.485 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] ACL.SnapdirACL 2023-11-30T23:26:27.540 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] ACL.SnapdirACL (1046 ms) 2023-11-30T23:26:27.541 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 5 tests from ACL (1435 ms total) 2023-11-30T23:26:27.541 INFO:tasks.workunit.client.0.smithi073.stdout: 2023-11-30T23:26:27.541 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 3 tests from MonConfig 2023-11-30T23:26:27.541 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] MonConfig.MonAddrsMissing 2023-11-30T23:26:27.543 INFO:tasks.workunit.client.0.smithi073.stderr:failed to get an address for mon.a: error -2 2023-11-30T23:26:27.543 INFO:tasks.workunit.client.0.smithi073.stderr:failed to get an address for mon.b: error -2 2023-11-30T23:26:27.543 INFO:tasks.workunit.client.0.smithi073.stderr:failed to get an address for mon.c: error -2 2023-11-30T23:26:27.555 INFO:tasks.workunit.client.0.smithi073.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2023-11-30T23:26:27.556 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] MonConfig.MonAddrsMissing (24 ms) 2023-11-30T23:26:27.556 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] MonConfig.MonAddrsInConfigProxy 2023-11-30T23:26:28.595 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] MonConfig.MonAddrsInConfigProxy (1040 ms) 2023-11-30T23:26:28.595 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] MonConfig.MonAddrsInCct 2023-11-30T23:26:29.345 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-11-30T23:26:29.340+0000 7f291d3b2700 -1 calc_pg_upmaps abort due to max <= 0 2023-11-30T23:26:29.663 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] MonConfig.MonAddrsInCct (1067 ms) 2023-11-30T23:26:29.663 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 3 tests from MonConfig (2131 ms total) 2023-11-30T23:26:29.663 INFO:tasks.workunit.client.0.smithi073.stdout: 2023-11-30T23:26:29.663 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2023-11-30T23:26:29.663 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 133 tests from 4 test suites ran. (748987 ms total) 2023-11-30T23:26:29.663 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 133 tests. 2023-11-30T23:26:29.663 INFO:tasks.workunit.client.0.smithi073.stdout: 2023-11-30T23:26:29.663 INFO:tasks.workunit.client.0.smithi073.stdout: YOU HAVE 4 DISABLED TESTS 2023-11-30T23:26:29.663 INFO:tasks.workunit.client.0.smithi073.stdout: 2023-11-30T23:26:29.850 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] Running 98 tests from 2 test suites. 2023-11-30T23:26:29.850 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment set-up. 2023-11-30T23:26:29.850 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 94 tests from LibCephFS 2023-11-30T23:26:29.850 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.OpenEmptyComponent 2023-11-30T23:26:30.103 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.OpenEmptyComponent (253 ms) 2023-11-30T23:26:30.103 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.OpenReadTruncate 2023-11-30T23:26:30.947 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.OpenReadTruncate (845 ms) 2023-11-30T23:26:30.947 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.OpenReadWrite 2023-11-30T23:26:31.019 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.OpenReadWrite (70 ms) 2023-11-30T23:26:31.019 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.MountNonExist 2023-11-30T23:26:31.048 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.MountNonExist (31 ms) 2023-11-30T23:26:31.048 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.MountDouble 2023-11-30T23:26:31.089 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.MountDouble (41 ms) 2023-11-30T23:26:31.089 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.MountRemount 2023-11-30T23:26:31.166 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.MountRemount (74 ms) 2023-11-30T23:26:31.166 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.UnmountUnmounted 2023-11-30T23:26:31.174 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.UnmountUnmounted (11 ms) 2023-11-30T23:26:31.175 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ReleaseUnmounted 2023-11-30T23:26:31.185 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ReleaseUnmounted (10 ms) 2023-11-30T23:26:31.185 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ReleaseMounted 2023-11-30T23:26:31.216 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ReleaseMounted (31 ms) 2023-11-30T23:26:31.216 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.UnmountRelease 2023-11-30T23:26:31.257 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.UnmountRelease (40 ms) 2023-11-30T23:26:31.257 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Mount 2023-11-30T23:26:31.341 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Mount (86 ms) 2023-11-30T23:26:31.341 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.OpenLayout 2023-11-30T23:26:31.476 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.OpenLayout (135 ms) 2023-11-30T23:26:31.476 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.DirLs 2023-11-30T23:26:42.200 INFO:tasks.workunit.client.0.smithi073.stdout:rand: 1276 2023-11-30T23:26:42.200 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.DirLs (10723 ms) 2023-11-30T23:26:42.200 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ManyNestedDirs 2023-11-30T23:26:43.398 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ManyNestedDirs (1198 ms) 2023-11-30T23:26:43.398 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Xattrs 2023-11-30T23:26:43.502 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_a 2023-11-30T23:26:43.502 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_b 2023-11-30T23:26:43.502 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_c 2023-11-30T23:26:43.502 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_d 2023-11-30T23:26:43.503 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_e 2023-11-30T23:26:43.503 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_f 2023-11-30T23:26:43.503 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_g 2023-11-30T23:26:43.503 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_h 2023-11-30T23:26:43.503 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_i 2023-11-30T23:26:43.503 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_j 2023-11-30T23:26:43.507 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_k 2023-11-30T23:26:43.507 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_l 2023-11-30T23:26:43.507 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_m 2023-11-30T23:26:43.507 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_n 2023-11-30T23:26:43.507 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_o 2023-11-30T23:26:43.507 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_p 2023-11-30T23:26:43.508 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_q 2023-11-30T23:26:43.508 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_r 2023-11-30T23:26:43.508 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_s 2023-11-30T23:26:43.508 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_t 2023-11-30T23:26:43.508 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_u 2023-11-30T23:26:43.508 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_v 2023-11-30T23:26:43.508 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_w 2023-11-30T23:26:43.509 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_x 2023-11-30T23:26:43.509 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_y 2023-11-30T23:26:43.509 INFO:tasks.workunit.client.0.smithi073.stdout:getting attr user.test_xattr_z 2023-11-30T23:26:43.571 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Xattrs (172 ms) 2023-11-30T23:26:43.571 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Xattrs_ll 2023-11-30T23:26:43.615 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Xattrs_ll (44 ms) 2023-11-30T23:26:43.615 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LstatSlashdot 2023-11-30T23:26:43.650 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LstatSlashdot (36 ms) 2023-11-30T23:26:43.650 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.StatDirNlink 2023-11-30T23:26:43.739 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.StatDirNlink (89 ms) 2023-11-30T23:26:43.739 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.DoubleChmod 2023-11-30T23:26:43.801 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.DoubleChmod (60 ms) 2023-11-30T23:26:43.801 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Fchmod 2023-11-30T23:26:43.857 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Fchmod (59 ms) 2023-11-30T23:26:43.857 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Lchmod 2023-11-30T23:26:43.928 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Lchmod (71 ms) 2023-11-30T23:26:43.928 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Fchown 2023-11-30T23:26:43.981 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Fchown (52 ms) 2023-11-30T23:26:43.981 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.FlagO_PATH 2023-11-30T23:26:44.031 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.FlagO_PATH (50 ms) 2023-11-30T23:26:44.032 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Symlinks 2023-11-30T23:26:44.201 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Symlinks (170 ms) 2023-11-30T23:26:44.201 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.DirSyms 2023-11-30T23:26:44.409 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.DirSyms (208 ms) 2023-11-30T23:26:44.409 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LoopSyms 2023-11-30T23:26:44.485 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LoopSyms (77 ms) 2023-11-30T23:26:44.485 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.HardlinkNoOriginal 2023-11-30T23:26:44.720 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.HardlinkNoOriginal (234 ms) 2023-11-30T23:26:44.720 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.BadArgument 2023-11-30T23:26:44.766 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.BadArgument (46 ms) 2023-11-30T23:26:44.766 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.BadFileDesc 2023-11-30T23:26:44.801 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.BadFileDesc (35 ms) 2023-11-30T23:26:44.801 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ReadEmptyFile 2023-11-30T23:26:44.852 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ReadEmptyFile (51 ms) 2023-11-30T23:26:44.852 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.PreadvPwritev 2023-11-30T23:26:44.907 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.PreadvPwritev (55 ms) 2023-11-30T23:26:44.907 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LlreadvLlwritev 2023-11-30T23:26:44.961 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LlreadvLlwritev (54 ms) 2023-11-30T23:26:44.961 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.StripeUnitGran 2023-11-30T23:26:44.996 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.StripeUnitGran (36 ms) 2023-11-30T23:26:44.996 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Rename 2023-11-30T23:26:45.057 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Rename (60 ms) 2023-11-30T23:26:45.057 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.UseUnmounted 2023-11-30T23:26:45.072 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.UseUnmounted (16 ms) 2023-11-30T23:26:45.072 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.GetPoolId 2023-11-30T23:26:45.103 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.GetPoolId (30 ms) 2023-11-30T23:26:45.103 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.GetPoolReplication 2023-11-30T23:26:45.139 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.GetPoolReplication (36 ms) 2023-11-30T23:26:45.139 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.GetExtentOsds 2023-11-30T23:26:45.187 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.GetExtentOsds (49 ms) 2023-11-30T23:26:45.189 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.GetOsdCrushLocation 2023-11-30T23:26:45.232 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.GetOsdCrushLocation (44 ms) 2023-11-30T23:26:45.232 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.GetOsdAddr 2023-11-30T23:26:45.270 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.GetOsdAddr (37 ms) 2023-11-30T23:26:45.270 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.OpenNoClose 2023-11-30T23:26:45.455 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.OpenNoClose (182 ms) 2023-11-30T23:26:45.455 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Nlink 2023-11-30T23:26:45.593 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Nlink (135 ms) 2023-11-30T23:26:45.593 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SlashDotDot 2023-11-30T23:26:46.692 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SlashDotDot (1105 ms) 2023-11-30T23:26:46.692 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Btime 2023-11-30T23:26:47.750 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Btime (1057 ms) 2023-11-30T23:26:47.751 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SetBtime 2023-11-30T23:26:47.800 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SetBtime (51 ms) 2023-11-30T23:26:47.800 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LazyStatx 2023-11-30T23:26:48.888 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LazyStatx (1088 ms) 2023-11-30T23:26:48.888 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ChangeAttr 2023-11-30T23:26:48.953 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ChangeAttr (66 ms) 2023-11-30T23:26:48.954 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.DirChangeAttrCreateFile 2023-11-30T23:26:49.125 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.DirChangeAttrCreateFile (169 ms) 2023-11-30T23:26:49.125 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.DirChangeAttrRenameFile 2023-11-30T23:26:49.295 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.DirChangeAttrRenameFile (173 ms) 2023-11-30T23:26:49.295 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.DirChangeAttrRemoveFile 2023-11-30T23:26:49.477 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.DirChangeAttrRemoveFile (179 ms) 2023-11-30T23:26:49.477 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SetSize 2023-11-30T23:26:49.594 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SetSize (119 ms) 2023-11-30T23:26:49.594 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.OperationsOnRoot 2023-11-30T23:26:49.630 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.OperationsOnRoot (37 ms) 2023-11-30T23:26:49.631 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ShutdownRace 2023-11-30T23:26:49.631 INFO:tasks.workunit.client.0.smithi073.stdout:Setting RLIMIT_NOFILE from 1024 to 16384 2023-11-30T23:27:21.291 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ShutdownRace (31660 ms) 2023-11-30T23:27:21.291 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.TestUtime 2023-11-30T23:27:21.353 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.TestUtime (63 ms) 2023-11-30T23:27:21.353 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.TestUtimes 2023-11-30T23:27:21.426 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.TestUtimes (73 ms) 2023-11-30T23:27:21.427 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.TestFutimens 2023-11-30T23:27:21.491 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.TestFutimens (64 ms) 2023-11-30T23:27:21.491 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.OperationsOnDotDot 2023-11-30T23:27:21.561 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.OperationsOnDotDot (70 ms) 2023-11-30T23:27:21.561 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Caps_vxattr 2023-11-30T23:27:21.610 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Caps_vxattr (49 ms) 2023-11-30T23:27:21.610 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapXattrs 2023-11-30T23:27:22.641 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapXattrs (1031 ms) 2023-11-30T23:27:22.642 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Lseek 2023-11-30T23:27:22.702 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Lseek (62 ms) 2023-11-30T23:27:22.702 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapInfoOnNonSnapshot 2023-11-30T23:27:23.735 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapInfoOnNonSnapshot (1032 ms) 2023-11-30T23:27:23.735 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.EmptySnapInfo 2023-11-30T23:27:24.768 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.EmptySnapInfo (1033 ms) 2023-11-30T23:27:24.768 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapInfo 2023-11-30T23:27:25.798 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapInfo (1031 ms) 2023-11-30T23:27:25.798 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LookupInoMDSDir 2023-11-30T23:27:25.834 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LookupInoMDSDir (35 ms) 2023-11-30T23:27:25.834 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LookupVino 2023-11-30T23:27:28.028 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LookupVino (2195 ms) 2023-11-30T23:27:28.029 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Openat 2023-11-30T23:27:28.169 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Openat (140 ms) 2023-11-30T23:27:28.169 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Statxat 2023-11-30T23:27:28.365 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Statxat (191 ms) 2023-11-30T23:27:28.365 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.StatxatATFDCWD 2023-11-30T23:27:28.552 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.StatxatATFDCWD (192 ms) 2023-11-30T23:27:28.553 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Fdopendir 2023-11-30T23:27:28.717 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Fdopendir (160 ms) 2023-11-30T23:27:28.717 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.FdopendirATFDCWD 2023-11-30T23:27:28.929 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.FdopendirATFDCWD (216 ms) 2023-11-30T23:27:28.929 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.FdopendirReaddirTestWithDelete 2023-11-30T23:27:29.118 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.FdopendirReaddirTestWithDelete (189 ms) 2023-11-30T23:27:29.118 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.FdopendirOnNonDir 2023-11-30T23:27:29.324 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.FdopendirOnNonDir (207 ms) 2023-11-30T23:27:29.324 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Mkdirat 2023-11-30T23:27:29.445 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Mkdirat (121 ms) 2023-11-30T23:27:29.446 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.MkdiratATFDCWD 2023-11-30T23:27:29.512 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.MkdiratATFDCWD (66 ms) 2023-11-30T23:27:29.512 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Readlinkat 2023-11-30T23:27:29.685 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Readlinkat (173 ms) 2023-11-30T23:27:29.685 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ReadlinkatATFDCWD 2023-11-30T23:27:29.857 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ReadlinkatATFDCWD (172 ms) 2023-11-30T23:27:29.857 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Symlinkat 2023-11-30T23:27:30.042 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Symlinkat (185 ms) 2023-11-30T23:27:30.042 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SymlinkatATFDCWD 2023-11-30T23:27:30.205 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SymlinkatATFDCWD (158 ms) 2023-11-30T23:27:30.205 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Unlinkat 2023-11-30T23:27:30.403 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Unlinkat (204 ms) 2023-11-30T23:27:30.404 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.UnlinkatATFDCWD 2023-11-30T23:27:30.601 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.UnlinkatATFDCWD (198 ms) 2023-11-30T23:27:30.601 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Chownat 2023-11-30T23:27:30.816 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Chownat (215 ms) 2023-11-30T23:27:30.817 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ChownatATFDCWD 2023-11-30T23:27:30.977 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ChownatATFDCWD (156 ms) 2023-11-30T23:27:30.977 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Chmodat 2023-11-30T23:27:31.161 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Chmodat (186 ms) 2023-11-30T23:27:31.161 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.ChmodatATFDCWD 2023-11-30T23:27:31.421 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.ChmodatATFDCWD (256 ms) 2023-11-30T23:27:31.421 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.Utimensat 2023-11-30T23:27:31.609 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.Utimensat (191 ms) 2023-11-30T23:27:31.609 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.UtimensatATFDCWD 2023-11-30T23:27:31.827 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.UtimensatATFDCWD (217 ms) 2023-11-30T23:27:31.828 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.LookupMdsPrivateInos 2023-11-30T23:27:32.417 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.LookupMdsPrivateInos (594 ms) 2023-11-30T23:27:32.418 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SetMountTimeoutPostMount 2023-11-30T23:27:33.456 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SetMountTimeoutPostMount (1038 ms) 2023-11-30T23:27:33.456 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SetMountTimeout 2023-11-30T23:27:34.489 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SetMountTimeout (1033 ms) 2023-11-30T23:27:34.489 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.FsCrypt 2023-11-30T23:27:35.563 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.FsCrypt (1073 ms) 2023-11-30T23:27:35.563 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapdirAttrs 2023-11-30T23:27:36.596 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapdirAttrs (1034 ms) 2023-11-30T23:27:36.597 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapCreate 2023-11-30T23:27:37.629 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapCreate (1032 ms) 2023-11-30T23:27:37.629 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapDelete 2023-11-30T23:27:38.671 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapDelete (1043 ms) 2023-11-30T23:27:38.671 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapRename 2023-11-30T23:27:39.708 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapRename (1036 ms) 2023-11-30T23:27:39.708 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 94 tests from LibCephFS (69858 ms total) 2023-11-30T23:27:39.708 INFO:tasks.workunit.client.0.smithi073.stdout: 2023-11-30T23:27:39.708 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 4 tests from AccessTest 2023-11-30T23:27:39.708 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] AccessTest.Foo 2023-11-30T23:27:39.757 INFO:tasks.workunit.client.0.smithi073.stdout:out: [{"entity":"client.libcephfs_foo_test.674695351","key":"AQBrGmllsbbFLBAAMMIip6aGcKZZu4UNYPF5pQ==","caps":{"mds":"allow rw","mon":"allow *","osd":"allow rw"}}] 2023-11-30T23:27:39.757 INFO:tasks.workunit.client.0.smithi073.stdout:key: AQBrGmllsbbFLBAAMMIip6aGcKZZu4UNYPF5pQ== 2023-11-30T23:27:39.806 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] AccessTest.Foo (98 ms) 2023-11-30T23:27:39.806 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] AccessTest.Path 2023-11-30T23:27:39.870 INFO:tasks.workunit.client.0.smithi073.stdout:out: [{"entity":"client.libcephfs_path_test.1891483012","key":"AQBrGmllgkFdMxAAFSV83mo+1up+LAf1bxovHg==","caps":{"mds":"allow r, allow rw path=/ceph_test_libcephfs_access.329950973","mon":"allow r","osd":"allow rwx"}}] 2023-11-30T23:27:39.870 INFO:tasks.workunit.client.0.smithi073.stdout:key: AQBrGmllgkFdMxAAFSV83mo+1up+LAf1bxovHg== 2023-11-30T23:27:41.157 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] AccessTest.Path (1347 ms) 2023-11-30T23:27:41.158 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] AccessTest.ReadOnly 2023-11-30T23:27:41.323 INFO:tasks.workunit.client.0.smithi073.stdout:out: [{"entity":"client.libcephfs_readonly_test.779896481","key":"AQBtGmllfvTUEhAANbauUjFWHPXTAqhJSGcTfQ==","caps":{"mds":"allow r","mon":"allow r","osd":"allow rw"}}] 2023-11-30T23:27:41.324 INFO:tasks.workunit.client.0.smithi073.stdout:key: AQBtGmllfvTUEhAANbauUjFWHPXTAqhJSGcTfQ== 2023-11-30T23:27:41.445 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] AccessTest.ReadOnly (293 ms) 2023-11-30T23:27:41.446 INFO:tasks.workunit.client.0.smithi073.stdout:[ RUN ] AccessTest.User 2023-11-30T23:27:41.578 INFO:tasks.workunit.client.0.smithi073.stdout:out: [{"entity":"client.libcephfs_user_test.2084850177","key":"AQBtGmlliX8RIhAAQOAKvom8CWRtAj8nnQ42AA==","caps":{"mds":"allow rw uid=123 gids=456,789","mon":"allow *","osd":"allow rw"}}] 2023-11-30T23:27:41.578 INFO:tasks.workunit.client.0.smithi073.stdout:key: AQBtGmlliX8RIhAAQOAKvom8CWRtAj8nnQ42AA== 2023-11-30T23:27:41.803 INFO:tasks.workunit.client.0.smithi073.stdout:[ OK ] AccessTest.User (358 ms) 2023-11-30T23:27:41.803 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] 4 tests from AccessTest (2096 ms total) 2023-11-30T23:27:41.803 INFO:tasks.workunit.client.0.smithi073.stdout: 2023-11-30T23:27:41.803 INFO:tasks.workunit.client.0.smithi073.stdout:[----------] Global test environment tear-down 2023-11-30T23:27:41.803 INFO:tasks.workunit.client.0.smithi073.stdout:[==========] 98 tests from 2 test suites ran. (71954 ms total) 2023-11-30T23:27:41.803 INFO:tasks.workunit.client.0.smithi073.stdout:[ PASSED ] 98 tests. 2023-11-30T23:27:41.847 DEBUG:teuthology.orchestra.run:got remote process result: 139 2023-11-30T23:27:41.848 INFO:tasks.workunit.client.0.smithi073.stderr:Segmentation fault (core dumped) 2023-11-30T23:27:41.848 INFO:tasks.workunit:Stopping ['libcephfs/test.sh'] on client.0... 2023-11-30T23:27:41.848 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-11-30T23:27:42.114 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test libcephfs/test.sh) on smithi073 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a6f82997ac57b70a895455dfed6256360a1e4c32 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' 2023-11-30T23:27:42.187 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7fcc23c315134363a51929320c92f144 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test libcephfs/test.sh) on smithi073 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a6f82997ac57b70a895455dfed6256360a1e4c32 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' 2023-11-30T23:27:42.189 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-11-30T23:27:42.200 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T23:27:42.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.318+0000 7f205bfff700 1 Processor -- start 2023-11-30T23:27:42.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.318+0000 7f205bfff700 1 -- start start 2023-11-30T23:27:42.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.318+0000 7f205bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f205c0b2710 0x7f205c0aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:42.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.318+0000 7f205bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f205c146a20 0x7f205c146e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:42.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.318+0000 7f205bfff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205c06f280 con 0x7f205c13cf00 2023-11-30T23:27:42.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.318+0000 7f205bfff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f205c06e5b0 con 0x7f205c0b2710 2023-11-30T23:27:42.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.318+0000 7f205bfff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0b2af0 con 0x7f205c146a20 2023-11-30T23:27:42.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.318+0000 7f205affd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f205c0b2710 0x7f205c0aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:42.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.318+0000 7f205affd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f205c0b2710 0x7f205c0aefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60704/0 (socket says 172.21.15.73:60704) 2023-11-30T23:27:42.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.318+0000 7f205affd700 1 -- 172.21.15.73:0/2172123562 learned_addr learned my addr 172.21.15.73:0/2172123562 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:42.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.318+0000 7f205a7fc700 1 --2- 172.21.15.73:0/2172123562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f205c146a20 0x7f205c146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:42.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.318+0000 7f2059ffb700 1 -- 172.21.15.73:0/2172123562 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642226688 0 0) 0x7f205c06f280 con 0x7f205c13cf00 2023-11-30T23:27:42.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.318+0000 7f2059ffb700 1 -- 172.21.15.73:0/2172123562 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20480035d0 con 0x7f205c13cf00 2023-11-30T23:27:42.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.318+0000 7f205affd700 1 -- 172.21.15.73:0/2172123562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f205c146a20 msgr2=0x7f205c146e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:42.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.318+0000 7f205affd700 1 --2- 172.21.15.73:0/2172123562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f205c146a20 0x7f205c146e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.318+0000 7f205affd700 1 -- 172.21.15.73:0/2172123562 >> v1:172.21.15.156:6789/0 conn(0x7f205c13cf00 legacy=0x7f205c13d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:42.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.322+0000 7f205affd700 1 -- 172.21.15.73:0/2172123562 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c1473a0 con 0x7f205c0b2710 2023-11-30T23:27:42.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.322+0000 7f205affd700 1 --2- 172.21.15.73:0/2172123562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205c0b2710 0x7f205c0aefa0 secure :-1 s=READY pgs=4206 cs=0 l=1 rev1=1 crypto rx=0x7f2044009910 tx=0x7f2044009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84520b803b9c2645 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:42.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.322+0000 7f2059ffb700 1 -- 172.21.15.73:0/2172123562 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2044011830 con 0x7f205c0b2710 2023-11-30T23:27:42.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.322+0000 7f2059ffb700 1 -- 172.21.15.73:0/2172123562 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2044011990 con 0x7f205c0b2710 2023-11-30T23:27:42.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.322+0000 7f2059ffb700 1 -- 172.21.15.73:0/2172123562 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2044011d00 con 0x7f205c0b2710 2023-11-30T23:27:42.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.322+0000 7f205bfff700 1 -- 172.21.15.73:0/2172123562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205c0b2710 msgr2=0x7f205c0aefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:42.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.322+0000 7f205bfff700 1 --2- 172.21.15.73:0/2172123562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205c0b2710 0x7f205c0aefa0 secure :-1 s=READY pgs=4206 cs=0 l=1 rev1=1 crypto rx=0x7f2044009910 tx=0x7f2044009c20 comp rx=0 tx=0).stop 2023-11-30T23:27:42.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.322+0000 7f205bfff700 1 -- 172.21.15.73:0/2172123562 shutdown_connections 2023-11-30T23:27:42.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.322+0000 7f205bfff700 1 --2- 172.21.15.73:0/2172123562 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f205c146a20 0x7f205c146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.322+0000 7f205bfff700 1 --2- 172.21.15.73:0/2172123562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205c0b2710 0x7f205c0aefa0 unknown :-1 s=CLOSED pgs=4206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.322+0000 7f205bfff700 1 -- 172.21.15.73:0/2172123562 >> 172.21.15.73:0/2172123562 conn(0x7f205c0b45a0 msgr2=0x7f205c0b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:42.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.322+0000 7f205bfff700 1 -- 172.21.15.73:0/2172123562 shutdown_connections 2023-11-30T23:27:42.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.322+0000 7f205bfff700 1 -- 172.21.15.73:0/2172123562 wait complete. 2023-11-30T23:27:42.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.322+0000 7f205bfff700 1 Processor -- start 2023-11-30T23:27:42.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.322+0000 7f205bfff700 1 -- start start 2023-11-30T23:27:42.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f205c0b2710 0x7f205c071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:42.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f205c13cf00 0x7f205c13c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:42.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205c146a20 0x7f205c1dec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:42.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205bfff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c06f730 con 0x7f205c146a20 2023-11-30T23:27:42.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205bfff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c140c60 con 0x7f205c13cf00 2023-11-30T23:27:42.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205bfff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c06f980 con 0x7f205c0b2710 2023-11-30T23:27:42.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205c146a20 0x7f205c1dec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:42.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205a7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f205c13cf00 0x7f205c13c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:42.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205c146a20 0x7f205c1dec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60706/0 (socket says 172.21.15.73:60706) 2023-11-30T23:27:42.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205b7fe700 1 -- 172.21.15.73:0/3009102600 learned_addr learned my addr 172.21.15.73:0/3009102600 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:42.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205affd700 1 --2- 172.21.15.73:0/3009102600 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f205c0b2710 0x7f205c071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:42.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205b7fe700 1 -- 172.21.15.73:0/3009102600 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f205c0b2710 msgr2=0x7f205c071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:42.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205b7fe700 1 --2- 172.21.15.73:0/3009102600 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f205c0b2710 0x7f205c071db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205b7fe700 1 -- 172.21.15.73:0/3009102600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f205c13cf00 msgr2=0x7f205c13c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:42.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205b7fe700 1 --2- 172.21.15.73:0/3009102600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f205c13cf00 0x7f205c13c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205b7fe700 1 -- 172.21.15.73:0/3009102600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2044009570 con 0x7f205c146a20 2023-11-30T23:27:42.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205b7fe700 1 --2- 172.21.15.73:0/3009102600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205c146a20 0x7f205c1dec20 secure :-1 s=READY pgs=4207 cs=0 l=1 rev1=1 crypto rx=0x7f204c00c490 tx=0x7f204c00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:42.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f20537fe700 1 -- 172.21.15.73:0/3009102600 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c0052d0 con 0x7f205c146a20 2023-11-30T23:27:42.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f20537fe700 1 -- 172.21.15.73:0/3009102600 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204c005450 con 0x7f205c146a20 2023-11-30T23:27:42.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205bfff700 1 -- 172.21.15.73:0/3009102600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f205c06fc60 con 0x7f205c146a20 2023-11-30T23:27:42.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f20537fe700 1 -- 172.21.15.73:0/3009102600 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c0038e0 con 0x7f205c146a20 2023-11-30T23:27:42.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205bfff700 1 -- 172.21.15.73:0/3009102600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f205c0ac960 con 0x7f205c146a20 2023-11-30T23:27:42.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.326+0000 7f205bfff700 1 -- 172.21.15.73:0/3009102600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f205c06fea0 con 0x7f205c146a20 2023-11-30T23:27:42.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.330+0000 7f20537fe700 1 -- 172.21.15.73:0/3009102600 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f204c003a40 con 0x7f205c146a20 2023-11-30T23:27:42.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.330+0000 7f20537fe700 1 --2- 172.21.15.73:0/3009102600 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f203c065b00 0x7f203c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:42.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.330+0000 7f205affd700 1 --2- 172.21.15.73:0/3009102600 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f203c065b00 0x7f203c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:42.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.330+0000 7f20537fe700 1 -- 172.21.15.73:0/3009102600 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f204c082530 con 0x7f205c146a20 2023-11-30T23:27:42.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.330+0000 7f205affd700 1 --2- 172.21.15.73:0/3009102600 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f203c065b00 0x7f203c067fc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2044009c60 tx=0x7f2044008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:42.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.338+0000 7f20537fe700 1 -- 172.21.15.73:0/3009102600 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f205c06fea0 con 0x7f205c146a20 2023-11-30T23:27:42.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.506+0000 7f205bfff700 1 -- 172.21.15.73:0/3009102600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f205c06fea0 con 0x7f205c146a20 2023-11-30T23:27:42.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.506+0000 7f20537fe700 1 -- 172.21.15.73:0/3009102600 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f205c06fea0 con 0x7f205c146a20 2023-11-30T23:27:42.512 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:27:42.513 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":48,"fsid":"a677cb6a-4a54-4567-a30d-f0fa4bc22b17","created":"2023-11-30T23:12:23.260968+0000","modified":"2023-11-30T23:27:40.419956+0000","last_up_change":"2023-11-30T23:12:33.649318+0000","last_in_change":"2023-11-30T23:12:25.326689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-30T23:12:34.413317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-30T23:12:45.403156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-30T23:12:46.475384+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":65,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbf1c93f-0775-4780-8524-cf25792d9aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36686},{"type":"v1","addr":"172.21.15.73:6817","nonce":36686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36686},{"type":"v1","addr":"172.21.15.73:6819","nonce":36686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36686},{"type":"v1","addr":"172.21.15.73:6823","nonce":36686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36686},{"type":"v1","addr":"172.21.15.73:6821","nonce":36686}]},"public_addr":"172.21.15.73:6817/36686","cluster_addr":"172.21.15.73:6819/36686","heartbeat_back_addr":"172.21.15.73:6823/36686","heartbeat_front_addr":"172.21.15.73:6821/36686","state":["exists","up"]},{"osd":1,"uuid":"9d9dd122-9a42-4588-a0d2-50d13b13eba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36687},{"type":"v1","addr":"172.21.15.73:6809","nonce":36687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":36687},{"type":"v1","addr":"172.21.15.73:6811","nonce":36687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36687},{"type":"v1","addr":"172.21.15.73:6815","nonce":36687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36687},{"type":"v1","addr":"172.21.15.73:6813","nonce":36687}]},"public_addr":"172.21.15.73:6809/36687","cluster_addr":"172.21.15.73:6811/36687","heartbeat_back_addr":"172.21.15.73:6815/36687","heartbeat_front_addr":"172.21.15.73:6813/36687","state":["exists","up"]},{"osd":2,"uuid":"68ff4f1e-ec45-42e0-bb83-fe03598e4940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36688},{"type":"v1","addr":"172.21.15.73:6825","nonce":36688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36688},{"type":"v1","addr":"172.21.15.73:6827","nonce":36688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36688},{"type":"v1","addr":"172.21.15.73:6831","nonce":36688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36688},{"type":"v1","addr":"172.21.15.73:6829","nonce":36688}]},"public_addr":"172.21.15.73:6825/36688","cluster_addr":"172.21.15.73:6827/36688","heartbeat_back_addr":"172.21.15.73:6831/36688","heartbeat_front_addr":"172.21.15.73:6829/36688","state":["exists","up"]},{"osd":3,"uuid":"e4b08c98-6a4d-4ec8-a245-59a35f70a16f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36685},{"type":"v1","addr":"172.21.15.73:6801","nonce":36685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36685},{"type":"v1","addr":"172.21.15.73:6803","nonce":36685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":36685},{"type":"v1","addr":"172.21.15.73:6807","nonce":36685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36685},{"type":"v1","addr":"172.21.15.73:6805","nonce":36685}]},"public_addr":"172.21.15.73:6801/36685","cluster_addr":"172.21.15.73:6803/36685","heartbeat_back_addr":"172.21.15.73:6807/36685","heartbeat_front_addr":"172.21.15.73:6805/36685","state":["exists","up"]},{"osd":4,"uuid":"d0922b0e-5170-474d-b270-ddb5adc858cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":36908},{"type":"v1","addr":"172.21.15.156:6801","nonce":36908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":36908},{"type":"v1","addr":"172.21.15.156:6803","nonce":36908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":36908},{"type":"v1","addr":"172.21.15.156:6807","nonce":36908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":36908},{"type":"v1","addr":"172.21.15.156:6805","nonce":36908}]},"public_addr":"172.21.15.156:6801/36908","cluster_addr":"172.21.15.156:6803/36908","heartbeat_back_addr":"172.21.15.156:6807/36908","heartbeat_front_addr":"172.21.15.156:6805/36908","state":["exists","up"]},{"osd":5,"uuid":"f2791a77-db25-479c-95d5-ea7f77458685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":36909},{"type":"v1","addr":"172.21.15.156:6809","nonce":36909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":36909},{"type":"v1","addr":"172.21.15.156:6811","nonce":36909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":36909},{"type":"v1","addr":"172.21.15.156:6815","nonce":36909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":36909},{"type":"v1","addr":"172.21.15.156:6813","nonce":36909}]},"public_addr":"172.21.15.156:6809/36909","cluster_addr":"172.21.15.156:6811/36909","heartbeat_back_addr":"172.21.15.156:6815/36909","heartbeat_front_addr":"172.21.15.156:6813/36909","state":["exists","up"]},{"osd":6,"uuid":"f86c2fe9-ec8b-406e-af26-5dc65c926382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":36910},{"type":"v1","addr":"172.21.15.156:6817","nonce":36910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":36910},{"type":"v1","addr":"172.21.15.156:6819","nonce":36910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":36910},{"type":"v1","addr":"172.21.15.156:6823","nonce":36910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":36910},{"type":"v1","addr":"172.21.15.156:6821","nonce":36910}]},"public_addr":"172.21.15.156:6817/36910","cluster_addr":"172.21.15.156:6819/36910","heartbeat_back_addr":"172.21.15.156:6823/36910","heartbeat_front_addr":"172.21.15.156:6821/36910","state":["exists","up"]},{"osd":7,"uuid":"56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":36911},{"type":"v1","addr":"172.21.15.156:6825","nonce":36911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":36911},{"type":"v1","addr":"172.21.15.156:6827","nonce":36911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":36911},{"type":"v1","addr":"172.21.15.156:6831","nonce":36911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":36911},{"type":"v1","addr":"172.21.15.156:6829","nonce":36911}]},"public_addr":"172.21.15.156:6825/36911","cluster_addr":"172.21.15.156:6827/36911","heartbeat_back_addr":"172.21.15.156:6831/36911","heartbeat_front_addr":"172.21.15.156:6829/36911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.597534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.505493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.811871+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.586741+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.366817+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.101605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.627496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.829046+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":60,"length":6}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":64,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T23:27:42.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.510+0000 7f205bfff700 1 -- 172.21.15.73:0/3009102600 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f203c065b00 msgr2=0x7f203c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:42.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.510+0000 7f205bfff700 1 --2- 172.21.15.73:0/3009102600 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f203c065b00 0x7f203c067fc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2044009c60 tx=0x7f2044008030 comp rx=0 tx=0).stop 2023-11-30T23:27:42.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.510+0000 7f205bfff700 1 -- 172.21.15.73:0/3009102600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205c146a20 msgr2=0x7f205c1dec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:42.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.510+0000 7f205bfff700 1 --2- 172.21.15.73:0/3009102600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205c146a20 0x7f205c1dec20 secure :-1 s=READY pgs=4207 cs=0 l=1 rev1=1 crypto rx=0x7f204c00c490 tx=0x7f204c00c7a0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.510+0000 7f205bfff700 1 -- 172.21.15.73:0/3009102600 shutdown_connections 2023-11-30T23:27:42.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.510+0000 7f205bfff700 1 --2- 172.21.15.73:0/3009102600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205c146a20 0x7f205c1dec20 unknown :-1 s=CLOSED pgs=4207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.510+0000 7f205bfff700 1 --2- 172.21.15.73:0/3009102600 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f203c065b00 0x7f203c067fc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.510+0000 7f205bfff700 1 --2- 172.21.15.73:0/3009102600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f205c13cf00 0x7f205c13c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.510+0000 7f205bfff700 1 --2- 172.21.15.73:0/3009102600 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f205c0b2710 0x7f205c071db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.510+0000 7f205bfff700 1 -- 172.21.15.73:0/3009102600 >> 172.21.15.73:0/3009102600 conn(0x7f205c0b45a0 msgr2=0x7f205c1cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:42.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.510+0000 7f205bfff700 1 -- 172.21.15.73:0/3009102600 shutdown_connections 2023-11-30T23:27:42.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.510+0000 7f205bfff700 1 -- 172.21.15.73:0/3009102600 wait complete. 2023-11-30T23:27:42.529 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-30T23:12:34.413317+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-30T23:12:45.403156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-30T23:12:46.475384+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 65, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-30T23:27:42.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-30T23:27:42.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.646+0000 7fed01c6c700 1 Processor -- start 2023-11-30T23:27:42.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.646+0000 7fed01c6c700 1 -- start start 2023-11-30T23:27:42.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.646+0000 7fed01c6c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fecfc0b4c30 0x7fecfc146830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:42.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.646+0000 7fed01c6c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecfc0b24c0 0x7fecfc0b1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:42.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.646+0000 7fed01c6c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecfc0b4140 con 0x7fecfc0b1cd0 2023-11-30T23:27:42.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.646+0000 7fed01c6c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecfc0b56f0 con 0x7fecfc0b4c30 2023-11-30T23:27:42.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.646+0000 7fed01c6c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0bceb0 con 0x7fecfc0b24c0 2023-11-30T23:27:42.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.646+0000 7fed0146b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fecfc0b1cd0 0x7fecfc149da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48452/0 (socket says 172.21.15.73:48452) 2023-11-30T23:27:42.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.646+0000 7fed0146b700 1 -- 172.21.15.73:0/2884701559 learned_addr learned my addr 172.21.15.73:0/2884701559 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:27:42.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.646+0000 7fed00c6a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fecfc0b4c30 0x7fecfc146830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:42.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.646+0000 7fecfbfff700 1 --2- 172.21.15.73:0/2884701559 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecfc0b24c0 0x7fecfc0b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:42.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.646+0000 7fecfb7fe700 1 -- 172.21.15.73:0/2884701559 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088335512 0 0) 0x7fecfc0b4140 con 0x7fecfc0b1cd0 2023-11-30T23:27:42.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.646+0000 7fecfb7fe700 1 -- 172.21.15.73:0/2884701559 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fece40035d0 con 0x7fecfc0b1cd0 2023-11-30T23:27:42.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.646+0000 7fed00c6a700 1 -- 172.21.15.73:0/2884701559 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecfc0b24c0 msgr2=0x7fecfc0b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:42.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.646+0000 7fed00c6a700 1 --2- 172.21.15.73:0/2884701559 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecfc0b24c0 0x7fecfc0b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.646+0000 7fed00c6a700 1 -- 172.21.15.73:0/2884701559 >> v1:172.21.15.73:6789/0 conn(0x7fecfc0b1cd0 legacy=0x7fecfc149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:42.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.646+0000 7fed00c6a700 1 -- 172.21.15.73:0/2884701559 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc0b3b30 con 0x7fecfc0b4c30 2023-11-30T23:27:42.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.650+0000 7fed00c6a700 1 --2- 172.21.15.73:0/2884701559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecfc0b4c30 0x7fecfc146830 secure :-1 s=READY pgs=4209 cs=0 l=1 rev1=1 crypto rx=0x7fecf0009850 tx=0x7fecf0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4901bd4d7e60b263 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:42.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.650+0000 7fecfb7fe700 1 -- 172.21.15.73:0/2884701559 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0011830 con 0x7fecfc0b4c30 2023-11-30T23:27:42.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.650+0000 7fecfb7fe700 1 -- 172.21.15.73:0/2884701559 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf0011990 con 0x7fecfc0b4c30 2023-11-30T23:27:42.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.650+0000 7fecfb7fe700 1 -- 172.21.15.73:0/2884701559 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0011d40 con 0x7fecfc0b4c30 2023-11-30T23:27:42.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.650+0000 7fed01c6c700 1 -- 172.21.15.73:0/2884701559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecfc0b4c30 msgr2=0x7fecfc146830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:42.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.650+0000 7fed01c6c700 1 --2- 172.21.15.73:0/2884701559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecfc0b4c30 0x7fecfc146830 secure :-1 s=READY pgs=4209 cs=0 l=1 rev1=1 crypto rx=0x7fecf0009850 tx=0x7fecf0009b60 comp rx=0 tx=0).stop 2023-11-30T23:27:42.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.650+0000 7fed01c6c700 1 -- 172.21.15.73:0/2884701559 shutdown_connections 2023-11-30T23:27:42.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.650+0000 7fed01c6c700 1 --2- 172.21.15.73:0/2884701559 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecfc0b24c0 0x7fecfc0b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.650+0000 7fed01c6c700 1 --2- 172.21.15.73:0/2884701559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecfc0b4c30 0x7fecfc146830 unknown :-1 s=CLOSED pgs=4209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.650+0000 7fed01c6c700 1 -- 172.21.15.73:0/2884701559 >> 172.21.15.73:0/2884701559 conn(0x7fecfc0bc030 msgr2=0x7fecfc0bc440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:42.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.650+0000 7fed01c6c700 1 -- 172.21.15.73:0/2884701559 shutdown_connections 2023-11-30T23:27:42.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.650+0000 7fed01c6c700 1 -- 172.21.15.73:0/2884701559 wait complete. 2023-11-30T23:27:42.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.650+0000 7fed01c6c700 1 Processor -- start 2023-11-30T23:27:42.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.650+0000 7fed01c6c700 1 -- start start 2023-11-30T23:27:42.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed01c6c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecfc0b1cd0 0x7fecfc149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:42.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed01c6c700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecfc0b24c0 0x7fecfc1db790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:42.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed01c6c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecfc0b4c30 0x7fecfc1ded80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:42.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed01c6c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0a91e0 con 0x7fecfc0b4c30 2023-11-30T23:27:42.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed01c6c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc148ab0 con 0x7fecfc0b1cd0 2023-11-30T23:27:42.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed01c6c700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc148d90 con 0x7fecfc0b24c0 2023-11-30T23:27:42.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed0146b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecfc0b4c30 0x7fecfc1ded80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:42.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed00c6a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecfc0b1cd0 0x7fecfc149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:42.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed00c6a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecfc0b1cd0 0x7fecfc149b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:54134/0 (socket says 172.21.15.73:54134) 2023-11-30T23:27:42.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed00c6a700 1 -- 172.21.15.73:0/2939167318 learned_addr learned my addr 172.21.15.73:0/2939167318 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:42.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fecfbfff700 1 --2- 172.21.15.73:0/2939167318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecfc0b24c0 0x7fecfc1db790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:42.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed0146b700 1 -- 172.21.15.73:0/2939167318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecfc0b24c0 msgr2=0x7fecfc1db790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:42.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed0146b700 1 --2- 172.21.15.73:0/2939167318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecfc0b24c0 0x7fecfc1db790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed0146b700 1 -- 172.21.15.73:0/2939167318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecfc0b1cd0 msgr2=0x7fecfc149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:42.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed0146b700 1 --2- 172.21.15.73:0/2939167318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecfc0b1cd0 0x7fecfc149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed0146b700 1 -- 172.21.15.73:0/2939167318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf00094b0 con 0x7fecfc0b4c30 2023-11-30T23:27:42.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed0146b700 1 --2- 172.21.15.73:0/2939167318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecfc0b4c30 0x7fecfc1ded80 secure :-1 s=READY pgs=4210 cs=0 l=1 rev1=1 crypto rx=0x7fecf400ca80 tx=0x7fecf400cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:42.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fecf97fa700 1 -- 172.21.15.73:0/2939167318 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4007480 con 0x7fecfc0b4c30 2023-11-30T23:27:42.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed01c6c700 1 -- 172.21.15.73:0/2939167318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecfc149070 con 0x7fecfc0b4c30 2023-11-30T23:27:42.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fecf97fa700 1 -- 172.21.15.73:0/2939167318 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf40075e0 con 0x7fecfc0b4c30 2023-11-30T23:27:42.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fecf97fa700 1 -- 172.21.15.73:0/2939167318 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4007950 con 0x7fecfc0b4c30 2023-11-30T23:27:42.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed01c6c700 1 -- 172.21.15.73:0/2939167318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecfc144490 con 0x7fecfc0b4c30 2023-11-30T23:27:42.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.654+0000 7fed01c6c700 1 -- 172.21.15.73:0/2939167318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecfc149290 con 0x7fecfc0b4c30 2023-11-30T23:27:42.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.658+0000 7fecf97fa700 1 -- 172.21.15.73:0/2939167318 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fecf401b3b0 con 0x7fecfc0b4c30 2023-11-30T23:27:42.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.658+0000 7fecf97fa700 1 --2- 172.21.15.73:0/2939167318 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fece8065b00 0x7fece8067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:42.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.658+0000 7fecf97fa700 1 -- 172.21.15.73:0/2939167318 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fecf40829f0 con 0x7fecfc0b4c30 2023-11-30T23:27:42.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.658+0000 7fed00c6a700 1 --2- 172.21.15.73:0/2939167318 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fece8065b00 0x7fece8067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:42.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.658+0000 7fed00c6a700 1 --2- 172.21.15.73:0/2939167318 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fece8065b00 0x7fece8067fc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fecf0000c00 tx=0x7fecf001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:42.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.666+0000 7fecf97fa700 1 -- 172.21.15.73:0/2939167318 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fecf40503c0 con 0x7fecfc0b4c30 2023-11-30T23:27:42.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.830+0000 7fed01c6c700 1 -- 172.21.15.73:0/2939167318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fecfc146d40 con 0x7fecfc0b4c30 2023-11-30T23:27:42.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.830+0000 7fecf97fa700 1 -- 172.21.15.73:0/2939167318 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7fecf40539e0 con 0x7fecfc0b4c30 2023-11-30T23:27:42.836 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-11-30T23:27:42.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.830+0000 7fed01c6c700 1 -- 172.21.15.73:0/2939167318 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fece8065b00 msgr2=0x7fece8067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:42.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.830+0000 7fed01c6c700 1 --2- 172.21.15.73:0/2939167318 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fece8065b00 0x7fece8067fc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fecf0000c00 tx=0x7fecf001c040 comp rx=0 tx=0).stop 2023-11-30T23:27:42.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.830+0000 7fed01c6c700 1 -- 172.21.15.73:0/2939167318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecfc0b4c30 msgr2=0x7fecfc1ded80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:42.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.830+0000 7fed01c6c700 1 --2- 172.21.15.73:0/2939167318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecfc0b4c30 0x7fecfc1ded80 secure :-1 s=READY pgs=4210 cs=0 l=1 rev1=1 crypto rx=0x7fecf400ca80 tx=0x7fecf400cab0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.830+0000 7fed01c6c700 1 -- 172.21.15.73:0/2939167318 shutdown_connections 2023-11-30T23:27:42.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.830+0000 7fed01c6c700 1 --2- 172.21.15.73:0/2939167318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecfc0b4c30 0x7fecfc1ded80 unknown :-1 s=CLOSED pgs=4210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.830+0000 7fed01c6c700 1 --2- 172.21.15.73:0/2939167318 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fecfc0b24c0 0x7fecfc1db790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.830+0000 7fed01c6c700 1 --2- 172.21.15.73:0/2939167318 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fece8065b00 0x7fece8067fc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.830+0000 7fed01c6c700 1 --2- 172.21.15.73:0/2939167318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecfc0b1cd0 0x7fecfc149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.830+0000 7fed01c6c700 1 -- 172.21.15.73:0/2939167318 >> 172.21.15.73:0/2939167318 conn(0x7fecfc0bc030 msgr2=0x7fecfc0bc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:42.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.834+0000 7fed01c6c700 1 -- 172.21.15.73:0/2939167318 shutdown_connections 2023-11-30T23:27:42.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.834+0000 7fed01c6c700 1 -- 172.21.15.73:0/2939167318 wait complete. 2023-11-30T23:27:42.850 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-30T23:27:42.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.966+0000 7f40facd6700 1 Processor -- start 2023-11-30T23:27:42.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.966+0000 7f40facd6700 1 -- start start 2023-11-30T23:27:42.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.966+0000 7f40facd6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f40f4140d60 0x7f40f406b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:42.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.966+0000 7f40facd6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f40b1210 con 0x7f40f4073380 2023-11-30T23:27:42.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.966+0000 7f40facd6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f4073760 con 0x7f40f4146910 2023-11-30T23:27:42.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.966+0000 7f40facd6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f40b1660 con 0x7f40f4140d60 2023-11-30T23:27:42.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.966+0000 7f40f9cd4700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f40f4073380 0x7f40f4140650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48462/0 (socket says 172.21.15.73:48462) 2023-11-30T23:27:42.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.966+0000 7f40f9cd4700 1 -- 172.21.15.73:0/545843189 learned_addr learned my addr 172.21.15.73:0/545843189 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:27:42.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.966+0000 7f40fa4d5700 1 --2- 172.21.15.73:0/545843189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f40f4140d60 0x7f40f406b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:42.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.966+0000 7f40fa4d5700 1 -- 172.21.15.73:0/545843189 >> v1:172.21.15.156:6789/0 conn(0x7f40f4146910 legacy=0x7f40f414bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:42.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.966+0000 7f40fa4d5700 1 -- 172.21.15.73:0/545843189 >> v1:172.21.15.73:6789/0 conn(0x7f40f4073380 legacy=0x7f40f4140650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:42.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.966+0000 7f40fa4d5700 1 -- 172.21.15.73:0/545843189 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f40b1870 con 0x7f40f4140d60 2023-11-30T23:27:42.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.966+0000 7f40f8cd2700 1 -- 172.21.15.73:0/545843189 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364333392 0 0) 0x7f40f40b1210 con 0x7f40f4073380 2023-11-30T23:27:42.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.966+0000 7f40fa4d5700 1 --2- 172.21.15.73:0/545843189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f40f4140d60 0x7f40f406b3b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009dc0 tx=0x7f40ec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff96f5ada15ee69b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:42.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.966+0000 7f40f8cd2700 1 -- 172.21.15.73:0/545843189 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec00e070 con 0x7f40f4140d60 2023-11-30T23:27:42.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.966+0000 7f40f8cd2700 1 -- 172.21.15.73:0/545843189 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ec00bad0 con 0x7f40f4140d60 2023-11-30T23:27:42.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.966+0000 7f40f8cd2700 1 -- 172.21.15.73:0/545843189 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec00be80 con 0x7f40f4140d60 2023-11-30T23:27:42.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.970+0000 7f40facd6700 1 -- 172.21.15.73:0/545843189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f40f4140d60 msgr2=0x7f40f406b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:42.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.970+0000 7f40facd6700 1 --2- 172.21.15.73:0/545843189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f40f4140d60 0x7f40f406b3b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009dc0 tx=0x7f40ec00b330 comp rx=0 tx=0).stop 2023-11-30T23:27:42.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.970+0000 7f40facd6700 1 -- 172.21.15.73:0/545843189 shutdown_connections 2023-11-30T23:27:42.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.970+0000 7f40facd6700 1 --2- 172.21.15.73:0/545843189 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f40f4140d60 0x7f40f406b3b0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.970+0000 7f40facd6700 1 -- 172.21.15.73:0/545843189 >> 172.21.15.73:0/545843189 conn(0x7f40f406a180 msgr2=0x7f40f406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:42.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.970+0000 7f40facd6700 1 -- 172.21.15.73:0/545843189 shutdown_connections 2023-11-30T23:27:42.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.970+0000 7f40facd6700 1 -- 172.21.15.73:0/545843189 wait complete. 2023-11-30T23:27:42.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.970+0000 7f40facd6700 1 Processor -- start 2023-11-30T23:27:42.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.970+0000 7f40facd6700 1 -- start start 2023-11-30T23:27:42.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40facd6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40f4073380 0x7f40f40a8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:42.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40facd6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40f4140d60 0x7f40f41d9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:42.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40facd6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f40f4146910 0x7f40f41da360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:42.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40facd6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f41d9960 con 0x7f40f4073380 2023-11-30T23:27:42.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40facd6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f40aa140 con 0x7f40f4140d60 2023-11-30T23:27:42.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40facd6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f40aa420 con 0x7f40f4146910 2023-11-30T23:27:42.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40f9cd4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40f4073380 0x7f40f40a8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:42.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40f9cd4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40f4073380 0x7f40f40a8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60726/0 (socket says 172.21.15.73:60726) 2023-11-30T23:27:42.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40f9cd4700 1 -- 172.21.15.73:0/1963407381 learned_addr learned my addr 172.21.15.73:0/1963407381 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:42.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40f94d3700 1 --2- 172.21.15.73:0/1963407381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40f4140d60 0x7f40f41d9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:42.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40fa4d5700 1 --2- 172.21.15.73:0/1963407381 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f40f4146910 0x7f40f41da360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:42.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40fa4d5700 1 -- 172.21.15.73:0/1963407381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40f4140d60 msgr2=0x7f40f41d9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:42.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40fa4d5700 1 --2- 172.21.15.73:0/1963407381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40f4140d60 0x7f40f41d9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40fa4d5700 1 -- 172.21.15.73:0/1963407381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40f4073380 msgr2=0x7f40f40a8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:42.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40fa4d5700 1 --2- 172.21.15.73:0/1963407381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40f4073380 0x7f40f40a8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:42.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40fa4d5700 1 -- 172.21.15.73:0/1963407381 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec009a70 con 0x7f40f4146910 2023-11-30T23:27:42.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40f9cd4700 1 --2- 172.21.15.73:0/1963407381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40f4073380 0x7f40f40a8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:27:42.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40fa4d5700 1 --2- 172.21.15.73:0/1963407381 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f40f4146910 0x7f40f41da360 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f40ec015000 tx=0x7f40ec004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:42.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40ea7fc700 1 -- 172.21.15.73:0/1963407381 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec012430 con 0x7f40f4146910 2023-11-30T23:27:42.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40ea7fc700 1 -- 172.21.15.73:0/1963407381 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ec0125b0 con 0x7f40f4146910 2023-11-30T23:27:42.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40facd6700 1 -- 172.21.15.73:0/1963407381 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f4072100 con 0x7f40f4146910 2023-11-30T23:27:42.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40ea7fc700 1 -- 172.21.15.73:0/1963407381 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec012960 con 0x7f40f4146910 2023-11-30T23:27:42.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.974+0000 7f40facd6700 1 -- 172.21.15.73:0/1963407381 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f4071c60 con 0x7f40f4146910 2023-11-30T23:27:42.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.978+0000 7f40facd6700 1 -- 172.21.15.73:0/1963407381 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f406bd10 con 0x7f40f4146910 2023-11-30T23:27:42.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.978+0000 7f40ea7fc700 1 -- 172.21.15.73:0/1963407381 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f40ec012ac0 con 0x7f40f4146910 2023-11-30T23:27:42.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.978+0000 7f40ea7fc700 1 --2- 172.21.15.73:0/1963407381 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f40d8065ad0 0x7f40d8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:42.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.978+0000 7f40ea7fc700 1 -- 172.21.15.73:0/1963407381 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f40ec085570 con 0x7f40f4146910 2023-11-30T23:27:42.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.978+0000 7f40f9cd4700 1 --2- 172.21.15.73:0/1963407381 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f40d8065ad0 0x7f40d8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:42.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.978+0000 7f40f9cd4700 1 --2- 172.21.15.73:0/1963407381 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f40d8065ad0 0x7f40d8067f90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f40f0000f60 tx=0x7f40f0001960 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:42.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:42.990+0000 7f40ea7fc700 1 -- 172.21.15.73:0/1963407381 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f40ec053030 con 0x7f40f4146910 2023-11-30T23:27:43.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.158+0000 7f40facd6700 1 -- 172.21.15.73:0/1963407381 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f40f40681c0 con 0x7f40f4146910 2023-11-30T23:27:43.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.162+0000 7f40ea7fc700 1 -- 172.21.15.73:0/1963407381 <== mon.2 v2:172.21.15.156:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+11 (secure 0 0 0) 0x7f40ec009450 con 0x7f40f4146910 2023-11-30T23:27:43.166 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-11-30T23:27:43.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.166+0000 7f40facd6700 1 -- 172.21.15.73:0/1963407381 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f40d8065ad0 msgr2=0x7f40d8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:43.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.166+0000 7f40facd6700 1 --2- 172.21.15.73:0/1963407381 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f40d8065ad0 0x7f40d8067f90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f40f0000f60 tx=0x7f40f0001960 comp rx=0 tx=0).stop 2023-11-30T23:27:43.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.166+0000 7f40facd6700 1 -- 172.21.15.73:0/1963407381 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f40f4146910 msgr2=0x7f40f41da360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:43.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.166+0000 7f40facd6700 1 --2- 172.21.15.73:0/1963407381 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f40f4146910 0x7f40f41da360 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f40ec015000 tx=0x7f40ec004af0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.166+0000 7f40facd6700 1 -- 172.21.15.73:0/1963407381 shutdown_connections 2023-11-30T23:27:43.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.166+0000 7f40facd6700 1 --2- 172.21.15.73:0/1963407381 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f40f4146910 0x7f40f41da360 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.166+0000 7f40facd6700 1 --2- 172.21.15.73:0/1963407381 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f40d8065ad0 0x7f40d8067f90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.166+0000 7f40facd6700 1 --2- 172.21.15.73:0/1963407381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40f4140d60 0x7f40f41d9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.166+0000 7f40facd6700 1 --2- 172.21.15.73:0/1963407381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40f4073380 0x7f40f40a8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.166+0000 7f40facd6700 1 -- 172.21.15.73:0/1963407381 >> 172.21.15.73:0/1963407381 conn(0x7f40f406a180 msgr2=0x7f40f4143520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:43.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.166+0000 7f40facd6700 1 -- 172.21.15.73:0/1963407381 shutdown_connections 2023-11-30T23:27:43.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.166+0000 7f40facd6700 1 -- 172.21.15.73:0/1963407381 wait complete. 2023-11-30T23:27:43.186 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-30T23:27:43.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.290+0000 7f78a09ab700 1 Processor -- start 2023-11-30T23:27:43.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.290+0000 7f78a09ab700 1 -- start start 2023-11-30T23:27:43.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.290+0000 7f78a09ab700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f789c14a860 0x7f789c0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:43.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.290+0000 7f78a09ab700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789c0b4010 con 0x7f789c0bcb00 2023-11-30T23:27:43.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.290+0000 7f78a09ab700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789c0b6110 con 0x7f789c140550 2023-11-30T23:27:43.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.290+0000 7f78a09ab700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f789c0b4820 con 0x7f789c14a860 2023-11-30T23:27:43.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.290+0000 7f789b7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f789c0bcb00 0x7f789c14a150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48468/0 (socket says 172.21.15.73:48468) 2023-11-30T23:27:43.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.290+0000 7f789b7fe700 1 -- 172.21.15.73:0/3388757716 learned_addr learned my addr 172.21.15.73:0/3388757716 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:27:43.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.290+0000 7f789affd700 1 --2- 172.21.15.73:0/3388757716 >> v2:172.21.15.156:3300/0 conn(0x7f789c14a860 0x7f789c0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:43.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.290+0000 7f789a7fc700 1 -- 172.21.15.73:0/3388757716 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776447761 0 0) 0x7f789c0b6110 con 0x7f789c140550 2023-11-30T23:27:43.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.290+0000 7f789a7fc700 1 -- 172.21.15.73:0/3388757716 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78840035d0 con 0x7f789c140550 2023-11-30T23:27:43.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.290+0000 7f789a7fc700 1 -- 172.21.15.73:0/3388757716 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934093372 0 0) 0x7f789c0b4010 con 0x7f789c0bcb00 2023-11-30T23:27:43.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.290+0000 7f789a7fc700 1 -- 172.21.15.73:0/3388757716 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f789c0b6110 con 0x7f789c0bcb00 2023-11-30T23:27:43.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.290+0000 7f789affd700 1 -- 172.21.15.73:0/3388757716 >> v1:172.21.15.156:6789/0 conn(0x7f789c140550 legacy=0x7f789c1409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:43.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.290+0000 7f789affd700 1 -- 172.21.15.73:0/3388757716 >> v1:172.21.15.73:6789/0 conn(0x7f789c0bcb00 legacy=0x7f789c14a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:43.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.290+0000 7f789affd700 1 -- 172.21.15.73:0/3388757716 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c0bcee0 con 0x7f789c14a860 2023-11-30T23:27:43.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.290+0000 7f789affd700 1 --2- 172.21.15.73:0/3388757716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f789c14a860 0x7f789c0b5040 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f788c009850 tx=0x7f788c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=325fa0f9ff052d3c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:43.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.294+0000 7f789a7fc700 1 -- 172.21.15.73:0/3388757716 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c011830 con 0x7f789c14a860 2023-11-30T23:27:43.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.294+0000 7f789a7fc700 1 -- 172.21.15.73:0/3388757716 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c011990 con 0x7f789c14a860 2023-11-30T23:27:43.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.294+0000 7f789a7fc700 1 -- 172.21.15.73:0/3388757716 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c011d00 con 0x7f789c14a860 2023-11-30T23:27:43.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.294+0000 7f78a09ab700 1 -- 172.21.15.73:0/3388757716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f789c14a860 msgr2=0x7f789c0b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:43.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.294+0000 7f78a09ab700 1 --2- 172.21.15.73:0/3388757716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f789c14a860 0x7f789c0b5040 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f788c009850 tx=0x7f788c009b60 comp rx=0 tx=0).stop 2023-11-30T23:27:43.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.294+0000 7f78a09ab700 1 -- 172.21.15.73:0/3388757716 shutdown_connections 2023-11-30T23:27:43.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.294+0000 7f78a09ab700 1 --2- 172.21.15.73:0/3388757716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f789c14a860 0x7f789c0b5040 unknown :-1 s=CLOSED pgs=2348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.294+0000 7f78a09ab700 1 -- 172.21.15.73:0/3388757716 >> 172.21.15.73:0/3388757716 conn(0x7f789c071ff0 msgr2=0x7f789c0bc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:43.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.294+0000 7f78a09ab700 1 -- 172.21.15.73:0/3388757716 shutdown_connections 2023-11-30T23:27:43.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.294+0000 7f78a09ab700 1 -- 172.21.15.73:0/3388757716 wait complete. 2023-11-30T23:27:43.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.294+0000 7f78a09ab700 1 Processor -- start 2023-11-30T23:27:43.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.294+0000 7f78a09ab700 1 -- start start 2023-11-30T23:27:43.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f78a09ab700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f789c0bcb00 0x7f789c1457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:43.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f78a09ab700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f789c140550 0x7f789c146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:43.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f78a09ab700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f789c14a860 0x7f789c1d2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:43.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f78a09ab700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c1dc6d0 con 0x7f789c140550 2023-11-30T23:27:43.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f78a09ab700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c1dbe40 con 0x7f789c14a860 2023-11-30T23:27:43.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f78a09ab700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789c145ce0 con 0x7f789c0bcb00 2023-11-30T23:27:43.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f789affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f789c140550 0x7f789c146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:43.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f789affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f789c140550 0x7f789c146cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60730/0 (socket says 172.21.15.73:60730) 2023-11-30T23:27:43.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f789affd700 1 -- 172.21.15.73:0/1705622417 learned_addr learned my addr 172.21.15.73:0/1705622417 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:43.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f789b7fe700 1 --2- 172.21.15.73:0/1705622417 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f789c0bcb00 0x7f789c1457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:43.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f789bfff700 1 --2- 172.21.15.73:0/1705622417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f789c14a860 0x7f789c1d2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:43.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f789affd700 1 -- 172.21.15.73:0/1705622417 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f789c0bcb00 msgr2=0x7f789c1457a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:43.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f789affd700 1 --2- 172.21.15.73:0/1705622417 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f789c0bcb00 0x7f789c1457a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f789affd700 1 -- 172.21.15.73:0/1705622417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f789c14a860 msgr2=0x7f789c1d2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:43.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f789affd700 1 --2- 172.21.15.73:0/1705622417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f789c14a860 0x7f789c1d2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f789affd700 1 -- 172.21.15.73:0/1705622417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c0094b0 con 0x7f789c140550 2023-11-30T23:27:43.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f789affd700 1 --2- 172.21.15.73:0/1705622417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f789c140550 0x7f789c146cb0 secure :-1 s=READY pgs=4213 cs=0 l=1 rev1=1 crypto rx=0x7f789c0b7db0 tx=0x7f788c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:43.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f7883fff700 1 -- 172.21.15.73:0/1705622417 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c01a710 con 0x7f789c140550 2023-11-30T23:27:43.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f7883fff700 1 -- 172.21.15.73:0/1705622417 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c01f070 con 0x7f789c140550 2023-11-30T23:27:43.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f78a09ab700 1 -- 172.21.15.73:0/1705622417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f789c13b4b0 con 0x7f789c140550 2023-11-30T23:27:43.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f7883fff700 1 -- 172.21.15.73:0/1705622417 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c01aaf0 con 0x7f789c140550 2023-11-30T23:27:43.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.298+0000 7f78a09ab700 1 -- 172.21.15.73:0/1705622417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f789c1d06b0 con 0x7f789c140550 2023-11-30T23:27:43.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.302+0000 7f78a09ab700 1 -- 172.21.15.73:0/1705622417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f789c067d20 con 0x7f789c140550 2023-11-30T23:27:43.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.302+0000 7f7883fff700 1 -- 172.21.15.73:0/1705622417 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f788c021030 con 0x7f789c140550 2023-11-30T23:27:43.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.302+0000 7f7883fff700 1 --2- 172.21.15.73:0/1705622417 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7888065ad0 0x7f7888067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:43.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.302+0000 7f789b7fe700 1 --2- 172.21.15.73:0/1705622417 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7888065ad0 0x7f7888067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:43.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.302+0000 7f7883fff700 1 -- 172.21.15.73:0/1705622417 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f788c084360 con 0x7f789c140550 2023-11-30T23:27:43.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.302+0000 7f789b7fe700 1 --2- 172.21.15.73:0/1705622417 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7888065ad0 0x7f7888067f90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7890007fd0 tx=0x7f7890009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:43.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.310+0000 7f7883fff700 1 -- 172.21.15.73:0/1705622417 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f788c051c60 con 0x7f789c140550 2023-11-30T23:27:43.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.482+0000 7f78a09ab700 1 -- 172.21.15.73:0/1705622417 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f789c1dc810 con 0x7f789c140550 2023-11-30T23:27:43.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.482+0000 7f7883fff700 1 -- 172.21.15.73:0/1705622417 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) v1 ==== 100+0+11 (secure 0 0 0) 0x7f789c1dc810 con 0x7f789c140550 2023-11-30T23:27:43.488 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-11-30T23:27:43.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.486+0000 7f78a09ab700 1 -- 172.21.15.73:0/1705622417 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7888065ad0 msgr2=0x7f7888067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:43.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.486+0000 7f78a09ab700 1 --2- 172.21.15.73:0/1705622417 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7888065ad0 0x7f7888067f90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7890007fd0 tx=0x7f7890009040 comp rx=0 tx=0).stop 2023-11-30T23:27:43.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.486+0000 7f78a09ab700 1 -- 172.21.15.73:0/1705622417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f789c140550 msgr2=0x7f789c146cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:43.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.486+0000 7f78a09ab700 1 --2- 172.21.15.73:0/1705622417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f789c140550 0x7f789c146cb0 secure :-1 s=READY pgs=4213 cs=0 l=1 rev1=1 crypto rx=0x7f789c0b7db0 tx=0x7f788c004770 comp rx=0 tx=0).stop 2023-11-30T23:27:43.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.486+0000 7f78a09ab700 1 -- 172.21.15.73:0/1705622417 shutdown_connections 2023-11-30T23:27:43.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.486+0000 7f78a09ab700 1 --2- 172.21.15.73:0/1705622417 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7888065ad0 0x7f7888067f90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.486+0000 7f78a09ab700 1 --2- 172.21.15.73:0/1705622417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f789c14a860 0x7f789c1d2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.486+0000 7f78a09ab700 1 --2- 172.21.15.73:0/1705622417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f789c140550 0x7f789c146cb0 unknown :-1 s=CLOSED pgs=4213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.486+0000 7f78a09ab700 1 --2- 172.21.15.73:0/1705622417 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f789c0bcb00 0x7f789c1457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.486+0000 7f78a09ab700 1 -- 172.21.15.73:0/1705622417 >> 172.21.15.73:0/1705622417 conn(0x7f789c071ff0 msgr2=0x7f789c066490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:43.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.486+0000 7f78a09ab700 1 -- 172.21.15.73:0/1705622417 shutdown_connections 2023-11-30T23:27:43.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.486+0000 7f78a09ab700 1 -- 172.21.15.73:0/1705622417 wait complete. 2023-11-30T23:27:43.502 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-11-30T23:27:43.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd25d403700 1 Processor -- start 2023-11-30T23:27:43.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd25d403700 1 -- start start 2023-11-30T23:27:43.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd25d403700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd25806ed80 0x7fd2580b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:43.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd25d403700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd25806e050 0x7fd258071db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:43.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd25d403700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd2580722f0 0x7fd258147b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:43.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd25d403700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd258072780 con 0x7fd2580722f0 2023-11-30T23:27:43.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd25d403700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25813ecd0 con 0x7fd25806ed80 2023-11-30T23:27:43.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd25d403700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25806f160 con 0x7fd25806e050 2023-11-30T23:27:43.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd25cc02700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd2580722f0 0x7fd258147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:43.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd25cc02700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd2580722f0 0x7fd258147b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60740/0 (socket says 172.21.15.73:60740) 2023-11-30T23:27:43.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd25cc02700 1 -- 172.21.15.73:0/215061063 learned_addr learned my addr 172.21.15.73:0/215061063 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:43.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd2577fe700 1 --2- 172.21.15.73:0/215061063 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd25806e050 0x7fd258071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:43.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd257fff700 1 --2- 172.21.15.73:0/215061063 >> v2:172.21.15.156:3300/0 conn(0x7fd25806ed80 0x7fd2580b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:43.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd25cc02700 1 -- 172.21.15.73:0/215061063 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd25806e050 msgr2=0x7fd258071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:43.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd25cc02700 1 --2- 172.21.15.73:0/215061063 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd25806e050 0x7fd258071db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd25cc02700 1 -- 172.21.15.73:0/215061063 >> v2:172.21.15.156:3300/0 conn(0x7fd25806ed80 msgr2=0x7fd2580b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:43.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd25cc02700 1 --2- 172.21.15.73:0/215061063 >> v2:172.21.15.156:3300/0 conn(0x7fd25806ed80 0x7fd2580b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd25cc02700 1 -- 172.21.15.73:0/215061063 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2580b4340 con 0x7fd2580722f0 2023-11-30T23:27:43.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd25cc02700 1 --2- 172.21.15.73:0/215061063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2580722f0 0x7fd258147b80 secure :-1 s=READY pgs=4214 cs=0 l=1 rev1=1 crypto rx=0x7fd250009910 tx=0x7fd250009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d3dfbb02be1872 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:43.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd256ffd700 1 -- 172.21.15.73:0/215061063 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250011830 con 0x7fd2580722f0 2023-11-30T23:27:43.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd256ffd700 1 -- 172.21.15.73:0/215061063 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd250011990 con 0x7fd2580722f0 2023-11-30T23:27:43.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.606+0000 7fd256ffd700 1 -- 172.21.15.73:0/215061063 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250011d40 con 0x7fd2580722f0 2023-11-30T23:27:43.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25d403700 1 -- 172.21.15.73:0/215061063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2580722f0 msgr2=0x7fd258147b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:43.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25d403700 1 --2- 172.21.15.73:0/215061063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2580722f0 0x7fd258147b80 secure :-1 s=READY pgs=4214 cs=0 l=1 rev1=1 crypto rx=0x7fd250009910 tx=0x7fd250009c20 comp rx=0 tx=0).stop 2023-11-30T23:27:43.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25d403700 1 -- 172.21.15.73:0/215061063 shutdown_connections 2023-11-30T23:27:43.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25d403700 1 --2- 172.21.15.73:0/215061063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2580722f0 0x7fd258147b80 unknown :-1 s=CLOSED pgs=4214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25d403700 1 --2- 172.21.15.73:0/215061063 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd25806e050 0x7fd258071db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25d403700 1 --2- 172.21.15.73:0/215061063 >> v2:172.21.15.156:3300/0 conn(0x7fd25806ed80 0x7fd2580b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25d403700 1 -- 172.21.15.73:0/215061063 >> 172.21.15.73:0/215061063 conn(0x7fd2580b45a0 msgr2=0x7fd2580b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:43.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25d403700 1 -- 172.21.15.73:0/215061063 shutdown_connections 2023-11-30T23:27:43.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25d403700 1 -- 172.21.15.73:0/215061063 wait complete. 2023-11-30T23:27:43.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25d403700 1 Processor -- start 2023-11-30T23:27:43.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25d403700 1 -- start start 2023-11-30T23:27:43.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25d403700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd25806e050 0x7fd2581d9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:43.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25d403700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd25806ed80 0x7fd2580b8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:43.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25d403700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2580722f0 0x7fd2580b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:43.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25d403700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2580b6c20 con 0x7fd2580722f0 2023-11-30T23:27:43.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25d403700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2580b6220 con 0x7fd25806ed80 2023-11-30T23:27:43.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25d403700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2580b6f00 con 0x7fd25806e050 2023-11-30T23:27:43.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd257fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd25806e050 0x7fd2581d9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:43.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25cc02700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2580722f0 0x7fd2580b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:43.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd257fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd25806e050 0x7fd2581d9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:45694/0 (socket says 172.21.15.73:45694) 2023-11-30T23:27:43.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd257fff700 1 -- 172.21.15.73:0/3243739871 learned_addr learned my addr 172.21.15.73:0/3243739871 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:43.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd2577fe700 1 --2- 172.21.15.73:0/3243739871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd25806ed80 0x7fd2580b8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:43.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25cc02700 1 -- 172.21.15.73:0/3243739871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd25806e050 msgr2=0x7fd2581d9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:43.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25cc02700 1 --2- 172.21.15.73:0/3243739871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd25806e050 0x7fd2581d9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25cc02700 1 -- 172.21.15.73:0/3243739871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd25806ed80 msgr2=0x7fd2580b8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:43.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25cc02700 1 --2- 172.21.15.73:0/3243739871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd25806ed80 0x7fd2580b8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:43.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25cc02700 1 -- 172.21.15.73:0/3243739871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd250009570 con 0x7fd2580722f0 2023-11-30T23:27:43.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd25cc02700 1 --2- 172.21.15.73:0/3243739871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2580722f0 0x7fd2580b5ce0 secure :-1 s=READY pgs=4215 cs=0 l=1 rev1=1 crypto rx=0x7fd2580b1cc0 tx=0x7fd250004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:43.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd254ff9700 1 -- 172.21.15.73:0/3243739871 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250004240 con 0x7fd2580722f0 2023-11-30T23:27:43.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.610+0000 7fd254ff9700 1 -- 172.21.15.73:0/3243739871 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2500043a0 con 0x7fd2580722f0 2023-11-30T23:27:43.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.614+0000 7fd25d403700 1 -- 172.21.15.73:0/3243739871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2580b79b0 con 0x7fd2580722f0 2023-11-30T23:27:43.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.614+0000 7fd254ff9700 1 -- 172.21.15.73:0/3243739871 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25001d7c0 con 0x7fd2580722f0 2023-11-30T23:27:43.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.614+0000 7fd25d403700 1 -- 172.21.15.73:0/3243739871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2580b68d0 con 0x7fd2580722f0 2023-11-30T23:27:43.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.614+0000 7fd25d403700 1 -- 172.21.15.73:0/3243739871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2580b6d60 con 0x7fd2580722f0 2023-11-30T23:27:43.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.614+0000 7fd254ff9700 1 -- 172.21.15.73:0/3243739871 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd250025030 con 0x7fd2580722f0 2023-11-30T23:27:43.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.614+0000 7fd254ff9700 1 --2- 172.21.15.73:0/3243739871 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd238065b00 0x7fd238067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:43.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.614+0000 7fd257fff700 1 --2- 172.21.15.73:0/3243739871 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd238065b00 0x7fd238067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:43.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.614+0000 7fd254ff9700 1 -- 172.21.15.73:0/3243739871 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fd250088360 con 0x7fd2580722f0 2023-11-30T23:27:43.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.614+0000 7fd257fff700 1 --2- 172.21.15.73:0/3243739871 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd238065b00 0x7fd238067fc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd240009c30 tx=0x7fd240009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:43.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.622+0000 7fd254ff9700 1 -- 172.21.15.73:0/3243739871 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fd2580b6d60 con 0x7fd2580722f0 2023-11-30T23:27:43.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.826+0000 7fd25d403700 1 -- 172.21.15.73:0/3243739871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fd2580b6d60 con 0x7fd2580722f0 2023-11-30T23:27:43.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.838+0000 7fd254ff9700 1 -- 172.21.15.73:0/3243739871 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v5) v1 ==== 81+0+443814 (secure 0 0 0) 0x7fd2580b6d60 con 0x7fd2580722f0 2023-11-30T23:27:43.851 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:27:43.851 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-30T23:27:43.851 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 5, 2023-11-30T23:27:43.851 INFO:teuthology.orchestra.run.smithi073.stdout: "active_gid": 4104, 2023-11-30T23:27:43.851 INFO:teuthology.orchestra.run.smithi073.stdout: "active_name": "y", 2023-11-30T23:27:43.851 INFO:teuthology.orchestra.run.smithi073.stdout: "active_addrs": { 2023-11-30T23:27:43.852 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-11-30T23:27:43.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:43.852 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-11-30T23:27:43.852 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6832", 2023-11-30T23:27:43.852 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 36559 2023-11-30T23:27:43.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:43.852 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-11-30T23:27:43.852 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6833", 2023-11-30T23:27:43.853 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 36559 2023-11-30T23:27:43.853 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:43.853 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-30T23:27:43.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.853 INFO:teuthology.orchestra.run.smithi073.stdout: "active_addr": "172.21.15.73:6833/36559", 2023-11-30T23:27:43.853 INFO:teuthology.orchestra.run.smithi073.stdout: "active_change": "2023-11-30T23:12:28.331926+0000", 2023-11-30T23:27:43.853 INFO:teuthology.orchestra.run.smithi073.stdout: "active_mgr_features": 4540138322906710015, 2023-11-30T23:27:43.853 INFO:teuthology.orchestra.run.smithi073.stdout: "available": true, 2023-11-30T23:27:43.854 INFO:teuthology.orchestra.run.smithi073.stdout: "standbys": [ 2023-11-30T23:27:43.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:43.854 INFO:teuthology.orchestra.run.smithi073.stdout: "gid": 4105, 2023-11-30T23:27:43.854 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "x", 2023-11-30T23:27:43.854 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_features": 4540138322906710015, 2023-11-30T23:27:43.854 INFO:teuthology.orchestra.run.smithi073.stdout: "available_modules": [ 2023-11-30T23:27:43.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:43.854 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "alerts", 2023-11-30T23:27:43.854 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:43.855 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:43.855 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:43.855 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-11-30T23:27:43.855 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-11-30T23:27:43.855 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:43.855 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.855 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.855 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-11-30T23:27:43.856 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.856 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.856 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.856 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How frequently to reexamine health status", 2023-11-30T23:27:43.856 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.856 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.856 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.856 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:43.857 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:43.857 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.857 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.857 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.857 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:43.857 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.857 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.857 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:43.857 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:43.858 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:43.858 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:43.858 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:43.858 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:43.858 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:43.858 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:43.858 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:43.858 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.858 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.859 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.859 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:43.859 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:43.859 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.859 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.859 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.859 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:43.859 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.860 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.860 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.860 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:43.860 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.860 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.860 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.860 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:43.860 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:43.861 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.861 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.861 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.861 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:43.861 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.861 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.861 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:43.861 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:43.862 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:43.862 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:43.862 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:43.862 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:43.862 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:43.862 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:43.862 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:43.862 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.863 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.863 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.863 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:43.863 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:43.863 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.863 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.863 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.863 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:43.864 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.864 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.864 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.864 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:43.864 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.864 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.864 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.864 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_destination": { 2023-11-30T23:27:43.865 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_destination", 2023-11-30T23:27:43.865 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.865 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.865 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.865 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:43.865 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.865 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.865 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.866 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email address to send alerts to", 2023-11-30T23:27:43.866 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.866 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.866 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.866 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_from_name": { 2023-11-30T23:27:43.866 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_from_name", 2023-11-30T23:27:43.866 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.866 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.867 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.867 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "Ceph", 2023-11-30T23:27:43.867 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.867 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.867 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.867 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email From: name", 2023-11-30T23:27:43.867 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.867 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.868 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.868 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_host": { 2023-11-30T23:27:43.868 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_host", 2023-11-30T23:27:43.868 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.868 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.868 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.868 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:43.868 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.869 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.869 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.869 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP server", 2023-11-30T23:27:43.869 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.869 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.869 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.869 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_password": { 2023-11-30T23:27:43.870 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_password", 2023-11-30T23:27:43.870 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.870 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.870 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.870 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:43.870 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.870 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.870 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.871 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Password to authenticate with", 2023-11-30T23:27:43.871 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.871 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.871 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.871 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_port": { 2023-11-30T23:27:43.871 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_port", 2023-11-30T23:27:43.871 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:43.871 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.872 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.872 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "465", 2023-11-30T23:27:43.872 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.872 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.872 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.872 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP port", 2023-11-30T23:27:43.872 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.872 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.873 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.873 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_sender": { 2023-11-30T23:27:43.873 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_sender", 2023-11-30T23:27:43.873 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.873 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.873 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.873 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:43.873 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.874 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.874 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.874 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP envelope sender", 2023-11-30T23:27:43.874 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.874 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.874 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.875 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_ssl": { 2023-11-30T23:27:43.875 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_ssl", 2023-11-30T23:27:43.875 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.875 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.875 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.875 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:43.875 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.875 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.875 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.876 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use SSL to connect to SMTP server", 2023-11-30T23:27:43.876 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.876 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.876 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.876 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_user": { 2023-11-30T23:27:43.876 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_user", 2023-11-30T23:27:43.876 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.877 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.877 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.877 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:43.877 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.877 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.877 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.877 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "User to authenticate as", 2023-11-30T23:27:43.877 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.877 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "balancer", 2023-11-30T23:27:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:43.878 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: "active": { 2023-11-30T23:27:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "active", 2023-11-30T23:27:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.879 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically balance PGs across cluster", 2023-11-30T23:27:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_time": { 2023-11-30T23:27:43.880 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_time", 2023-11-30T23:27:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0000", 2023-11-30T23:27:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "beginning time of day to automatically balance", 2023-11-30T23:27:43.881 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-30T23:27:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_weekday": { 2023-11-30T23:27:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_weekday", 2023-11-30T23:27:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-11-30T23:27:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.882 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-11-30T23:27:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2023-11-30T23:27:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2023-11-30T23:27:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-11-30T23:27:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-11-30T23:27:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_max_iterations": { 2023-11-30T23:27:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_max_iterations", 2023-11-30T23:27:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-11-30T23:27:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "25", 2023-11-30T23:27:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-11-30T23:27:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "250", 2023-11-30T23:27:43.884 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-11-30T23:27:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_metrics": { 2023-11-30T23:27:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_metrics", 2023-11-30T23:27:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.885 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "pgs,objects,bytes", 2023-11-30T23:27:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-11-30T23:27:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-11-30T23:27:43.886 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_step": { 2023-11-30T23:27:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_step", 2023-11-30T23:27:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-11-30T23:27:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.5", 2023-11-30T23:27:43.887 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0.001", 2023-11-30T23:27:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "0.999", 2023-11-30T23:27:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "aggressiveness of optimization", 2023-11-30T23:27:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-11-30T23:27:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: "end_time": { 2023-11-30T23:27:43.888 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_time", 2023-11-30T23:27:43.889 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.889 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.889 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.889 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2359", 2023-11-30T23:27:43.889 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.889 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.889 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.889 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ending time of day to automatically balance", 2023-11-30T23:27:43.890 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-30T23:27:43.890 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.890 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.890 INFO:teuthology.orchestra.run.smithi073.stdout: "end_weekday": { 2023-11-30T23:27:43.890 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_weekday", 2023-11-30T23:27:43.890 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-11-30T23:27:43.890 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.890 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.891 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-11-30T23:27:43.891 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2023-11-30T23:27:43.891 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2023-11-30T23:27:43.891 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.891 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-11-30T23:27:43.891 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-11-30T23:27:43.891 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.891 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.892 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:43.892 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:43.892 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.892 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.892 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.892 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:43.892 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.892 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.893 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:43.893 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:43.893 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:43.893 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:43.893 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:43.893 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:43.894 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:43.894 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:43.894 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:43.894 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.894 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.894 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.894 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.895 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.896 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:43.896 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.896 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.896 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.896 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:43.896 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:43.896 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.897 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.897 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.897 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:43.897 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.897 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.897 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:43.897 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:43.897 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:43.897 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:43.898 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:43.898 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:43.898 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:43.898 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:43.898 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:43.898 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.898 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.898 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.899 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.900 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.900 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:43.900 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.900 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.900 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.900 INFO:teuthology.orchestra.run.smithi073.stdout: "min_score": { 2023-11-30T23:27:43.900 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_score", 2023-11-30T23:27:43.900 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-11-30T23:27:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-11-30T23:27:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-11-30T23:27:43.901 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2023-11-30T23:27:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2023-11-30T23:27:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.902 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "upmap", 2023-11-30T23:27:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-compat", 2023-11-30T23:27:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "none", 2023-11-30T23:27:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap" 2023-11-30T23:27:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:43.903 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Balancer mode", 2023-11-30T23:27:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_ids": { 2023-11-30T23:27:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_ids", 2023-11-30T23:27:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.904 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.905 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:43.905 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.905 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.905 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.905 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-11-30T23:27:43.905 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.905 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.905 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-11-30T23:27:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-11-30T23:27:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-11-30T23:27:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.906 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-11-30T23:27:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_deviation": { 2023-11-30T23:27:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_deviation", 2023-11-30T23:27:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-11-30T23:27:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-11-30T23:27:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "deviation below which no optimization is attempted", 2023-11-30T23:27:43.908 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-11-30T23:27:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_optimizations": { 2023-11-30T23:27:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_optimizations", 2023-11-30T23:27:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-11-30T23:27:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-11-30T23:27:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-11-30T23:27:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.910 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cephadm", 2023-11-30T23:27:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:43.911 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_down_multiplier": { 2023-11-30T23:27:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_down_multiplier", 2023-11-30T23:27:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-11-30T23:27:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2023-11-30T23:27:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.912 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-11-30T23:27:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_refresh_rate": { 2023-11-30T23:27:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_refresh_rate", 2023-11-30T23:27:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:43.913 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "20", 2023-11-30T23:27:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-11-30T23:27:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.914 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_starting_port": { 2023-11-30T23:27:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_starting_port", 2023-11-30T23:27:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.915 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4721", 2023-11-30T23:27:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-11-30T23:27:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_ptrace": { 2023-11-30T23:27:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_ptrace", 2023-11-30T23:27:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.917 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-11-30T23:27:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-11-30T23:27:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_interval": { 2023-11-30T23:27:43.918 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_interval", 2023-11-30T23:27:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-11-30T23:27:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to autotune daemon memory", 2023-11-30T23:27:43.919 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_memory_target_ratio": { 2023-11-30T23:27:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_memory_target_ratio", 2023-11-30T23:27:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-11-30T23:27:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.920 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.7", 2023-11-30T23:27:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-11-30T23:27:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: "cgroups_split": { 2023-11-30T23:27:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cgroups_split", 2023-11-30T23:27:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.922 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-11-30T23:27:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "config_checks_enabled": { 2023-11-30T23:27:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_checks_enabled", 2023-11-30T23:27:43.923 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-11-30T23:27:43.924 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "config_dashboard": { 2023-11-30T23:27:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_dashboard", 2023-11-30T23:27:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.925 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-11-30T23:27:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_alertmanager": { 2023-11-30T23:27:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_alertmanager", 2023-11-30T23:27:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-11-30T23:27:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.927 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-11-30T23:27:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_base": { 2023-11-30T23:27:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_base", 2023-11-30T23:27:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/ceph", 2023-11-30T23:27:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Container image name, without the tag", 2023-11-30T23:27:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.929 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_elasticsearch": { 2023-11-30T23:27:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_elasticsearch", 2023-11-30T23:27:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-11-30T23:27:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "elasticsearch container image", 2023-11-30T23:27:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_grafana": { 2023-11-30T23:27:43.931 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_grafana", 2023-11-30T23:27:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-11-30T23:27:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-11-30T23:27:43.932 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_haproxy": { 2023-11-30T23:27:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_haproxy", 2023-11-30T23:27:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.933 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-11-30T23:27:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "HAproxy container image", 2023-11-30T23:27:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.934 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_agent": { 2023-11-30T23:27:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_agent", 2023-11-30T23:27:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-11-30T23:27:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.935 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger agent container image", 2023-11-30T23:27:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_collector": { 2023-11-30T23:27:43.936 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_collector", 2023-11-30T23:27:43.937 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.937 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.937 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.937 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-11-30T23:27:43.937 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.937 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.937 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.937 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger collector container image", 2023-11-30T23:27:43.937 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_query": { 2023-11-30T23:27:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_query", 2023-11-30T23:27:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.938 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-11-30T23:27:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger query container image", 2023-11-30T23:27:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_keepalived": { 2023-11-30T23:27:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_keepalived", 2023-11-30T23:27:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-11-30T23:27:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.940 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.941 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.941 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Keepalived container image", 2023-11-30T23:27:43.941 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.941 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.941 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.941 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_loki": { 2023-11-30T23:27:43.941 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_loki", 2023-11-30T23:27:43.941 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-11-30T23:27:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Loki container image", 2023-11-30T23:27:43.942 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_node_exporter": { 2023-11-30T23:27:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_node_exporter", 2023-11-30T23:27:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.943 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-11-30T23:27:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-11-30T23:27:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.944 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_nvmeof": { 2023-11-30T23:27:43.945 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_nvmeof", 2023-11-30T23:27:43.945 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.945 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.945 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.945 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.2", 2023-11-30T23:27:43.945 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.945 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.945 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.945 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Nvme-of container image", 2023-11-30T23:27:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_prometheus": { 2023-11-30T23:27:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_prometheus", 2023-11-30T23:27:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.946 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-11-30T23:27:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-11-30T23:27:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.947 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_promtail": { 2023-11-30T23:27:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_promtail", 2023-11-30T23:27:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-11-30T23:27:43.948 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Promtail container image", 2023-11-30T23:27:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_snmp_gateway": { 2023-11-30T23:27:43.949 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_snmp_gateway", 2023-11-30T23:27:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-11-30T23:27:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.950 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SNMP Gateway container image", 2023-11-30T23:27:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: "container_init": { 2023-11-30T23:27:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_init", 2023-11-30T23:27:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.951 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Run podman/docker with `--init`", 2023-11-30T23:27:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: "daemon_cache_timeout": { 2023-11-30T23:27:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "daemon_cache_timeout", 2023-11-30T23:27:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-11-30T23:27:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.953 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-11-30T23:27:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: "default_cephadm_command_timeout": { 2023-11-30T23:27:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_cephadm_command_timeout", 2023-11-30T23:27:43.954 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "900", 2023-11-30T23:27:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-11-30T23:27:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.955 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "default_registry": { 2023-11-30T23:27:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_registry", 2023-11-30T23:27:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.956 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io", 2023-11-30T23:27:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-11-30T23:27:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.957 INFO:teuthology.orchestra.run.smithi073.stdout: "device_cache_timeout": { 2023-11-30T23:27:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_cache_timeout", 2023-11-30T23:27:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1800", 2023-11-30T23:27:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.958 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache device inventory", 2023-11-30T23:27:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "device_enhanced_scan": { 2023-11-30T23:27:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_enhanced_scan", 2023-11-30T23:27:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.959 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.960 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.960 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:43.960 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.960 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.960 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.960 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use libstoragemgmt during device scans", 2023-11-30T23:27:43.960 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.960 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.960 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.961 INFO:teuthology.orchestra.run.smithi073.stdout: "facts_cache_timeout": { 2023-11-30T23:27:43.961 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "facts_cache_timeout", 2023-11-30T23:27:43.961 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:43.961 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.961 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.961 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-11-30T23:27:43.961 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.961 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.962 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.962 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache host facts data", 2023-11-30T23:27:43.962 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.962 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.962 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.962 INFO:teuthology.orchestra.run.smithi073.stdout: "host_check_interval": { 2023-11-30T23:27:43.962 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "host_check_interval", 2023-11-30T23:27:43.962 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:43.963 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.963 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.963 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-11-30T23:27:43.963 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.963 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.963 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.963 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to perform a host check", 2023-11-30T23:27:43.963 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.964 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.964 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.964 INFO:teuthology.orchestra.run.smithi073.stdout: "inventory_list_all": { 2023-11-30T23:27:43.964 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "inventory_list_all", 2023-11-30T23:27:43.964 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.964 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.964 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.964 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:43.965 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.965 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.965 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.965 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-11-30T23:27:43.965 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.965 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.965 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.966 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:43.966 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:43.966 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.966 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.966 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.966 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:43.966 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.966 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.966 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:43.967 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:43.967 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:43.967 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:43.967 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:43.967 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:43.967 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:43.967 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:43.967 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:43.967 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.968 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.969 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.969 INFO:teuthology.orchestra.run.smithi073.stdout: "log_refresh_metadata": { 2023-11-30T23:27:43.969 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_refresh_metadata", 2023-11-30T23:27:43.969 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.970 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.970 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.970 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:43.970 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.970 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.970 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.970 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-11-30T23:27:43.970 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.970 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.971 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.971 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:43.971 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:43.971 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.971 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.971 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.971 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:43.972 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.972 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.972 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.972 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-11-30T23:27:43.972 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.972 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.972 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.972 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:43.973 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:43.973 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.973 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.973 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.973 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:43.973 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.973 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.973 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:43.974 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:43.974 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:43.974 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:43.974 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:43.974 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:43.974 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:43.974 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:43.974 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:43.974 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.975 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.975 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.975 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:43.975 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:43.975 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.975 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.975 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:43.975 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:43.976 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.976 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.976 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.976 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:43.976 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.976 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.976 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.976 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf": { 2023-11-30T23:27:43.977 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-11-30T23:27:43.977 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.977 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.977 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.977 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:43.977 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.977 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.977 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.978 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-11-30T23:27:43.978 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.978 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.978 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.978 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-11-30T23:27:43.978 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-11-30T23:27:43.978 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.979 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.979 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.979 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "*", 2023-11-30T23:27:43.979 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.979 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.979 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.979 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-11-30T23:27:43.979 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.979 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.980 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.980 INFO:teuthology.orchestra.run.smithi073.stdout: "max_count_per_host": { 2023-11-30T23:27:43.980 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_count_per_host", 2023-11-30T23:27:43.980 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:43.980 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.980 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.980 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-11-30T23:27:43.981 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.981 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.981 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.981 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of daemons per service per host", 2023-11-30T23:27:43.981 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.981 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.981 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.981 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd_draining_count": { 2023-11-30T23:27:43.982 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_osd_draining_count", 2023-11-30T23:27:43.982 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:43.982 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.982 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.982 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-11-30T23:27:43.982 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.982 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.982 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.983 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-11-30T23:27:43.983 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.983 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.983 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.983 INFO:teuthology.orchestra.run.smithi073.stdout: "migration_current": { 2023-11-30T23:27:43.983 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "migration_current", 2023-11-30T23:27:43.983 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:43.983 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.984 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.984 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:43.984 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.984 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.984 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.984 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "internal - do not modify", 2023-11-30T23:27:43.984 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.984 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.984 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.985 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2023-11-30T23:27:43.985 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2023-11-30T23:27:43.985 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.985 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.985 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.985 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "root", 2023-11-30T23:27:43.985 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.985 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.986 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:43.986 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm-package", 2023-11-30T23:27:43.986 INFO:teuthology.orchestra.run.smithi073.stdout: "root" 2023-11-30T23:27:43.986 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:43.986 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "mode for remote execution of cephadm", 2023-11-30T23:27:43.986 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.986 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.986 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.987 INFO:teuthology.orchestra.run.smithi073.stdout: "prometheus_alerts_path": { 2023-11-30T23:27:43.987 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus_alerts_path", 2023-11-30T23:27:43.987 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.987 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.987 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.987 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-11-30T23:27:43.987 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.987 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.988 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.988 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-11-30T23:27:43.988 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.988 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.988 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.988 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_insecure": { 2023-11-30T23:27:43.988 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_insecure", 2023-11-30T23:27:43.989 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.989 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.989 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.989 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:43.989 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.989 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.989 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.989 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-11-30T23:27:43.989 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.990 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.990 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.990 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_password": { 2023-11-30T23:27:43.990 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_password", 2023-11-30T23:27:43.990 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.990 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.990 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.990 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:43.991 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.991 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.991 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.991 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-11-30T23:27:43.991 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.991 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.991 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.991 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_url": { 2023-11-30T23:27:43.992 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_url", 2023-11-30T23:27:43.992 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.992 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.992 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.992 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:43.992 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.992 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.992 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.992 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-11-30T23:27:43.993 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.993 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.993 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.993 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_username": { 2023-11-30T23:27:43.993 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_username", 2023-11-30T23:27:43.993 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.994 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.994 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.994 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:43.994 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.994 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.994 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.994 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-11-30T23:27:43.994 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.995 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.995 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.995 INFO:teuthology.orchestra.run.smithi073.stdout: "secure_monitoring_stack": { 2023-11-30T23:27:43.995 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "secure_monitoring_stack", 2023-11-30T23:27:43.995 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:43.995 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.995 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.995 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:43.996 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.996 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.996 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.996 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-11-30T23:27:43.996 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.996 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.996 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.996 INFO:teuthology.orchestra.run.smithi073.stdout: "service_discovery_port": { 2023-11-30T23:27:43.997 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "service_discovery_port", 2023-11-30T23:27:43.997 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:43.997 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.997 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.997 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8765", 2023-11-30T23:27:43.997 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.997 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.997 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.998 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "cephadm service discovery port", 2023-11-30T23:27:43.998 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.998 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:43.998 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:43.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:43.998 INFO:teuthology.orchestra.run.smithi073.stdout: "ssh_config_file": { 2023-11-30T23:27:43.998 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssh_config_file", 2023-11-30T23:27:43.998 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:43.998 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:43.999 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:43.999 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:43.999 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:43.999 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:43.999 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:43.999 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-11-30T23:27:43.999 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:43.999 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.000 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.000 INFO:teuthology.orchestra.run.smithi073.stdout: "use_agent": { 2023-11-30T23:27:44.000 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_agent", 2023-11-30T23:27:44.000 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.000 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.000 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.000 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.000 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.001 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.001 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.001 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-11-30T23:27:44.001 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.001 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.001 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.001 INFO:teuthology.orchestra.run.smithi073.stdout: "use_repo_digest": { 2023-11-30T23:27:44.001 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_repo_digest", 2023-11-30T23:27:44.002 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.002 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.002 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.002 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.002 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.002 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.002 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.002 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-11-30T23:27:44.002 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.003 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.003 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.003 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_failed_host_check": { 2023-11-30T23:27:44.003 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_failed_host_check", 2023-11-30T23:27:44.003 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.003 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.003 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.004 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.004 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.004 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.004 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.004 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if the host check fails", 2023-11-30T23:27:44.004 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.004 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.004 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.005 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_daemons": { 2023-11-30T23:27:44.005 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_daemons", 2023-11-30T23:27:44.005 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.005 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.005 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.005 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.005 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.005 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.005 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.006 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-11-30T23:27:44.006 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.006 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.006 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.006 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_hosts": { 2023-11-30T23:27:44.006 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_hosts", 2023-11-30T23:27:44.006 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.006 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.007 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.007 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.007 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.007 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.007 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.007 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-11-30T23:27:44.007 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.007 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.008 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.008 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.008 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.008 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crash", 2023-11-30T23:27:44.008 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.008 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.008 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.009 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.009 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.009 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.009 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.009 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.009 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.009 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.009 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.010 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.010 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.010 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.010 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.010 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.010 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.010 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.010 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.010 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.011 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.011 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.011 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.011 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.011 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.011 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.011 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.012 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.012 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.012 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.012 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.012 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.012 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.012 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.012 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.012 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.013 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.013 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.013 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.013 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.013 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.013 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.013 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.013 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.014 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.014 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.014 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.014 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.014 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.014 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.014 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.014 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.015 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.015 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.015 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.015 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.015 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.015 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.015 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.015 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.016 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.016 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.016 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.016 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.016 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.016 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.016 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.016 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.016 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.017 INFO:teuthology.orchestra.run.smithi073.stdout: "retain_interval": { 2023-11-30T23:27:44.017 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retain_interval", 2023-11-30T23:27:44.017 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.017 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.017 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.017 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "31536000", 2023-11-30T23:27:44.017 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.017 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.018 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.018 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain crashes before pruning them", 2023-11-30T23:27:44.018 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.018 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.018 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.018 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_recent_interval": { 2023-11-30T23:27:44.018 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_recent_interval", 2023-11-30T23:27:44.019 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.019 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.019 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.019 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1209600", 2023-11-30T23:27:44.019 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.019 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.020 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.020 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "time interval in which to warn about recent crashes", 2023-11-30T23:27:44.020 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.020 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.020 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.020 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.020 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.021 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dashboard", 2023-11-30T23:27:44.021 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.021 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.021 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.021 INFO:teuthology.orchestra.run.smithi073.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-11-30T23:27:44.021 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-11-30T23:27:44.021 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.022 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.022 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.022 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-11-30T23:27:44.022 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.022 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.022 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.022 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.022 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_HOST": { 2023-11-30T23:27:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_HOST", 2023-11-30T23:27:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.023 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.024 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-11-30T23:27:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-11-30T23:27:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.025 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_ENABLED": { 2023-11-30T23:27:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_ENABLED", 2023-11-30T23:27:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.026 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-11-30T23:27:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-11-30T23:27:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "ENABLE_BROWSABLE_API": { 2023-11-30T23:27:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ENABLE_BROWSABLE_API", 2023-11-30T23:27:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.029 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.030 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-11-30T23:27:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-11-30T23:27:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.031 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.032 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-11-30T23:27:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-11-30T23:27:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.033 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-11-30T23:27:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-11-30T23:27:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.034 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.035 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-11-30T23:27:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-11-30T23:27:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.036 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_NFS": { 2023-11-30T23:27:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-11-30T23:27:44.037 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.038 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RBD": { 2023-11-30T23:27:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-11-30T23:27:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.039 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.040 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RGW": { 2023-11-30T23:27:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-11-30T23:27:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.041 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-11-30T23:27:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-11-30T23:27:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.042 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.043 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_PASSWORD": { 2023-11-30T23:27:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_PASSWORD", 2023-11-30T23:27:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-11-30T23:27:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-11-30T23:27:44.045 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-11-30T23:27:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.046 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_URL": { 2023-11-30T23:27:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_URL", 2023-11-30T23:27:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.047 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_USERNAME": { 2023-11-30T23:27:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_USERNAME", 2023-11-30T23:27:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-11-30T23:27:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.049 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-11-30T23:27:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-11-30T23:27:44.050 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.051 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.051 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.051 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.051 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.051 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.051 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.051 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.051 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.052 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.052 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.052 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-11-30T23:27:44.052 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-11-30T23:27:44.052 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.052 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.052 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.052 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.053 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.053 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.053 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.053 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.053 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.053 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.053 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-11-30T23:27:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-11-30T23:27:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.054 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "ISSUE_TRACKER_API_KEY": { 2023-11-30T23:27:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-11-30T23:27:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.055 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.056 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_HOST": { 2023-11-30T23:27:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_HOST", 2023-11-30T23:27:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.057 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.058 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.058 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.058 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.058 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.058 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.058 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-11-30T23:27:44.058 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-11-30T23:27:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.059 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-11-30T23:27:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-11-30T23:27:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.060 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-11-30T23:27:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-11-30T23:27:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.062 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-11-30T23:27:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-11-30T23:27:44.063 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.064 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-11-30T23:27:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-11-30T23:27:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.065 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-11-30T23:27:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-11-30T23:27:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-11-30T23:27:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-11-30T23:27:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.068 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-11-30T23:27:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-11-30T23:27:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.070 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_ENABLED": { 2023-11-30T23:27:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_ENABLED", 2023-11-30T23:27:44.071 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.072 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-11-30T23:27:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-11-30T23:27:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.073 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-11-30T23:27:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.074 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-11-30T23:27:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-11-30T23:27:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-11-30T23:27:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.075 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-11-30T23:27:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-11-30T23:27:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.076 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8", 2023-11-30T23:27:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.077 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "REST_REQUESTS_TIMEOUT": { 2023-11-30T23:27:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-11-30T23:27:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "45", 2023-11-30T23:27:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.078 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ACCESS_KEY": { 2023-11-30T23:27:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ACCESS_KEY", 2023-11-30T23:27:44.079 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.080 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-11-30T23:27:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-11-30T23:27:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.081 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-11-30T23:27:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SECRET_KEY": { 2023-11-30T23:27:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SECRET_KEY", 2023-11-30T23:27:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.083 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.084 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.084 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.084 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.084 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.084 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SSL_VERIFY": { 2023-11-30T23:27:44.084 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SSL_VERIFY", 2023-11-30T23:27:44.084 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.085 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.086 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.086 INFO:teuthology.orchestra.run.smithi073.stdout: "UNSAFE_TLS_v1_2": { 2023-11-30T23:27:44.086 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "UNSAFE_TLS_v1_2", 2023-11-30T23:27:44.086 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.086 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.086 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.086 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.086 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-11-30T23:27:44.087 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-11-30T23:27:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-11-30T23:27:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.088 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-11-30T23:27:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-11-30T23:27:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.089 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-11-30T23:27:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-11-30T23:27:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-11-30T23:27:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-11-30T23:27:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.091 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "cross_origin_url": { 2023-11-30T23:27:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cross_origin_url", 2023-11-30T23:27:44.092 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.093 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.093 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.093 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.093 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.093 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.093 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.093 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.093 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.093 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.094 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.094 INFO:teuthology.orchestra.run.smithi073.stdout: "crt_file": { 2023-11-30T23:27:44.094 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crt_file", 2023-11-30T23:27:44.094 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.094 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.094 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.094 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.095 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.095 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.095 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.095 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.095 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.095 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.095 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.095 INFO:teuthology.orchestra.run.smithi073.stdout: "debug": { 2023-11-30T23:27:44.096 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "debug", 2023-11-30T23:27:44.096 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.096 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.096 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.096 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.096 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.096 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.096 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.096 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable/disable debug options", 2023-11-30T23:27:44.097 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.097 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.097 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.097 INFO:teuthology.orchestra.run.smithi073.stdout: "jwt_token_ttl": { 2023-11-30T23:27:44.097 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "jwt_token_ttl", 2023-11-30T23:27:44.097 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.097 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.097 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.098 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "28800", 2023-11-30T23:27:44.098 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.098 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.098 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.098 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.098 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.098 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.098 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2023-11-30T23:27:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2023-11-30T23:27:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.099 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.100 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.100 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.100 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.100 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.100 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.100 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.100 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.100 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.101 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.101 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.101 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.101 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.101 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.101 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.101 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.101 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.101 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.102 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.102 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.102 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.102 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.102 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.102 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.102 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.102 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.103 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.103 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.103 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.103 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.103 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.103 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.103 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.103 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.103 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.104 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.104 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.104 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.104 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.104 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.104 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.104 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.105 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.105 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.105 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.105 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.105 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.105 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.105 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.105 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.105 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.106 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.106 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.106 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.106 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.106 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.106 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.106 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.106 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.107 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.107 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.107 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.107 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.107 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.107 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.107 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.107 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.108 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.108 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.108 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.108 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.108 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.108 INFO:teuthology.orchestra.run.smithi073.stdout: "motd": { 2023-11-30T23:27:44.108 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "motd", 2023-11-30T23:27:44.108 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "The message of the day", 2023-11-30T23:27:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.109 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.110 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.110 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect_resolve_ip_addr": { 2023-11-30T23:27:44.110 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "redirect_resolve_ip_addr", 2023-11-30T23:27:44.110 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.110 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.110 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.110 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.110 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.111 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.111 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.111 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.111 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.111 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.111 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.111 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2023-11-30T23:27:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2023-11-30T23:27:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2023-11-30T23:27:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.112 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2023-11-30T23:27:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2023-11-30T23:27:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.113 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.114 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8080", 2023-11-30T23:27:44.114 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.114 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.114 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.114 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.114 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.114 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.114 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.115 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2023-11-30T23:27:44.115 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2023-11-30T23:27:44.115 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.115 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.115 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.115 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.115 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.115 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.116 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.116 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.116 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.116 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.116 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.116 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl_server_port": { 2023-11-30T23:27:44.116 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl_server_port", 2023-11-30T23:27:44.116 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.117 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.117 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.117 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8443", 2023-11-30T23:27:44.117 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.117 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.117 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.117 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.117 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.117 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.118 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.118 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2023-11-30T23:27:44.118 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2023-11-30T23:27:44.118 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.118 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.118 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.118 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "redirect", 2023-11-30T23:27:44.118 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.119 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.119 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.119 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.119 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect" 2023-11-30T23:27:44.119 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.119 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.119 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.119 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.119 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.120 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2023-11-30T23:27:44.120 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2023-11-30T23:27:44.120 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.120 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.120 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.120 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2023-11-30T23:27:44.120 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2023-11-30T23:27:44.121 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2023-11-30T23:27:44.121 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.121 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.121 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.121 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.121 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.121 INFO:teuthology.orchestra.run.smithi073.stdout: "url_prefix": { 2023-11-30T23:27:44.121 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url_prefix", 2023-11-30T23:27:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.122 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.123 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.123 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.123 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.123 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.123 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.123 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "devicehealth", 2023-11-30T23:27:44.123 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_monitoring": { 2023-11-30T23:27:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_monitoring", 2023-11-30T23:27:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.124 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.125 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.125 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.125 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "monitor device health metrics", 2023-11-30T23:27:44.125 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.125 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.125 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.125 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.125 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.126 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.126 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.126 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.126 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.126 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.126 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.126 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.126 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.127 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.127 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.127 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.127 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.127 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.127 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.127 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.127 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.128 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.129 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.129 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.129 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.129 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.129 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.129 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.129 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.129 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.130 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.131 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.131 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.131 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.131 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.131 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.131 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.131 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.131 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.132 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.133 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.133 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.133 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.133 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.133 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.133 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.133 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.133 INFO:teuthology.orchestra.run.smithi073.stdout: "mark_out_threshold": { 2023-11-30T23:27:44.134 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mark_out_threshold", 2023-11-30T23:27:44.134 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.134 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.134 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.134 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2419200", 2023-11-30T23:27:44.134 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.134 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.134 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.134 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-11-30T23:27:44.135 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.135 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.135 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.135 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": { 2023-11-30T23:27:44.135 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_name", 2023-11-30T23:27:44.135 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.135 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.135 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "device_health_metrics", 2023-11-30T23:27:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name of pool in which to store device health metrics", 2023-11-30T23:27:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.136 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: "retention_period": { 2023-11-30T23:27:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retention_period", 2023-11-30T23:27:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15552000", 2023-11-30T23:27:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.137 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.138 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.138 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain device health metrics", 2023-11-30T23:27:44.138 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.138 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.138 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.138 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_frequency": { 2023-11-30T23:27:44.138 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_frequency", 2023-11-30T23:27:44.138 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2023-11-30T23:27:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to scrape device health metrics", 2023-11-30T23:27:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.139 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: "self_heal": { 2023-11-30T23:27:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "self_heal", 2023-11-30T23:27:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.140 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-11-30T23:27:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-11-30T23:27:44.141 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-11-30T23:27:44.142 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.142 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.142 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.142 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-11-30T23:27:44.142 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.142 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.142 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.142 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and check device health", 2023-11-30T23:27:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_threshold": { 2023-11-30T23:27:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_threshold", 2023-11-30T23:27:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.143 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.144 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7257600", 2023-11-30T23:27:44.144 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.144 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.144 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.144 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-11-30T23:27:44.144 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.144 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.144 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.144 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.145 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.145 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "diskprediction_local", 2023-11-30T23:27:44.145 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.145 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.145 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.145 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.146 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.147 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.147 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.147 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.147 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.147 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.147 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.147 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.147 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.148 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.148 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.148 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.148 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.148 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.148 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.148 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.148 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.149 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.151 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.151 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.151 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.151 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.151 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.151 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.151 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.151 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.151 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.152 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.152 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.152 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.152 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.152 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.152 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.152 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.152 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.153 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.153 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.153 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.153 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.153 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.153 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.153 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.153 INFO:teuthology.orchestra.run.smithi073.stdout: "predict_interval": { 2023-11-30T23:27:44.154 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predict_interval", 2023-11-30T23:27:44.154 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.154 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.154 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.154 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2023-11-30T23:27:44.154 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.154 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.154 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.155 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.155 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.155 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.155 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.155 INFO:teuthology.orchestra.run.smithi073.stdout: "predictor_model": { 2023-11-30T23:27:44.155 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predictor_model", 2023-11-30T23:27:44.155 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.155 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "prophetstor", 2023-11-30T23:27:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.156 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-11-30T23:27:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-11-30T23:27:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-11-30T23:27:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.157 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.159 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "influx", 2023-11-30T23:27:44.159 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": false, 2023-11-30T23:27:44.159 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "influxdb python module not found", 2023-11-30T23:27:44.159 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.159 INFO:teuthology.orchestra.run.smithi073.stdout: "batch_size": { 2023-11-30T23:27:44.159 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "batch_size", 2023-11-30T23:27:44.159 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.159 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5000", 2023-11-30T23:27:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-11-30T23:27:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.160 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: "database": { 2023-11-30T23:27:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "database", 2023-11-30T23:27:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "ceph", 2023-11-30T23:27:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.161 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.162 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.162 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-11-30T23:27:44.162 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.162 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.162 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.162 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": { 2023-11-30T23:27:44.162 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "hostname", 2023-11-30T23:27:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server hostname", 2023-11-30T23:27:44.163 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.164 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.164 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.164 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-11-30T23:27:44.164 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-11-30T23:27:44.164 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.164 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.164 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.164 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "30", 2023-11-30T23:27:44.165 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "5", 2023-11-30T23:27:44.165 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.165 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.165 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-11-30T23:27:44.165 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.165 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.165 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.166 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.167 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.168 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.170 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.171 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.173 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.173 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.173 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.173 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.174 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: "password": { 2023-11-30T23:27:44.175 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "password", 2023-11-30T23:27:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "password of InfluxDB server user", 2023-11-30T23:27:44.176 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: "port": { 2023-11-30T23:27:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "port", 2023-11-30T23:27:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.177 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8086", 2023-11-30T23:27:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server port", 2023-11-30T23:27:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2023-11-30T23:27:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2023-11-30T23:27:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "false", 2023-11-30T23:27:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.179 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-11-30T23:27:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "threads": { 2023-11-30T23:27:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threads", 2023-11-30T23:27:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.180 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-11-30T23:27:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-11-30T23:27:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "32", 2023-11-30T23:27:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-11-30T23:27:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.181 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "username": { 2023-11-30T23:27:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "username", 2023-11-30T23:27:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "username of InfluxDB server user", 2023-11-30T23:27:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: "verify_ssl": { 2023-11-30T23:27:44.183 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "verify_ssl", 2023-11-30T23:27:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "true", 2023-11-30T23:27:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-11-30T23:27:44.184 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "insights", 2023-11-30T23:27:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.185 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.186 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.186 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.186 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.186 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.186 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.186 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.186 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.186 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.186 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.187 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.187 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.187 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.187 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.187 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.187 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.187 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.187 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.188 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.189 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.190 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.191 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.192 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.193 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "iostat", 2023-11-30T23:27:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.194 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.195 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.196 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.197 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.199 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.200 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.201 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.202 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "localpool", 2023-11-30T23:27:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: "failure_domain": { 2023-11-30T23:27:44.203 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "failure_domain", 2023-11-30T23:27:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "host", 2023-11-30T23:27:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "failure domain for any created local pool", 2023-11-30T23:27:44.204 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-11-30T23:27:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.206 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.207 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.208 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.209 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.209 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.209 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.209 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.209 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.209 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.209 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.209 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.210 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.210 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.210 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.210 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.210 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.210 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.210 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.210 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.210 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.211 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.211 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.211 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.211 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.211 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.211 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.211 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.211 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.212 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.212 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.212 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.212 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.212 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.212 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.212 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.212 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.213 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.213 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.213 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": { 2023-11-30T23:27:44.213 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_size", 2023-11-30T23:27:44.213 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.213 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.213 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.213 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.214 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.214 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.214 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.214 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default min_size for any created local pool", 2023-11-30T23:27:44.214 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-11-30T23:27:44.214 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.214 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.215 INFO:teuthology.orchestra.run.smithi073.stdout: "num_rep": { 2023-11-30T23:27:44.215 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "num_rep", 2023-11-30T23:27:44.215 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.215 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.215 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.215 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3", 2023-11-30T23:27:44.215 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.215 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.215 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.216 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default replica count for any created local pool", 2023-11-30T23:27:44.216 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.216 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.216 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.216 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": { 2023-11-30T23:27:44.216 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_num", 2023-11-30T23:27:44.216 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.216 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.217 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.217 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "128", 2023-11-30T23:27:44.217 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.217 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.217 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.217 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default pg_num for any created local pool", 2023-11-30T23:27:44.217 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.217 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.218 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.218 INFO:teuthology.orchestra.run.smithi073.stdout: "prefix": { 2023-11-30T23:27:44.218 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prefix", 2023-11-30T23:27:44.218 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.218 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.218 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.218 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.218 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.219 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.219 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.219 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name prefix for any created local pool", 2023-11-30T23:27:44.219 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.219 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.219 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.219 INFO:teuthology.orchestra.run.smithi073.stdout: "subtree": { 2023-11-30T23:27:44.219 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "subtree", 2023-11-30T23:27:44.220 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.220 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.220 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.220 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "rack", 2023-11-30T23:27:44.220 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.220 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.220 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.220 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "CRUSH level for which to create a local pool", 2023-11-30T23:27:44.221 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-11-30T23:27:44.221 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.221 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.221 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.221 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.221 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirroring", 2023-11-30T23:27:44.221 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.222 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.222 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.222 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.222 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.222 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.222 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.222 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.222 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.222 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.223 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.223 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.223 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.223 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.223 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.223 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.223 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.223 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.223 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.224 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.224 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.224 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.224 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.224 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.224 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.224 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.224 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.225 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.225 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.225 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.225 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.225 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.225 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.225 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.225 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.226 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.226 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.226 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.226 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.226 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.226 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.226 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.226 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.227 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.227 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.227 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.227 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.227 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.227 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.227 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.227 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.228 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.228 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.228 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.228 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.228 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.228 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.228 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.228 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.229 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.229 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.229 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.229 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.229 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.229 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.229 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.229 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.229 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.230 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.230 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.230 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.230 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "nfs", 2023-11-30T23:27:44.230 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.230 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.230 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.231 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.231 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.231 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.231 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.231 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.231 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.231 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.231 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.232 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.232 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.232 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.232 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.232 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.232 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.232 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.232 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.232 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.233 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.233 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.233 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.233 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.233 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.233 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.233 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.233 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.234 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.234 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.234 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.234 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.234 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.234 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.234 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.234 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.235 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.235 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.235 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.235 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.235 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.235 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.235 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.235 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.235 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.236 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.236 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.236 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.236 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.236 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.236 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.236 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.236 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.237 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.237 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.237 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.237 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.237 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.237 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.237 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.237 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.238 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.238 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.238 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.238 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.238 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.238 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.238 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.238 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.239 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.239 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.239 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2023-11-30T23:27:44.239 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.239 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.239 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.239 INFO:teuthology.orchestra.run.smithi073.stdout: "fail_fs": { 2023-11-30T23:27:44.240 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "fail_fs", 2023-11-30T23:27:44.240 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.240 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.240 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.240 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.240 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.240 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.240 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.240 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-11-30T23:27:44.241 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.241 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.241 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.241 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.241 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.241 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.241 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.242 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.242 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.242 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.242 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.242 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.242 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.242 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.242 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.242 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.243 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.243 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.243 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.243 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.243 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.243 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.243 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.243 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.244 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.244 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.244 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.244 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.244 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.244 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.244 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.244 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.244 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.245 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.245 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.245 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.245 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.245 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.245 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.245 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.245 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.246 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.246 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.246 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.246 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.246 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.246 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.246 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.246 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.247 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.247 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.247 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.247 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.247 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.247 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.247 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.247 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.248 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.248 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.248 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.248 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.248 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.248 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.248 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.248 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.248 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.249 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.249 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.249 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.249 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator": { 2023-11-30T23:27:44.249 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2023-11-30T23:27:44.249 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.249 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.250 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.250 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.250 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.250 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.250 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.250 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm", 2023-11-30T23:27:44.250 INFO:teuthology.orchestra.run.smithi073.stdout: "rook", 2023-11-30T23:27:44.250 INFO:teuthology.orchestra.run.smithi073.stdout: "test_orchestrator" 2023-11-30T23:27:44.250 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.251 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Orchestrator backend", 2023-11-30T23:27:44.251 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.251 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.251 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.251 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.251 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.251 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_perf_query", 2023-11-30T23:27:44.252 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.252 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.252 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.252 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.252 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.252 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.252 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.252 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.252 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.253 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.253 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.253 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.253 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.253 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.253 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.253 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.253 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.253 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.254 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.254 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.254 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.254 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.254 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.254 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.254 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.255 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.255 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.255 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.255 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.255 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.255 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.255 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.255 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.255 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.256 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.256 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.256 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.256 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.256 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.256 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.256 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.256 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.257 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.257 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.257 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.257 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.257 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.257 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.257 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.257 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.257 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.258 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.258 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.258 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.258 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.258 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.258 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.258 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.259 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.259 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.259 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.259 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.259 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.259 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.259 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.259 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.260 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.260 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.260 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.260 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.260 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.260 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_support", 2023-11-30T23:27:44.260 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.261 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.261 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.261 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.261 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.261 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.261 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.261 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.261 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_autoscaler", 2023-11-30T23:27:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.274 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.274 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.274 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.274 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.274 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.274 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.274 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.274 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.275 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.275 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.275 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.275 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.275 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.275 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.275 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.275 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.275 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.276 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.276 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.276 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.276 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.276 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.276 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.276 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.276 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.277 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.277 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.277 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.277 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.277 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.277 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.277 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.277 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.278 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-11-30T23:27:44.278 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-11-30T23:27:44.278 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.278 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.278 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.278 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-11-30T23:27:44.278 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.278 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.279 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.279 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.279 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.279 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.279 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.279 INFO:teuthology.orchestra.run.smithi073.stdout: "threshold": { 2023-11-30T23:27:44.279 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threshold", 2023-11-30T23:27:44.279 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-11-30T23:27:44.280 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.280 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.280 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2023-11-30T23:27:44.280 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1.0", 2023-11-30T23:27:44.280 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.280 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.280 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "scaling threshold", 2023-11-30T23:27:44.280 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-11-30T23:27:44.281 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.281 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.281 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.281 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.281 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "progress", 2023-11-30T23:27:44.281 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.281 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.282 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.282 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_pg_recovery_event": { 2023-11-30T23:27:44.282 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_pg_recovery_event", 2023-11-30T23:27:44.282 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.282 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.282 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.282 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.282 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.282 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.283 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.283 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow the module to show pg recovery progress", 2023-11-30T23:27:44.283 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.283 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.283 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.283 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2023-11-30T23:27:44.283 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2023-11-30T23:27:44.284 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.284 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.284 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.284 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.284 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.284 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.284 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.284 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.284 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.285 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.285 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.285 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.285 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.285 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.285 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.285 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.286 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.286 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.286 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.286 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.286 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.286 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.286 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.286 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.286 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.287 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.287 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.287 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.287 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.287 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.287 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.287 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.287 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.288 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.288 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.288 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.288 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.288 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.288 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.288 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.288 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.288 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.289 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.289 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.289 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.289 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.289 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.289 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.289 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.290 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.290 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.290 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.290 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.290 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.290 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.290 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.290 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.290 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.291 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.291 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.291 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.291 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.291 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.291 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.291 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.291 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.292 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.293 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.293 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.293 INFO:teuthology.orchestra.run.smithi073.stdout: "max_completed_events": { 2023-11-30T23:27:44.293 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_completed_events", 2023-11-30T23:27:44.293 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.293 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.293 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.294 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "50", 2023-11-30T23:27:44.294 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.294 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.294 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.294 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "number of past completed events to remember", 2023-11-30T23:27:44.294 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.294 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.294 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.295 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-11-30T23:27:44.295 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-11-30T23:27:44.295 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.295 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.295 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.295 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-11-30T23:27:44.295 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.295 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.295 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.296 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long the module is going to sleep", 2023-11-30T23:27:44.296 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.296 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.296 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.296 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.296 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.296 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus", 2023-11-30T23:27:44.297 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.297 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.297 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.297 INFO:teuthology.orchestra.run.smithi073.stdout: "cache": { 2023-11-30T23:27:44.297 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cache", 2023-11-30T23:27:44.297 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.297 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.297 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.297 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.298 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.298 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.298 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.298 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.298 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.298 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.298 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.299 INFO:teuthology.orchestra.run.smithi073.stdout: "exclude_perf_counters": { 2023-11-30T23:27:44.299 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "exclude_perf_counters", 2023-11-30T23:27:44.299 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.299 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.299 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.299 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.299 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.299 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.299 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.300 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-11-30T23:27:44.300 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-11-30T23:27:44.300 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.300 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.300 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.300 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.300 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.301 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.301 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.301 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.301 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.301 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.301 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.301 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.301 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.302 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.302 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.302 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.302 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.302 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.302 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.302 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.302 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.303 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.303 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.303 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.303 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.303 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.303 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.303 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.303 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.304 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.304 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.304 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.304 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.304 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.304 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.304 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.304 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.305 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.305 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.305 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.305 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.305 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.305 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.305 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.305 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.305 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.306 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.306 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.306 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.306 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.306 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.306 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.306 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.306 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.307 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.307 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.307 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.307 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.307 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.307 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.307 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.307 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.308 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.308 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.308 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.308 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.308 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.308 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools": { 2023-11-30T23:27:44.308 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools", 2023-11-30T23:27:44.308 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.309 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.309 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.309 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.309 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.309 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.309 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.309 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.309 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.310 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.310 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.310 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools_refresh_interval": { 2023-11-30T23:27:44.310 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-11-30T23:27:44.310 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.310 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.310 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.310 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "300", 2023-11-30T23:27:44.311 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.311 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.311 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.311 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.311 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.311 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.311 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.311 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_interval": { 2023-11-30T23:27:44.312 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_interval", 2023-11-30T23:27:44.312 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-11-30T23:27:44.312 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.312 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.312 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15.0", 2023-11-30T23:27:44.312 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.312 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.312 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.312 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.313 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.313 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.313 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.313 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2023-11-30T23:27:44.313 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2023-11-30T23:27:44.313 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.313 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.313 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.314 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2023-11-30T23:27:44.314 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.314 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.314 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.314 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-11-30T23:27:44.314 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.314 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.314 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.315 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2023-11-30T23:27:44.315 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2023-11-30T23:27:44.315 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.315 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.315 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.315 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "9283", 2023-11-30T23:27:44.315 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.315 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.316 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.316 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-11-30T23:27:44.316 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.316 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.316 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.316 INFO:teuthology.orchestra.run.smithi073.stdout: "stale_cache_strategy": { 2023-11-30T23:27:44.316 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stale_cache_strategy", 2023-11-30T23:27:44.316 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.317 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.317 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.317 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "log", 2023-11-30T23:27:44.317 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.317 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.317 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.317 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.317 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.317 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.318 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.318 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2023-11-30T23:27:44.318 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2023-11-30T23:27:44.318 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.318 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.318 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.318 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "default", 2023-11-30T23:27:44.318 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.319 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.319 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.319 INFO:teuthology.orchestra.run.smithi073.stdout: "default", 2023-11-30T23:27:44.319 INFO:teuthology.orchestra.run.smithi073.stdout: "error" 2023-11-30T23:27:44.319 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.319 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.319 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.319 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.319 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.320 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2023-11-30T23:27:44.320 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2023-11-30T23:27:44.320 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.320 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.320 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.321 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2023-11-30T23:27:44.321 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2023-11-30T23:27:44.321 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2023-11-30T23:27:44.321 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.321 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.322 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.322 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.322 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.322 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.322 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.323 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_support", 2023-11-30T23:27:44.323 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.323 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.323 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.323 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.323 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.323 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.324 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.324 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.324 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.324 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.324 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.324 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.324 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.324 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.325 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.325 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.325 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.325 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.325 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.325 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.325 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.325 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.325 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.326 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.326 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.326 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.326 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.326 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.326 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.326 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.326 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.327 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.327 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.327 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.327 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.327 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.327 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.327 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.327 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.328 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.328 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.328 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.328 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.328 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.328 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.328 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.328 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.329 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.329 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.329 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.329 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.329 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.329 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.329 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.329 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.329 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.330 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.330 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.330 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.330 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.330 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.330 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.330 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.330 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.331 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.331 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.331 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.331 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.331 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.331 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_snap_create": { 2023-11-30T23:27:44.331 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_snap_create", 2023-11-30T23:27:44.331 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.332 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.332 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.332 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-11-30T23:27:44.332 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.332 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.332 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.332 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.332 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.333 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.333 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.333 INFO:teuthology.orchestra.run.smithi073.stdout: "mirror_snapshot_schedule": { 2023-11-30T23:27:44.333 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirror_snapshot_schedule", 2023-11-30T23:27:44.333 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.333 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.333 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.333 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.334 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.334 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.334 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.334 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.334 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.334 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.334 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.334 INFO:teuthology.orchestra.run.smithi073.stdout: "trash_purge_schedule": { 2023-11-30T23:27:44.335 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "trash_purge_schedule", 2023-11-30T23:27:44.335 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.335 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.335 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.335 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.335 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.335 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.335 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.335 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.336 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.336 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.336 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.336 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.336 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.336 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.336 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "restful", 2023-11-30T23:27:44.336 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.337 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.337 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.337 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_auth": { 2023-11-30T23:27:44.337 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_auth", 2023-11-30T23:27:44.337 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.337 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.337 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.337 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.338 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.338 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.338 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.338 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.338 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.338 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.338 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.338 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2023-11-30T23:27:44.339 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2023-11-30T23:27:44.339 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.339 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.339 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.339 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.339 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.339 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.339 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.339 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.340 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.340 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.340 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.340 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.340 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.340 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.340 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.341 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.341 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.341 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.341 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.341 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.341 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.341 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.341 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.341 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.342 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.342 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.342 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.342 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.342 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.342 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.342 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.342 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.343 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.343 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.343 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.343 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.343 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.343 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.343 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.343 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.343 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.344 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.344 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.344 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.344 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.344 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.344 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.344 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.345 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.345 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.345 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.345 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.345 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.345 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.345 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.345 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.345 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.346 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.346 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.346 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.346 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.346 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.346 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.346 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.346 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.347 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.347 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.347 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.347 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.347 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.347 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.348 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.348 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.348 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.348 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.348 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.348 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.348 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2023-11-30T23:27:44.348 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2023-11-30T23:27:44.349 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.349 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.349 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.349 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.349 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.349 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.349 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.349 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.350 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.350 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.350 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.350 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2023-11-30T23:27:44.350 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2023-11-30T23:27:44.350 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.350 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.350 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.351 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.351 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.351 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.351 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.351 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.351 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.351 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.351 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.351 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.352 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.352 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "selftest", 2023-11-30T23:27:44.352 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.352 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.352 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.352 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.353 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.353 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.353 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.353 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.353 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.353 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.353 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.353 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.353 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.354 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.354 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.354 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.354 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.354 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.354 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.354 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.354 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.354 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.355 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.355 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.355 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.355 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.355 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.355 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.355 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.356 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.356 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.356 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.356 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.356 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.356 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.356 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.357 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.357 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.357 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.357 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.357 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.357 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.357 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.357 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.357 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.358 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.358 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.358 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.358 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.358 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.358 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.358 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.358 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.359 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.359 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.359 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.359 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.359 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.359 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.359 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.359 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.360 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.360 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.360 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.360 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.360 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.360 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.360 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.360 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.361 INFO:teuthology.orchestra.run.smithi073.stdout: "roption1": { 2023-11-30T23:27:44.361 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption1", 2023-11-30T23:27:44.361 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.361 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.361 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.361 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.361 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.361 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.361 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.362 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.362 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.362 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.362 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.362 INFO:teuthology.orchestra.run.smithi073.stdout: "roption2": { 2023-11-30T23:27:44.362 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption2", 2023-11-30T23:27:44.362 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.363 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.363 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.363 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "xyz", 2023-11-30T23:27:44.363 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.363 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.363 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.363 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.363 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.363 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.364 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.364 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption1": { 2023-11-30T23:27:44.364 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption1", 2023-11-30T23:27:44.364 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.364 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.364 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.364 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.364 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.365 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.365 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.365 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.365 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.365 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.365 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.365 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption2": { 2023-11-30T23:27:44.365 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption2", 2023-11-30T23:27:44.366 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.366 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.366 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.366 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.366 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.366 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.366 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.366 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.366 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.367 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.367 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.367 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption3": { 2023-11-30T23:27:44.367 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption3", 2023-11-30T23:27:44.367 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-11-30T23:27:44.367 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.367 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.368 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.368 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.368 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.368 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.368 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.368 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.368 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.368 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.369 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption4": { 2023-11-30T23:27:44.369 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption4", 2023-11-30T23:27:44.369 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.369 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.369 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.369 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.369 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.369 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.369 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.370 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.370 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.370 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.370 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.370 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.370 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption5": { 2023-11-30T23:27:44.370 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption5", 2023-11-30T23:27:44.370 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.371 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.371 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.371 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.371 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.371 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.371 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.371 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.371 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.371 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.372 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.372 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption6": { 2023-11-30T23:27:44.372 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption6", 2023-11-30T23:27:44.372 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.372 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.372 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.372 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.372 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.373 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.373 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.373 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.373 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.373 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.373 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.373 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption7": { 2023-11-30T23:27:44.374 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption7", 2023-11-30T23:27:44.374 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.374 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.374 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.374 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.374 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-11-30T23:27:44.374 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "42", 2023-11-30T23:27:44.374 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.374 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.375 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.375 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.375 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.377 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.377 INFO:teuthology.orchestra.run.smithi073.stdout: "testkey": { 2023-11-30T23:27:44.377 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testkey", 2023-11-30T23:27:44.377 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.377 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.378 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.378 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.378 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.378 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.378 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.378 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.378 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.378 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.379 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.379 INFO:teuthology.orchestra.run.smithi073.stdout: "testlkey": { 2023-11-30T23:27:44.379 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testlkey", 2023-11-30T23:27:44.379 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.379 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.379 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.379 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.379 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.380 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.380 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.380 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.380 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.380 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.380 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.380 INFO:teuthology.orchestra.run.smithi073.stdout: "testnewline": { 2023-11-30T23:27:44.380 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testnewline", 2023-11-30T23:27:44.381 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.381 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.381 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.381 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.381 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.381 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.381 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.381 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.381 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.382 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.382 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.382 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.382 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.382 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snap_schedule", 2023-11-30T23:27:44.382 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.383 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.383 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.383 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_m_granularity": { 2023-11-30T23:27:44.383 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_m_granularity", 2023-11-30T23:27:44.383 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.383 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.383 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.383 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.383 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.384 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.384 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.384 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow minute scheduled snapshots", 2023-11-30T23:27:44.384 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.384 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.384 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.384 INFO:teuthology.orchestra.run.smithi073.stdout: "dump_on_update": { 2023-11-30T23:27:44.384 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dump_on_update", 2023-11-30T23:27:44.385 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.385 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.385 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.385 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.385 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.385 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.385 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.385 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "dump database to debug log on update", 2023-11-30T23:27:44.385 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.386 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.386 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.386 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.386 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.386 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.386 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.386 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.387 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.387 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.387 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.387 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.387 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.387 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.387 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.387 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.387 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.388 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.388 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.388 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.388 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.388 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.388 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.388 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.388 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.389 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.389 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.389 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.389 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.389 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.389 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.389 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.389 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.389 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.390 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.390 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.390 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.390 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.390 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.390 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.390 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.391 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.391 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.391 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.391 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.391 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.391 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.391 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.391 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.391 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.392 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.392 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.392 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.392 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.392 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.392 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.392 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.392 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.393 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.393 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.393 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.393 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.393 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.393 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.393 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.393 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.393 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.394 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.394 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.394 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.394 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.394 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stats", 2023-11-30T23:27:44.394 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.395 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.395 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.395 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.395 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.395 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.395 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.395 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.395 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.396 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.396 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.396 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.396 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.396 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.396 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.396 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.396 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.396 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.397 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.397 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.397 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.397 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.397 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.397 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.397 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.397 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.398 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.398 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.398 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.398 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.398 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.398 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.398 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.398 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.399 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.399 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.399 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.399 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.399 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.399 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.399 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.399 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.400 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.400 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.400 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.400 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.400 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.400 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.400 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.400 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.401 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.401 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.401 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.401 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.401 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.401 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.401 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.401 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.402 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.402 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.402 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.402 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.402 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.402 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.402 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.402 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.402 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.403 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.403 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.403 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.403 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.403 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "status", 2023-11-30T23:27:44.403 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.403 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.404 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.404 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.404 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.404 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.404 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.404 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.404 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.404 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.405 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.405 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.405 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.405 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.405 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.405 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.405 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.405 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.405 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.406 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.406 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.406 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.406 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.406 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.406 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.406 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.406 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.407 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.407 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.407 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.407 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.407 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.407 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.407 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.407 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.407 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.408 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.408 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.408 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.408 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.408 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.408 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.408 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.409 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.409 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.409 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.409 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.409 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.409 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.409 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.409 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.409 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.410 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.410 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.410 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.410 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.410 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.410 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.410 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.411 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.411 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.411 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.411 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.411 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.411 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.411 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.411 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.411 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.412 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.412 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.412 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.412 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telegraf", 2023-11-30T23:27:44.412 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.412 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.412 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.413 INFO:teuthology.orchestra.run.smithi073.stdout: "address": { 2023-11-30T23:27:44.413 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "address", 2023-11-30T23:27:44.413 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.413 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.413 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.413 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-11-30T23:27:44.413 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.413 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.413 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.414 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.414 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.414 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.414 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.414 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-11-30T23:27:44.414 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-11-30T23:27:44.414 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.415 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.415 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.415 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15", 2023-11-30T23:27:44.415 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.415 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.415 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.415 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.415 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.415 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.416 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.416 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.416 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.416 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.416 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.416 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.416 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.416 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.417 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.417 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.417 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.417 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.417 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.417 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.417 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.417 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.418 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.418 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.418 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.418 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.418 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.418 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.418 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.419 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.419 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.419 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.419 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.419 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.419 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.419 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.419 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.419 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.420 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.420 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.420 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.420 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.420 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.420 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.420 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.420 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.421 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.421 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.421 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.421 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.421 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.421 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.421 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.421 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.422 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.422 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.422 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.422 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.422 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.422 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.422 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.422 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.423 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.423 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.423 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.423 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.423 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.423 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.423 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.423 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.423 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.424 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.424 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.424 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.424 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.424 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.424 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.424 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telemetry", 2023-11-30T23:27:44.424 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.425 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.425 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.425 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_basic": { 2023-11-30T23:27:44.425 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_basic", 2023-11-30T23:27:44.425 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.425 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.425 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.425 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.425 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.426 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.426 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.426 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share basic cluster information (size, version)", 2023-11-30T23:27:44.426 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.426 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.426 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.426 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_crash": { 2023-11-30T23:27:44.426 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_crash", 2023-11-30T23:27:44.427 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.427 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.427 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.427 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.427 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.427 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.427 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.427 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-11-30T23:27:44.428 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.428 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.428 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.428 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.428 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_device": { 2023-11-30T23:27:44.428 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_device", 2023-11-30T23:27:44.428 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.428 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.428 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.429 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.429 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.429 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.429 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.429 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-11-30T23:27:44.429 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.429 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.429 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.429 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.430 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_ident": { 2023-11-30T23:27:44.430 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_ident", 2023-11-30T23:27:44.430 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.430 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.430 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.430 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.430 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.430 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.431 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.431 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-11-30T23:27:44.431 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.431 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.431 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.431 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.431 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_perf": { 2023-11-30T23:27:44.431 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_perf", 2023-11-30T23:27:44.431 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.432 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.432 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.432 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.432 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.432 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.432 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.432 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share various performance metrics of a cluster", 2023-11-30T23:27:44.432 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.432 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.433 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.433 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.433 INFO:teuthology.orchestra.run.smithi073.stdout: "contact": { 2023-11-30T23:27:44.433 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "contact", 2023-11-30T23:27:44.433 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.433 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.433 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.433 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.433 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.434 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.434 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.434 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.434 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.434 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.434 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.434 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.434 INFO:teuthology.orchestra.run.smithi073.stdout: "description": { 2023-11-30T23:27:44.435 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "description", 2023-11-30T23:27:44.435 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.435 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.435 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.435 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.435 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.435 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.435 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.435 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.436 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.436 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.436 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.436 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.436 INFO:teuthology.orchestra.run.smithi073.stdout: "device_url": { 2023-11-30T23:27:44.436 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_url", 2023-11-30T23:27:44.436 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.436 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.437 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.437 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-11-30T23:27:44.437 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.437 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.437 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.437 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.437 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.437 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.437 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.438 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2023-11-30T23:27:44.438 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2023-11-30T23:27:44.438 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.438 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.438 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.438 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.438 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.439 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.439 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.439 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.439 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.439 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.439 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.439 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-11-30T23:27:44.439 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-11-30T23:27:44.440 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.440 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.440 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.440 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "24", 2023-11-30T23:27:44.440 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "8", 2023-11-30T23:27:44.440 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.440 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.440 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.440 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.441 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.441 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.441 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.441 INFO:teuthology.orchestra.run.smithi073.stdout: "last_opt_revision": { 2023-11-30T23:27:44.441 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "last_opt_revision", 2023-11-30T23:27:44.441 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.441 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.441 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.442 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1", 2023-11-30T23:27:44.442 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.442 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.442 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.442 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.442 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.442 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.442 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.442 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.443 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard": { 2023-11-30T23:27:44.443 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard", 2023-11-30T23:27:44.443 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.443 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.443 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.443 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.443 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.443 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.443 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.444 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.444 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.444 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.444 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.444 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.444 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard_description": { 2023-11-30T23:27:44.444 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard_description", 2023-11-30T23:27:44.444 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.444 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.445 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.445 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.445 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.445 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.445 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.445 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.445 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.445 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.446 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.446 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.446 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.446 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.446 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.446 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.446 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.446 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.447 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.447 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.447 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.447 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.447 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.447 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.447 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.447 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.447 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.448 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.448 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.448 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.448 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.448 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.448 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.448 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.448 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.449 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.449 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.449 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.449 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.449 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.449 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.449 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.449 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.450 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.450 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.450 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.450 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.450 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.450 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.450 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.450 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.451 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.451 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.451 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.451 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.451 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.451 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.451 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.451 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.452 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.452 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.452 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.452 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.452 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.452 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.452 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.452 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.453 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.453 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.453 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.453 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.453 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.453 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.453 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.453 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.454 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.454 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.454 INFO:teuthology.orchestra.run.smithi073.stdout: "organization": { 2023-11-30T23:27:44.454 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "organization", 2023-11-30T23:27:44.454 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.454 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.454 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.454 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.455 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.455 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.455 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.455 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.455 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.455 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.455 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.456 INFO:teuthology.orchestra.run.smithi073.stdout: "proxy": { 2023-11-30T23:27:44.456 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "proxy", 2023-11-30T23:27:44.456 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.456 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.456 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.456 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.456 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.456 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.456 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.457 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.457 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.457 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.457 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.457 INFO:teuthology.orchestra.run.smithi073.stdout: "url": { 2023-11-30T23:27:44.457 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url", 2023-11-30T23:27:44.457 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.457 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.458 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.458 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-11-30T23:27:44.458 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.458 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.458 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.458 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.458 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.458 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.459 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.459 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.459 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.459 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "test_orchestrator", 2023-11-30T23:27:44.459 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.459 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.459 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.460 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.460 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.460 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.460 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.460 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.460 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.460 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.460 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.460 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.461 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.461 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.461 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.461 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.461 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.461 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.461 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.461 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.462 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.462 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.462 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.462 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.462 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.462 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.462 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.462 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.463 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.463 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.463 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.463 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.463 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.463 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.463 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.463 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.464 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.464 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.464 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.464 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.464 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.464 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.464 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.464 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.465 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.465 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.465 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.465 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.465 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.465 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.465 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.465 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.466 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.466 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.466 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.466 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.466 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.466 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.466 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.466 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.467 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.467 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.467 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.467 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.467 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.467 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.467 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.467 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.468 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.468 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.468 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.468 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "volumes", 2023-11-30T23:27:44.468 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.468 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.468 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.469 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.469 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.469 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.469 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.469 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.469 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.469 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.469 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.470 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.470 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.470 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.470 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.470 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.470 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.470 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.470 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.470 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.471 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.471 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.471 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.471 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.471 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.471 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.471 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.472 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.472 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.472 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.472 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.472 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.472 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.472 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.472 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.472 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.473 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.473 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.473 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.473 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.473 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.473 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.473 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.473 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.474 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.474 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.474 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.474 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.474 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.474 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.474 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.474 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.474 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.475 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.475 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.475 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.475 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.475 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.475 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.475 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.475 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.476 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.477 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_clones": { 2023-11-30T23:27:44.477 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_clones", 2023-11-30T23:27:44.477 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.477 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.477 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.477 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4", 2023-11-30T23:27:44.477 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.477 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.478 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.478 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Number of asynchronous cloner threads", 2023-11-30T23:27:44.478 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.478 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.478 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.478 INFO:teuthology.orchestra.run.smithi073.stdout: "snapshot_clone_delay": { 2023-11-30T23:27:44.478 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snapshot_clone_delay", 2023-11-30T23:27:44.478 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.479 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.479 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.479 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-11-30T23:27:44.479 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.479 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.479 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.479 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-11-30T23:27:44.479 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.480 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.480 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.480 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.480 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.480 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.480 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix", 2023-11-30T23:27:44.480 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.480 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stdout: "discovery_interval": { 2023-11-30T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "discovery_interval", 2023-11-30T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-11-30T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "100", 2023-11-30T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.481 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stdout: "identifier": { 2023-11-30T23:27:44.482 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "identifier", 2023-11-30T23:27:44.483 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.483 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.483 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.483 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.483 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.483 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.483 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.483 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.484 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.484 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.484 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.484 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-11-30T23:27:44.484 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-11-30T23:27:44.484 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.484 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.484 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.485 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-11-30T23:27:44.485 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.485 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.485 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.485 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.485 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.485 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.485 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.486 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.486 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.486 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.486 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.486 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.486 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.486 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.486 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.486 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.487 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.487 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.487 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.487 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.487 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.487 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.487 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.487 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.488 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.488 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.488 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.488 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.488 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.488 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.488 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.488 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.489 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.489 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.489 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.489 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.489 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.489 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.489 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.489 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.490 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.490 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.490 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.490 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.490 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.490 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.490 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.490 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.491 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.491 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.491 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.491 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.491 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.491 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.491 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.491 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.491 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.492 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.492 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.492 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.492 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.492 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.492 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.492 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.492 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.493 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.493 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.493 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.493 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.493 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.493 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.493 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.493 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.494 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_host": { 2023-11-30T23:27:44.494 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_host", 2023-11-30T23:27:44.494 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.494 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.494 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.494 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.494 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.494 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.495 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.495 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.495 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.495 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.495 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.495 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_port": { 2023-11-30T23:27:44.495 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_port", 2023-11-30T23:27:44.495 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.496 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.496 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.496 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10051", 2023-11-30T23:27:44.496 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.496 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.496 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.496 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.496 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.496 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.497 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.497 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_sender": { 2023-11-30T23:27:44.497 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_sender", 2023-11-30T23:27:44.497 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.497 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.497 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.497 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-11-30T23:27:44.498 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.498 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.498 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.498 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.498 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.498 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.498 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.498 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.499 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.499 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.499 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-30T23:27:44.499 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.499 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.499 INFO:teuthology.orchestra.run.smithi073.stdout: "modules": [ 2023-11-30T23:27:44.499 INFO:teuthology.orchestra.run.smithi073.stdout: "iostat", 2023-11-30T23:27:44.499 INFO:teuthology.orchestra.run.smithi073.stdout: "nfs", 2023-11-30T23:27:44.499 INFO:teuthology.orchestra.run.smithi073.stdout: "restful" 2023-11-30T23:27:44.500 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.500 INFO:teuthology.orchestra.run.smithi073.stdout: "available_modules": [ 2023-11-30T23:27:44.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.500 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "alerts", 2023-11-30T23:27:44.500 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.500 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.500 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.500 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-11-30T23:27:44.501 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-11-30T23:27:44.501 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.501 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.501 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.501 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-11-30T23:27:44.501 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.501 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.501 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.501 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How frequently to reexamine health status", 2023-11-30T23:27:44.502 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.502 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.502 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.502 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.502 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.502 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.502 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.503 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.503 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.503 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.503 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.503 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.503 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.503 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.503 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.504 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.504 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.504 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.504 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.504 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.504 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.504 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.504 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.505 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.505 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.505 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.505 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.505 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.505 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.505 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.505 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.505 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.506 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.506 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.506 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.506 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.506 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.506 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.506 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.507 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.507 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.507 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.507 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.507 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.507 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.507 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.507 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.507 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.508 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.508 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.508 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.508 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.508 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.508 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.508 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.508 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.508 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.509 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.509 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.509 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.509 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.509 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.509 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.509 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.509 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.509 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.510 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.510 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.510 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.510 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.510 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_destination": { 2023-11-30T23:27:44.510 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_destination", 2023-11-30T23:27:44.510 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.511 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.511 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.511 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.511 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.511 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.511 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.511 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email address to send alerts to", 2023-11-30T23:27:44.511 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.511 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.512 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.512 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_from_name": { 2023-11-30T23:27:44.512 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_from_name", 2023-11-30T23:27:44.512 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.512 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.512 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.512 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "Ceph", 2023-11-30T23:27:44.512 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.513 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.513 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.513 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Email From: name", 2023-11-30T23:27:44.513 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.513 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.513 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.513 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_host": { 2023-11-30T23:27:44.513 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_host", 2023-11-30T23:27:44.514 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.514 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.514 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.514 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.514 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.514 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.514 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.514 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP server", 2023-11-30T23:27:44.515 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.515 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.515 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.515 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_password": { 2023-11-30T23:27:44.515 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_password", 2023-11-30T23:27:44.515 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.515 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.515 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.516 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.516 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.516 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.516 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.516 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Password to authenticate with", 2023-11-30T23:27:44.516 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.516 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.516 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.517 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_port": { 2023-11-30T23:27:44.517 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_port", 2023-11-30T23:27:44.517 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.517 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.517 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.517 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "465", 2023-11-30T23:27:44.517 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.517 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.517 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.518 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP port", 2023-11-30T23:27:44.518 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.518 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.518 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.518 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.518 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_sender": { 2023-11-30T23:27:44.518 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_sender", 2023-11-30T23:27:44.518 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.518 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.519 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.519 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.519 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.519 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.519 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.519 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SMTP envelope sender", 2023-11-30T23:27:44.519 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.519 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.520 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.520 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_ssl": { 2023-11-30T23:27:44.520 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_ssl", 2023-11-30T23:27:44.520 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.520 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.520 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.520 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.520 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.521 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.521 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.521 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use SSL to connect to SMTP server", 2023-11-30T23:27:44.521 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.521 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.521 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.521 INFO:teuthology.orchestra.run.smithi073.stdout: "smtp_user": { 2023-11-30T23:27:44.521 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "smtp_user", 2023-11-30T23:27:44.522 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.522 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.522 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.522 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.522 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.522 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.522 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.522 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "User to authenticate as", 2023-11-30T23:27:44.523 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.523 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.523 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.523 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.523 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.523 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.523 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "balancer", 2023-11-30T23:27:44.523 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.524 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.524 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.524 INFO:teuthology.orchestra.run.smithi073.stdout: "active": { 2023-11-30T23:27:44.524 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "active", 2023-11-30T23:27:44.524 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.524 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.524 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.524 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.525 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.525 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.525 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.525 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically balance PGs across cluster", 2023-11-30T23:27:44.525 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.525 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.525 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.525 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_time": { 2023-11-30T23:27:44.526 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_time", 2023-11-30T23:27:44.526 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.526 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.526 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.526 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0000", 2023-11-30T23:27:44.526 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.526 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.526 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.526 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "beginning time of day to automatically balance", 2023-11-30T23:27:44.527 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-30T23:27:44.527 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.527 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.527 INFO:teuthology.orchestra.run.smithi073.stdout: "begin_weekday": { 2023-11-30T23:27:44.527 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "begin_weekday", 2023-11-30T23:27:44.527 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-11-30T23:27:44.527 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.527 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.528 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-11-30T23:27:44.528 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2023-11-30T23:27:44.528 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2023-11-30T23:27:44.528 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.528 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-11-30T23:27:44.528 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-11-30T23:27:44.528 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.528 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.529 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_max_iterations": { 2023-11-30T23:27:44.529 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_max_iterations", 2023-11-30T23:27:44.529 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-11-30T23:27:44.529 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.529 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.529 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "25", 2023-11-30T23:27:44.529 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-11-30T23:27:44.529 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "250", 2023-11-30T23:27:44.529 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.530 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-11-30T23:27:44.530 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.530 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.530 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.530 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_metrics": { 2023-11-30T23:27:44.530 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_metrics", 2023-11-30T23:27:44.530 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.531 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.531 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.531 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "pgs,objects,bytes", 2023-11-30T23:27:44.531 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.531 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.531 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.531 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-11-30T23:27:44.531 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-11-30T23:27:44.531 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.532 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.532 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_compat_step": { 2023-11-30T23:27:44.532 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crush_compat_step", 2023-11-30T23:27:44.532 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-11-30T23:27:44.532 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.532 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.532 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.5", 2023-11-30T23:27:44.532 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0.001", 2023-11-30T23:27:44.533 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "0.999", 2023-11-30T23:27:44.533 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.533 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "aggressiveness of optimization", 2023-11-30T23:27:44.533 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-11-30T23:27:44.533 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.533 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.533 INFO:teuthology.orchestra.run.smithi073.stdout: "end_time": { 2023-11-30T23:27:44.534 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_time", 2023-11-30T23:27:44.534 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.534 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.534 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.534 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2359", 2023-11-30T23:27:44.534 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.534 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.534 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.534 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ending time of day to automatically balance", 2023-11-30T23:27:44.535 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-30T23:27:44.535 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.535 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.535 INFO:teuthology.orchestra.run.smithi073.stdout: "end_weekday": { 2023-11-30T23:27:44.535 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "end_weekday", 2023-11-30T23:27:44.535 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-11-30T23:27:44.535 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.536 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.536 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-11-30T23:27:44.536 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "0", 2023-11-30T23:27:44.536 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "6", 2023-11-30T23:27:44.536 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.536 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-11-30T23:27:44.536 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-11-30T23:27:44.536 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.536 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.537 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.537 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.537 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.537 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.537 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.537 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.537 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.537 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.538 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.538 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.538 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.538 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.538 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.538 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.538 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.538 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.538 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.539 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.539 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.539 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.539 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.539 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.539 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.539 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.540 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.540 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.540 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.540 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.540 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.540 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.540 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.540 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.540 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.541 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.541 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.541 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.541 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.541 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.541 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.541 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.542 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.542 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.542 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.542 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.542 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.542 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.542 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.542 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.542 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.543 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.543 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.543 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.543 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.543 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.543 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.543 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.543 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.543 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.544 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.544 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.544 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.544 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.544 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.544 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.544 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.544 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.544 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.545 INFO:teuthology.orchestra.run.smithi073.stdout: "min_score": { 2023-11-30T23:27:44.545 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_score", 2023-11-30T23:27:44.545 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-11-30T23:27:44.545 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.545 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.545 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-11-30T23:27:44.545 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.546 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.546 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.546 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-11-30T23:27:44.546 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.546 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.546 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.546 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2023-11-30T23:27:44.546 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2023-11-30T23:27:44.547 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.547 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.547 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.547 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "upmap", 2023-11-30T23:27:44.547 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.547 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.547 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.547 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-compat", 2023-11-30T23:27:44.547 INFO:teuthology.orchestra.run.smithi073.stdout: "none", 2023-11-30T23:27:44.548 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap" 2023-11-30T23:27:44.548 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.548 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Balancer mode", 2023-11-30T23:27:44.548 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.548 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.548 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.548 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_ids": { 2023-11-30T23:27:44.549 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_ids", 2023-11-30T23:27:44.549 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.549 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.549 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.549 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.549 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.549 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.549 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.549 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-11-30T23:27:44.550 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.550 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.550 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.550 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-11-30T23:27:44.550 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-11-30T23:27:44.550 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.550 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.550 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.551 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-11-30T23:27:44.551 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.551 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.551 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.551 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-11-30T23:27:44.551 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.551 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.551 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.552 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_deviation": { 2023-11-30T23:27:44.552 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_deviation", 2023-11-30T23:27:44.552 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.552 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.552 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.552 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-11-30T23:27:44.552 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-11-30T23:27:44.552 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.552 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.553 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "deviation below which no optimization is attempted", 2023-11-30T23:27:44.553 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-11-30T23:27:44.553 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.553 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.553 INFO:teuthology.orchestra.run.smithi073.stdout: "upmap_max_optimizations": { 2023-11-30T23:27:44.553 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "upmap_max_optimizations", 2023-11-30T23:27:44.553 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-11-30T23:27:44.554 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.554 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.554 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-11-30T23:27:44.554 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.554 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.554 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.554 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-11-30T23:27:44.554 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.554 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.555 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.555 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.555 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.555 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cephadm", 2023-11-30T23:27:44.555 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.555 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.555 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.556 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_down_multiplier": { 2023-11-30T23:27:44.556 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_down_multiplier", 2023-11-30T23:27:44.556 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-11-30T23:27:44.556 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.556 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.556 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2023-11-30T23:27:44.556 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.556 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.556 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.557 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-11-30T23:27:44.557 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.557 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.557 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.557 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_refresh_rate": { 2023-11-30T23:27:44.557 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_refresh_rate", 2023-11-30T23:27:44.557 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.558 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.558 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.558 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "20", 2023-11-30T23:27:44.558 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.558 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.558 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.558 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-11-30T23:27:44.558 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.559 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.559 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.559 INFO:teuthology.orchestra.run.smithi073.stdout: "agent_starting_port": { 2023-11-30T23:27:44.559 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "agent_starting_port", 2023-11-30T23:27:44.559 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.559 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.559 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.559 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4721", 2023-11-30T23:27:44.560 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.560 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.560 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.560 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-11-30T23:27:44.560 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.560 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.560 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.560 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_ptrace": { 2023-11-30T23:27:44.561 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_ptrace", 2023-11-30T23:27:44.561 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.561 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.561 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.561 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.561 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.561 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.561 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.562 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-11-30T23:27:44.562 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-11-30T23:27:44.562 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.562 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.562 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_interval": { 2023-11-30T23:27:44.562 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_interval", 2023-11-30T23:27:44.562 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.562 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.563 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.563 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-11-30T23:27:44.563 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.563 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.563 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.563 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to autotune daemon memory", 2023-11-30T23:27:44.563 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.563 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.563 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.564 INFO:teuthology.orchestra.run.smithi073.stdout: "autotune_memory_target_ratio": { 2023-11-30T23:27:44.564 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "autotune_memory_target_ratio", 2023-11-30T23:27:44.564 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-11-30T23:27:44.564 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.564 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.564 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0.7", 2023-11-30T23:27:44.564 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.564 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.565 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.565 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-11-30T23:27:44.565 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.565 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.565 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.565 INFO:teuthology.orchestra.run.smithi073.stdout: "cgroups_split": { 2023-11-30T23:27:44.565 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cgroups_split", 2023-11-30T23:27:44.566 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.566 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.566 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.566 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.566 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.566 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.566 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.566 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-11-30T23:27:44.567 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.567 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.567 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.567 INFO:teuthology.orchestra.run.smithi073.stdout: "config_checks_enabled": { 2023-11-30T23:27:44.567 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_checks_enabled", 2023-11-30T23:27:44.567 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.567 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.567 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.568 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.568 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.568 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.568 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.568 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-11-30T23:27:44.568 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.568 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.568 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.569 INFO:teuthology.orchestra.run.smithi073.stdout: "config_dashboard": { 2023-11-30T23:27:44.569 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "config_dashboard", 2023-11-30T23:27:44.569 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.569 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.569 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.569 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.569 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.569 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.569 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.570 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-11-30T23:27:44.570 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.570 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.570 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.570 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_alertmanager": { 2023-11-30T23:27:44.570 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_alertmanager", 2023-11-30T23:27:44.570 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.571 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.571 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.571 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-11-30T23:27:44.571 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.571 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.571 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.571 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-11-30T23:27:44.571 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.571 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.572 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.572 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_base": { 2023-11-30T23:27:44.572 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_base", 2023-11-30T23:27:44.572 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.572 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.572 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.572 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/ceph", 2023-11-30T23:27:44.572 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.573 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.573 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.573 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Container image name, without the tag", 2023-11-30T23:27:44.573 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.573 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.573 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.573 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_elasticsearch": { 2023-11-30T23:27:44.573 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_elasticsearch", 2023-11-30T23:27:44.574 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.574 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.574 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.574 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-11-30T23:27:44.574 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.574 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.574 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.574 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "elasticsearch container image", 2023-11-30T23:27:44.575 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.575 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.575 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.575 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_grafana": { 2023-11-30T23:27:44.575 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_grafana", 2023-11-30T23:27:44.575 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.575 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.575 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.576 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-11-30T23:27:44.576 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.576 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.576 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.576 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-11-30T23:27:44.576 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.576 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.576 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.577 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_haproxy": { 2023-11-30T23:27:44.577 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_haproxy", 2023-11-30T23:27:44.577 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.577 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.577 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.577 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-11-30T23:27:44.577 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.577 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.578 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.578 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "HAproxy container image", 2023-11-30T23:27:44.578 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.578 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.578 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.578 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_agent": { 2023-11-30T23:27:44.578 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_agent", 2023-11-30T23:27:44.579 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.579 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.579 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.579 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-11-30T23:27:44.579 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.579 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.579 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.579 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger agent container image", 2023-11-30T23:27:44.579 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.580 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.580 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.580 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_collector": { 2023-11-30T23:27:44.580 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_collector", 2023-11-30T23:27:44.580 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.580 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.580 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.580 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-11-30T23:27:44.581 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.581 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.581 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.581 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger collector container image", 2023-11-30T23:27:44.581 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.581 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.581 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.582 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_jaeger_query": { 2023-11-30T23:27:44.582 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_jaeger_query", 2023-11-30T23:27:44.582 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.582 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.582 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.582 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-11-30T23:27:44.582 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.582 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.583 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.583 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Jaeger query container image", 2023-11-30T23:27:44.583 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.583 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.583 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.583 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_keepalived": { 2023-11-30T23:27:44.583 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_keepalived", 2023-11-30T23:27:44.583 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.584 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.584 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.584 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-11-30T23:27:44.584 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.584 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.584 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.584 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Keepalived container image", 2023-11-30T23:27:44.584 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.584 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.585 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.585 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_loki": { 2023-11-30T23:27:44.585 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_loki", 2023-11-30T23:27:44.585 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.585 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.585 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.585 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-11-30T23:27:44.585 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.586 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.586 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.586 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Loki container image", 2023-11-30T23:27:44.586 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.586 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.586 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.586 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_node_exporter": { 2023-11-30T23:27:44.587 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_node_exporter", 2023-11-30T23:27:44.587 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.587 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.587 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.587 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-11-30T23:27:44.587 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.587 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.587 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.587 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-11-30T23:27:44.588 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.588 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.588 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.588 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_nvmeof": { 2023-11-30T23:27:44.588 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_nvmeof", 2023-11-30T23:27:44.588 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.588 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.588 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.589 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.2", 2023-11-30T23:27:44.589 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.589 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.589 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.589 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Nvme-of container image", 2023-11-30T23:27:44.589 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.589 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.589 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.590 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_prometheus": { 2023-11-30T23:27:44.590 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_prometheus", 2023-11-30T23:27:44.590 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.590 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.590 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.590 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-11-30T23:27:44.590 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.590 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.591 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.591 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Prometheus container image", 2023-11-30T23:27:44.591 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.591 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.591 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.591 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_promtail": { 2023-11-30T23:27:44.591 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_promtail", 2023-11-30T23:27:44.591 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.592 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.592 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.592 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-11-30T23:27:44.592 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.592 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.592 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.592 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Promtail container image", 2023-11-30T23:27:44.592 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.592 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.593 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.593 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image_snmp_gateway": { 2023-11-30T23:27:44.593 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_image_snmp_gateway", 2023-11-30T23:27:44.593 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.593 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.593 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.593 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-11-30T23:27:44.593 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.594 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.594 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.594 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "SNMP Gateway container image", 2023-11-30T23:27:44.594 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.594 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.594 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.594 INFO:teuthology.orchestra.run.smithi073.stdout: "container_init": { 2023-11-30T23:27:44.595 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "container_init", 2023-11-30T23:27:44.595 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.595 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.595 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.595 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.595 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.595 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.595 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.595 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Run podman/docker with `--init`", 2023-11-30T23:27:44.596 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.596 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.596 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.596 INFO:teuthology.orchestra.run.smithi073.stdout: "daemon_cache_timeout": { 2023-11-30T23:27:44.596 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "daemon_cache_timeout", 2023-11-30T23:27:44.596 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.596 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.597 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.597 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-11-30T23:27:44.597 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.597 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.597 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.597 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-11-30T23:27:44.597 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.597 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.597 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.598 INFO:teuthology.orchestra.run.smithi073.stdout: "default_cephadm_command_timeout": { 2023-11-30T23:27:44.598 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_cephadm_command_timeout", 2023-11-30T23:27:44.598 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.598 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.598 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.598 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "900", 2023-11-30T23:27:44.598 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.598 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.599 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.599 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-11-30T23:27:44.599 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.599 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.599 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.599 INFO:teuthology.orchestra.run.smithi073.stdout: "default_registry": { 2023-11-30T23:27:44.599 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "default_registry", 2023-11-30T23:27:44.600 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.600 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.600 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.600 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "docker.io", 2023-11-30T23:27:44.600 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.600 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.600 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.600 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-11-30T23:27:44.600 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.601 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.601 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.601 INFO:teuthology.orchestra.run.smithi073.stdout: "device_cache_timeout": { 2023-11-30T23:27:44.601 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_cache_timeout", 2023-11-30T23:27:44.601 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.601 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.601 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.601 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1800", 2023-11-30T23:27:44.602 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.602 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.602 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.602 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache device inventory", 2023-11-30T23:27:44.602 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.602 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.602 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.602 INFO:teuthology.orchestra.run.smithi073.stdout: "device_enhanced_scan": { 2023-11-30T23:27:44.603 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_enhanced_scan", 2023-11-30T23:27:44.603 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.603 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.603 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.603 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.603 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.603 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.603 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.603 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use libstoragemgmt during device scans", 2023-11-30T23:27:44.604 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.604 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.604 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.604 INFO:teuthology.orchestra.run.smithi073.stdout: "facts_cache_timeout": { 2023-11-30T23:27:44.604 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "facts_cache_timeout", 2023-11-30T23:27:44.604 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.604 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.605 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.605 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-11-30T23:27:44.605 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.605 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.605 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.605 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "seconds to cache host facts data", 2023-11-30T23:27:44.605 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.605 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.605 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.606 INFO:teuthology.orchestra.run.smithi073.stdout: "host_check_interval": { 2023-11-30T23:27:44.606 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "host_check_interval", 2023-11-30T23:27:44.606 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.606 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.606 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.606 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-11-30T23:27:44.606 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.607 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.607 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.607 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to perform a host check", 2023-11-30T23:27:44.607 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.607 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.607 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.607 INFO:teuthology.orchestra.run.smithi073.stdout: "inventory_list_all": { 2023-11-30T23:27:44.607 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "inventory_list_all", 2023-11-30T23:27:44.608 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.608 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.608 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.608 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.608 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.608 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.608 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.608 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-11-30T23:27:44.608 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.609 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.609 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.609 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.609 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.609 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.609 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.609 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.610 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.610 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.610 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.610 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.610 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.610 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.610 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.610 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.610 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.611 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.611 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.611 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.611 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.611 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.611 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.611 INFO:teuthology.orchestra.run.smithi073.stdout: "log_refresh_metadata": { 2023-11-30T23:27:44.611 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_refresh_metadata", 2023-11-30T23:27:44.612 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.612 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.612 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.612 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.612 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.612 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.612 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.612 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-11-30T23:27:44.612 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.613 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.613 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.613 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.613 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.613 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.613 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.613 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.614 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.614 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.614 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.614 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.614 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-11-30T23:27:44.614 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.614 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.614 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.615 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.615 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.615 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.615 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.615 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.615 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.615 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.615 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.615 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.616 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.616 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.616 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.616 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.616 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.616 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.616 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.616 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.616 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.617 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.617 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.617 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.617 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.617 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.617 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.617 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.617 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.618 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.618 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.618 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.618 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.618 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.618 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.618 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.618 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf": { 2023-11-30T23:27:44.619 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-11-30T23:27:44.619 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.619 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.619 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.619 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.619 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.619 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.619 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.619 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-11-30T23:27:44.620 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.620 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.620 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.620 INFO:teuthology.orchestra.run.smithi073.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-11-30T23:27:44.620 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-11-30T23:27:44.620 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.620 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.621 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.621 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "*", 2023-11-30T23:27:44.621 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.621 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.621 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.621 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-11-30T23:27:44.621 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.621 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.621 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.622 INFO:teuthology.orchestra.run.smithi073.stdout: "max_count_per_host": { 2023-11-30T23:27:44.622 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_count_per_host", 2023-11-30T23:27:44.622 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.622 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.622 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.622 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-11-30T23:27:44.622 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.622 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.623 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.623 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of daemons per service per host", 2023-11-30T23:27:44.623 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.623 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.623 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.623 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd_draining_count": { 2023-11-30T23:27:44.623 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_osd_draining_count", 2023-11-30T23:27:44.623 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.624 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.624 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.624 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-11-30T23:27:44.624 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.624 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.624 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.624 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-11-30T23:27:44.624 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.624 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.625 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.625 INFO:teuthology.orchestra.run.smithi073.stdout: "migration_current": { 2023-11-30T23:27:44.625 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "migration_current", 2023-11-30T23:27:44.625 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.625 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.625 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.625 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.625 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.626 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.626 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.626 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "internal - do not modify", 2023-11-30T23:27:44.626 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.626 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.626 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.626 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": { 2023-11-30T23:27:44.627 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mode", 2023-11-30T23:27:44.627 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.627 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.627 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.627 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "root", 2023-11-30T23:27:44.627 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.627 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.627 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.627 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm-package", 2023-11-30T23:27:44.628 INFO:teuthology.orchestra.run.smithi073.stdout: "root" 2023-11-30T23:27:44.628 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.628 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "mode for remote execution of cephadm", 2023-11-30T23:27:44.628 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.628 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.628 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.628 INFO:teuthology.orchestra.run.smithi073.stdout: "prometheus_alerts_path": { 2023-11-30T23:27:44.628 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus_alerts_path", 2023-11-30T23:27:44.629 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.629 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.629 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.629 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-11-30T23:27:44.629 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.629 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.629 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.629 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-11-30T23:27:44.630 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.630 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.630 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.630 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_insecure": { 2023-11-30T23:27:44.630 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_insecure", 2023-11-30T23:27:44.630 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.630 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.630 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.631 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.631 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.631 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.631 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.631 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-11-30T23:27:44.631 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.631 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.631 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.632 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_password": { 2023-11-30T23:27:44.632 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_password", 2023-11-30T23:27:44.632 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.632 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.632 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.632 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.632 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.632 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.632 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.633 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-11-30T23:27:44.633 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.633 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.633 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.633 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_url": { 2023-11-30T23:27:44.633 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_url", 2023-11-30T23:27:44.634 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.634 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.634 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.634 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.634 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.634 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.634 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.635 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-11-30T23:27:44.635 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.635 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.635 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.635 INFO:teuthology.orchestra.run.smithi073.stdout: "registry_username": { 2023-11-30T23:27:44.635 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "registry_username", 2023-11-30T23:27:44.635 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.636 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.636 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.636 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.636 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.636 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.636 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.636 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-11-30T23:27:44.636 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.636 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.637 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.637 INFO:teuthology.orchestra.run.smithi073.stdout: "secure_monitoring_stack": { 2023-11-30T23:27:44.637 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "secure_monitoring_stack", 2023-11-30T23:27:44.637 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.637 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.637 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.637 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.637 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.638 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.638 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.638 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-11-30T23:27:44.638 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.638 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.638 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.638 INFO:teuthology.orchestra.run.smithi073.stdout: "service_discovery_port": { 2023-11-30T23:27:44.638 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "service_discovery_port", 2023-11-30T23:27:44.639 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.639 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.639 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.639 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8765", 2023-11-30T23:27:44.639 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.639 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.639 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.639 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "cephadm service discovery port", 2023-11-30T23:27:44.640 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.640 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.640 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.640 INFO:teuthology.orchestra.run.smithi073.stdout: "ssh_config_file": { 2023-11-30T23:27:44.640 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssh_config_file", 2023-11-30T23:27:44.640 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.640 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.640 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.641 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.641 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.641 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.641 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.641 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-11-30T23:27:44.641 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.641 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.641 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.642 INFO:teuthology.orchestra.run.smithi073.stdout: "use_agent": { 2023-11-30T23:27:44.642 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_agent", 2023-11-30T23:27:44.642 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.642 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.642 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.642 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.642 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.642 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.642 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.643 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-11-30T23:27:44.643 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.643 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.643 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.643 INFO:teuthology.orchestra.run.smithi073.stdout: "use_repo_digest": { 2023-11-30T23:27:44.643 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "use_repo_digest", 2023-11-30T23:27:44.643 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.643 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.644 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.644 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.644 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.644 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.644 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.644 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-11-30T23:27:44.644 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.644 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.645 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.645 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_failed_host_check": { 2023-11-30T23:27:44.645 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_failed_host_check", 2023-11-30T23:27:44.645 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.645 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.645 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.645 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.645 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.646 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.646 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.646 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if the host check fails", 2023-11-30T23:27:44.646 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.646 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.646 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.646 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_daemons": { 2023-11-30T23:27:44.646 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_daemons", 2023-11-30T23:27:44.647 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.647 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.647 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.647 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.647 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.647 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.647 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.647 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-11-30T23:27:44.647 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.648 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.648 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.648 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_on_stray_hosts": { 2023-11-30T23:27:44.648 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_on_stray_hosts", 2023-11-30T23:27:44.648 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.648 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.648 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.648 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.649 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.649 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.649 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.649 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-11-30T23:27:44.649 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.649 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.649 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.649 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.649 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.650 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crash", 2023-11-30T23:27:44.650 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.650 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.650 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.650 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.650 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.651 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.651 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.651 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.651 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.651 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.651 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.651 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.651 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.651 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.652 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.652 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.652 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.652 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.652 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.652 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.652 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.652 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.652 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.653 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.653 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.653 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.653 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.653 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.653 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.653 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.653 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.654 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.654 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.654 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.654 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.654 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.654 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.654 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.655 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.655 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.655 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.655 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.655 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.655 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.655 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.655 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.655 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.656 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.656 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.656 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.656 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.656 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.656 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.656 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.656 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.656 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.657 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.657 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.657 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.657 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.657 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.657 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.657 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.657 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.658 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.658 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.658 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.658 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.658 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.658 INFO:teuthology.orchestra.run.smithi073.stdout: "retain_interval": { 2023-11-30T23:27:44.658 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retain_interval", 2023-11-30T23:27:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "31536000", 2023-11-30T23:27:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain crashes before pruning them", 2023-11-30T23:27:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_recent_interval": { 2023-11-30T23:27:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_recent_interval", 2023-11-30T23:27:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1209600", 2023-11-30T23:27:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "time interval in which to warn about recent crashes", 2023-11-30T23:27:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dashboard", 2023-11-30T23:27:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-11-30T23:27:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-11-30T23:27:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-11-30T23:27:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_HOST": { 2023-11-30T23:27:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_HOST", 2023-11-30T23:27:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-11-30T23:27:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-11-30T23:27:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_ENABLED": { 2023-11-30T23:27:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_ENABLED", 2023-11-30T23:27:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.669 INFO:teuthology.orchestra.run.smithi073.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-11-30T23:27:44.669 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-11-30T23:27:44.669 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.669 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.669 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.669 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.669 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.670 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.670 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.670 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.670 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.670 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.670 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.670 INFO:teuthology.orchestra.run.smithi073.stdout: "ENABLE_BROWSABLE_API": { 2023-11-30T23:27:44.670 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ENABLE_BROWSABLE_API", 2023-11-30T23:27:44.671 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.671 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.671 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.671 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.671 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.671 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.671 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.671 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.671 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.672 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.672 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.672 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.672 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-11-30T23:27:44.672 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-11-30T23:27:44.672 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.672 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.672 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.672 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.673 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.673 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.673 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.673 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.673 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.673 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.673 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.674 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-11-30T23:27:44.674 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-11-30T23:27:44.674 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.674 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.674 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.674 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.674 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.674 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.675 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.675 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.675 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.675 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.675 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.675 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-11-30T23:27:44.675 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-11-30T23:27:44.676 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.676 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.676 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.676 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.676 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.676 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.676 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.676 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.677 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.677 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.677 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.677 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-11-30T23:27:44.677 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-11-30T23:27:44.677 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.677 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.677 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.678 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.678 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.678 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.678 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.678 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.678 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.678 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.678 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.679 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_NFS": { 2023-11-30T23:27:44.679 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-11-30T23:27:44.679 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.679 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.679 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.679 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.679 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.679 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.680 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.680 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.680 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.680 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.680 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.680 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RBD": { 2023-11-30T23:27:44.680 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-11-30T23:27:44.681 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.681 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.681 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.681 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.681 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.681 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.681 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.681 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.681 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.682 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.682 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.682 INFO:teuthology.orchestra.run.smithi073.stdout: "FEATURE_TOGGLE_RGW": { 2023-11-30T23:27:44.682 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-11-30T23:27:44.682 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.682 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.682 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.683 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.683 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.683 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.683 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.683 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.683 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.683 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.683 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.684 INFO:teuthology.orchestra.run.smithi073.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-11-30T23:27:44.684 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-11-30T23:27:44.684 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.684 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.684 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.684 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.684 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.684 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.684 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.685 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.685 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.685 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.685 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.685 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_PASSWORD": { 2023-11-30T23:27:44.685 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_PASSWORD", 2023-11-30T23:27:44.685 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.686 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.686 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.686 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-11-30T23:27:44.686 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.686 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.686 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.686 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.686 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.687 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.687 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.687 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-11-30T23:27:44.687 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-11-30T23:27:44.687 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.687 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.687 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.687 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.688 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.688 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.688 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.688 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.688 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.688 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.688 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.689 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_URL": { 2023-11-30T23:27:44.689 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_URL", 2023-11-30T23:27:44.689 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.689 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.689 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.689 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.689 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.689 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.689 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.690 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.690 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.690 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.690 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.690 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_API_USERNAME": { 2023-11-30T23:27:44.690 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_API_USERNAME", 2023-11-30T23:27:44.690 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.690 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.691 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.691 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-11-30T23:27:44.691 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.691 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.691 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.691 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.691 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.691 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.691 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.692 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-11-30T23:27:44.692 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-11-30T23:27:44.692 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.692 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.692 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.692 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.692 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.693 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.693 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.693 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.693 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.693 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.693 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.693 INFO:teuthology.orchestra.run.smithi073.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-11-30T23:27:44.693 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-11-30T23:27:44.694 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.694 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.694 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.694 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.694 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.694 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.694 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.694 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.694 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.695 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.695 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.695 INFO:teuthology.orchestra.run.smithi073.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-11-30T23:27:44.695 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-11-30T23:27:44.695 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.695 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.695 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.695 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.696 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.696 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.696 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.696 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.696 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.696 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.696 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.696 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.696 INFO:teuthology.orchestra.run.smithi073.stdout: "ISSUE_TRACKER_API_KEY": { 2023-11-30T23:27:44.697 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-11-30T23:27:44.697 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.697 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.697 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.697 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.697 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.697 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.697 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.698 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.698 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.698 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.698 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.698 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_HOST": { 2023-11-30T23:27:44.698 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_HOST", 2023-11-30T23:27:44.698 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.698 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.699 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.699 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.699 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.699 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.699 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.699 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.699 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.699 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.699 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.700 INFO:teuthology.orchestra.run.smithi073.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-11-30T23:27:44.700 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-11-30T23:27:44.700 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.700 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.700 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.700 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.700 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.700 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.701 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.701 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.701 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.701 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.701 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.701 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-11-30T23:27:44.701 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-11-30T23:27:44.702 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.702 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.702 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.702 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.702 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.702 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.702 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.702 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.702 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.703 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.703 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.703 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-11-30T23:27:44.703 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-11-30T23:27:44.703 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.703 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.703 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.703 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.704 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.704 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.704 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.704 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.704 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.704 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.704 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.704 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-11-30T23:27:44.705 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-11-30T23:27:44.705 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.705 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.705 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.705 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.705 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.705 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.705 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.706 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.706 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.706 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.706 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.706 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-11-30T23:27:44.706 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-11-30T23:27:44.706 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.707 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.707 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.707 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.707 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.707 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.707 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.707 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.707 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.707 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.708 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.708 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-11-30T23:27:44.708 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-11-30T23:27:44.708 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.708 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.708 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.708 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.708 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.709 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.709 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.709 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.709 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.709 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.709 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.709 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-11-30T23:27:44.709 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-11-30T23:27:44.710 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.710 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.710 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.710 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.710 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.710 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.710 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.710 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.711 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.711 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.711 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.711 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-11-30T23:27:44.711 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-11-30T23:27:44.711 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.711 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.711 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.712 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.712 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.712 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.712 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.712 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.712 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.712 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.712 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.713 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_ENABLED": { 2023-11-30T23:27:44.713 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_ENABLED", 2023-11-30T23:27:44.713 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.713 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.713 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.713 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.713 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.713 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.713 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.714 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.714 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.714 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.714 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.714 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-11-30T23:27:44.714 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-11-30T23:27:44.714 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.715 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.715 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.715 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-11-30T23:27:44.715 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.715 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.715 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.715 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.715 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.715 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.716 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.716 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-11-30T23:27:44.716 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-11-30T23:27:44.716 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.716 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.716 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.716 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-11-30T23:27:44.716 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.717 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.717 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.717 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.717 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.717 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.717 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.717 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.717 INFO:teuthology.orchestra.run.smithi073.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-11-30T23:27:44.717 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-11-30T23:27:44.718 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.718 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.718 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.718 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8", 2023-11-30T23:27:44.718 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.718 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.718 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.718 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.718 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.719 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.719 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.719 INFO:teuthology.orchestra.run.smithi073.stdout: "REST_REQUESTS_TIMEOUT": { 2023-11-30T23:27:44.719 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-11-30T23:27:44.719 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.719 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.719 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.719 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "45", 2023-11-30T23:27:44.720 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.720 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.720 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.720 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.720 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.720 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.720 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.720 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ACCESS_KEY": { 2023-11-30T23:27:44.721 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ACCESS_KEY", 2023-11-30T23:27:44.721 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.721 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.721 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.721 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.721 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.721 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.721 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.722 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.722 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.722 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.722 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.722 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-11-30T23:27:44.722 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-11-30T23:27:44.722 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.722 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.723 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.723 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "admin", 2023-11-30T23:27:44.723 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.723 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.723 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.723 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.723 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.723 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.723 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.724 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SECRET_KEY": { 2023-11-30T23:27:44.724 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SECRET_KEY", 2023-11-30T23:27:44.724 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.724 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.724 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.724 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.724 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.724 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.725 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.725 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.725 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.725 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.725 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.725 INFO:teuthology.orchestra.run.smithi073.stdout: "RGW_API_SSL_VERIFY": { 2023-11-30T23:27:44.725 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "RGW_API_SSL_VERIFY", 2023-11-30T23:27:44.725 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.726 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.726 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.726 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.726 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.726 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.726 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.726 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.726 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.727 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.727 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.727 INFO:teuthology.orchestra.run.smithi073.stdout: "UNSAFE_TLS_v1_2": { 2023-11-30T23:27:44.727 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "UNSAFE_TLS_v1_2", 2023-11-30T23:27:44.727 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.727 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.727 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.727 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.728 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.728 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.728 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.728 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.728 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.728 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.728 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.728 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-11-30T23:27:44.729 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-11-30T23:27:44.729 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.729 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.729 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.729 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-11-30T23:27:44.729 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.729 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.729 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.729 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-11-30T23:27:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-11-30T23:27:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.731 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-11-30T23:27:44.731 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.731 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.731 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.731 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.731 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.731 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.731 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-11-30T23:27:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-11-30T23:27:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-11-30T23:27:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: "cross_origin_url": { 2023-11-30T23:27:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cross_origin_url", 2023-11-30T23:27:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "crt_file": { 2023-11-30T23:27:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "crt_file", 2023-11-30T23:27:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: "debug": { 2023-11-30T23:27:44.737 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "debug", 2023-11-30T23:27:44.737 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.737 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.737 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.737 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.737 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.737 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.737 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Enable/disable debug options", 2023-11-30T23:27:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: "jwt_token_ttl": { 2023-11-30T23:27:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "jwt_token_ttl", 2023-11-30T23:27:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "28800", 2023-11-30T23:27:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2023-11-30T23:27:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2023-11-30T23:27:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: "motd": { 2023-11-30T23:27:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "motd", 2023-11-30T23:27:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "The message of the day", 2023-11-30T23:27:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect_resolve_ip_addr": { 2023-11-30T23:27:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "redirect_resolve_ip_addr", 2023-11-30T23:27:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.752 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.752 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.752 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.752 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.752 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.752 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.752 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.752 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2023-11-30T23:27:44.753 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2023-11-30T23:27:44.753 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.753 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.753 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.753 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2023-11-30T23:27:44.753 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.753 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.753 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.753 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.754 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.754 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.754 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.754 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2023-11-30T23:27:44.754 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2023-11-30T23:27:44.754 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.754 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.755 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.755 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8080", 2023-11-30T23:27:44.755 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.755 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.755 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.755 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.755 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.755 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.755 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.756 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2023-11-30T23:27:44.756 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2023-11-30T23:27:44.756 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.756 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.756 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.756 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.756 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.756 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.757 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.757 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.757 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.757 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.757 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.757 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl_server_port": { 2023-11-30T23:27:44.757 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl_server_port", 2023-11-30T23:27:44.757 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.758 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.758 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.758 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8443", 2023-11-30T23:27:44.758 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.758 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.758 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.758 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.758 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.759 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.759 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.759 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2023-11-30T23:27:44.759 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2023-11-30T23:27:44.759 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.759 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.759 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.759 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "redirect", 2023-11-30T23:27:44.760 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.760 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.760 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.760 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.760 INFO:teuthology.orchestra.run.smithi073.stdout: "redirect" 2023-11-30T23:27:44.760 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.760 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.760 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.760 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.761 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.761 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2023-11-30T23:27:44.761 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2023-11-30T23:27:44.761 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.761 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.761 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.761 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2023-11-30T23:27:44.761 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2023-11-30T23:27:44.762 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2023-11-30T23:27:44.762 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.762 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.762 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.762 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.762 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.762 INFO:teuthology.orchestra.run.smithi073.stdout: "url_prefix": { 2023-11-30T23:27:44.763 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url_prefix", 2023-11-30T23:27:44.763 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.763 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.763 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.763 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.763 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.763 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.763 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.763 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.764 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.764 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.764 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.764 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.764 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.764 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "devicehealth", 2023-11-30T23:27:44.764 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.765 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.765 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.765 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_monitoring": { 2023-11-30T23:27:44.765 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_monitoring", 2023-11-30T23:27:44.765 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.765 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.765 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.765 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.765 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.766 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.766 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.766 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "monitor device health metrics", 2023-11-30T23:27:44.766 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.766 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.766 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.766 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.767 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.767 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.767 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.767 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.767 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.767 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.767 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.767 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.767 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.768 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.768 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.768 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.768 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.768 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.768 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.768 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.768 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.768 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.769 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.769 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.769 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.769 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.769 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.769 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.769 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.769 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.770 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.770 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.770 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.770 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.770 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.770 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.770 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.771 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.771 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.771 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.771 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.771 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.771 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.771 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.771 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.771 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.772 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.772 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.772 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.772 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.772 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.772 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.772 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.772 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.772 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.773 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.774 INFO:teuthology.orchestra.run.smithi073.stdout: "mark_out_threshold": { 2023-11-30T23:27:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mark_out_threshold", 2023-11-30T23:27:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "2419200", 2023-11-30T23:27:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.775 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-11-30T23:27:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": { 2023-11-30T23:27:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pool_name", 2023-11-30T23:27:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.776 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "device_health_metrics", 2023-11-30T23:27:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name of pool in which to store device health metrics", 2023-11-30T23:27:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "retention_period": { 2023-11-30T23:27:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "retention_period", 2023-11-30T23:27:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15552000", 2023-11-30T23:27:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.778 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long to retain device health metrics", 2023-11-30T23:27:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_frequency": { 2023-11-30T23:27:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_frequency", 2023-11-30T23:27:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.779 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2023-11-30T23:27:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to scrape device health metrics", 2023-11-30T23:27:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.780 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "self_heal": { 2023-11-30T23:27:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "self_heal", 2023-11-30T23:27:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.781 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-11-30T23:27:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-11-30T23:27:44.782 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-11-30T23:27:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-11-30T23:27:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.783 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how frequently to wake up and check device health", 2023-11-30T23:27:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "warn_threshold": { 2023-11-30T23:27:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "warn_threshold", 2023-11-30T23:27:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.784 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "7257600", 2023-11-30T23:27:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-11-30T23:27:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.785 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.786 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.786 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "diskprediction_local", 2023-11-30T23:27:44.786 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.786 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.786 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.786 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.787 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.788 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.789 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.790 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.791 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "predict_interval": { 2023-11-30T23:27:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predict_interval", 2023-11-30T23:27:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "86400", 2023-11-30T23:27:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "predictor_model": { 2023-11-30T23:27:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "predictor_model", 2023-11-30T23:27:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "prophetstor", 2023-11-30T23:27:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-11-30T23:27:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-11-30T23:27:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "600", 2023-11-30T23:27:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.799 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.799 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.799 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.799 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.799 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.799 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.799 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "influx", 2023-11-30T23:27:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": false, 2023-11-30T23:27:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "influxdb python module not found", 2023-11-30T23:27:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "batch_size": { 2023-11-30T23:27:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "batch_size", 2023-11-30T23:27:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5000", 2023-11-30T23:27:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-11-30T23:27:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "database": { 2023-11-30T23:27:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "database", 2023-11-30T23:27:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "ceph", 2023-11-30T23:27:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-11-30T23:27:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": { 2023-11-30T23:27:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "hostname", 2023-11-30T23:27:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server hostname", 2023-11-30T23:27:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-11-30T23:27:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-11-30T23:27:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "30", 2023-11-30T23:27:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "5", 2023-11-30T23:27:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-11-30T23:27:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "password": { 2023-11-30T23:27:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "password", 2023-11-30T23:27:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "password of InfluxDB server user", 2023-11-30T23:27:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "port": { 2023-11-30T23:27:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "port", 2023-11-30T23:27:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "8086", 2023-11-30T23:27:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "InfluxDB server port", 2023-11-30T23:27:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "ssl": { 2023-11-30T23:27:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "ssl", 2023-11-30T23:27:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "false", 2023-11-30T23:27:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-11-30T23:27:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "threads": { 2023-11-30T23:27:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threads", 2023-11-30T23:27:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-11-30T23:27:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-11-30T23:27:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "32", 2023-11-30T23:27:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-11-30T23:27:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "username": { 2023-11-30T23:27:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "username", 2023-11-30T23:27:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "username of InfluxDB server user", 2023-11-30T23:27:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "verify_ssl": { 2023-11-30T23:27:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "verify_ssl", 2023-11-30T23:27:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "true", 2023-11-30T23:27:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-11-30T23:27:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "insights", 2023-11-30T23:27:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.832 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.832 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.832 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.832 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.832 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.832 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.832 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.832 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.832 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "iostat", 2023-11-30T23:27:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "localpool", 2023-11-30T23:27:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: "failure_domain": { 2023-11-30T23:27:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "failure_domain", 2023-11-30T23:27:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "host", 2023-11-30T23:27:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "failure domain for any created local pool", 2023-11-30T23:27:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-11-30T23:27:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.847 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.847 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.847 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.847 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.847 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.847 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.847 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.847 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.847 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": { 2023-11-30T23:27:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "min_size", 2023-11-30T23:27:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default min_size for any created local pool", 2023-11-30T23:27:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-11-30T23:27:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: "num_rep": { 2023-11-30T23:27:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "num_rep", 2023-11-30T23:27:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3", 2023-11-30T23:27:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default replica count for any created local pool", 2023-11-30T23:27:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": { 2023-11-30T23:27:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_num", 2023-11-30T23:27:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "128", 2023-11-30T23:27:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "default pg_num for any created local pool", 2023-11-30T23:27:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "prefix": { 2023-11-30T23:27:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prefix", 2023-11-30T23:27:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "name prefix for any created local pool", 2023-11-30T23:27:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: "subtree": { 2023-11-30T23:27:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "subtree", 2023-11-30T23:27:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "rack", 2023-11-30T23:27:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "CRUSH level for which to create a local pool", 2023-11-30T23:27:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-11-30T23:27:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirroring", 2023-11-30T23:27:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.868 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.868 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.868 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.868 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.868 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.868 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.868 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.868 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.868 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "nfs", 2023-11-30T23:27:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2023-11-30T23:27:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "fail_fs": { 2023-11-30T23:27:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "fail_fs", 2023-11-30T23:27:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-11-30T23:27:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator": { 2023-11-30T23:27:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "orchestrator", 2023-11-30T23:27:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm", 2023-11-30T23:27:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "rook", 2023-11-30T23:27:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "test_orchestrator" 2023-11-30T23:27:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Orchestrator backend", 2023-11-30T23:27:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_perf_query", 2023-11-30T23:27:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "osd_support", 2023-11-30T23:27:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "pg_autoscaler", 2023-11-30T23:27:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.909 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.910 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.911 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.911 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.911 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.911 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.911 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.911 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.911 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.911 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.912 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.913 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.914 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.915 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.915 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.915 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.915 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.915 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.915 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.915 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.915 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.915 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-11-30T23:27:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-11-30T23:27:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.916 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.917 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-11-30T23:27:44.917 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.917 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.917 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.917 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.917 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.917 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.917 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "threshold": { 2023-11-30T23:27:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "threshold", 2023-11-30T23:27:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-11-30T23:27:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "3.0", 2023-11-30T23:27:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1.0", 2023-11-30T23:27:44.918 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.919 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.919 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "scaling threshold", 2023-11-30T23:27:44.919 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-11-30T23:27:44.919 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.919 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.919 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.919 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "progress", 2023-11-30T23:27:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_pg_recovery_event": { 2023-11-30T23:27:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_pg_recovery_event", 2023-11-30T23:27:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.920 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.921 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.921 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.921 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.921 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.921 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow the module to show pg recovery progress", 2023-11-30T23:27:44.921 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.921 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.921 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2023-11-30T23:27:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2023-11-30T23:27:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.922 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.923 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.924 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.924 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.924 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.924 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.924 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.924 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.924 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.924 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.924 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.925 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.925 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.925 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.925 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.925 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.925 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.925 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.925 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.926 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.926 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.926 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.926 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.926 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.926 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.926 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.926 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.927 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.928 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.928 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.928 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.928 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.928 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.928 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.928 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.928 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.928 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: "max_completed_events": { 2023-11-30T23:27:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_completed_events", 2023-11-30T23:27:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "50", 2023-11-30T23:27:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "number of past completed events to remember", 2023-11-30T23:27:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: "sleep_interval": { 2023-11-30T23:27:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "sleep_interval", 2023-11-30T23:27:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "5", 2023-11-30T23:27:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "how long the module is going to sleep", 2023-11-30T23:27:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "prometheus", 2023-11-30T23:27:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: "cache": { 2023-11-30T23:27:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "cache", 2023-11-30T23:27:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.935 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.936 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.936 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.936 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.936 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.936 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.936 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.936 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.936 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.936 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: "exclude_perf_counters": { 2023-11-30T23:27:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "exclude_perf_counters", 2023-11-30T23:27:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.937 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-11-30T23:27:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-11-30T23:27:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.938 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.939 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.940 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.941 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.942 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.943 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.944 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.945 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.945 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.945 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.945 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.945 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.945 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.945 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.946 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools": { 2023-11-30T23:27:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools", 2023-11-30T23:27:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.947 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_stats_pools_refresh_interval": { 2023-11-30T23:27:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-11-30T23:27:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.948 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "300", 2023-11-30T23:27:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: "scrape_interval": { 2023-11-30T23:27:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "scrape_interval", 2023-11-30T23:27:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-11-30T23:27:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15.0", 2023-11-30T23:27:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.950 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2023-11-30T23:27:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2023-11-30T23:27:44.951 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "::", 2023-11-30T23:27:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-11-30T23:27:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.952 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.953 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.953 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2023-11-30T23:27:44.953 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2023-11-30T23:27:44.953 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.953 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.953 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.953 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "9283", 2023-11-30T23:27:44.953 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.954 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.954 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.954 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-11-30T23:27:44.954 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.954 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.954 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.954 INFO:teuthology.orchestra.run.smithi073.stdout: "stale_cache_strategy": { 2023-11-30T23:27:44.955 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stale_cache_strategy", 2023-11-30T23:27:44.955 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.955 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.955 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.955 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "log", 2023-11-30T23:27:44.955 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.955 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.955 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.955 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.956 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.956 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.956 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.956 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_behaviour": { 2023-11-30T23:27:44.956 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_behaviour", 2023-11-30T23:27:44.956 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.956 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.957 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.957 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "default", 2023-11-30T23:27:44.957 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.957 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.957 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.957 INFO:teuthology.orchestra.run.smithi073.stdout: "default", 2023-11-30T23:27:44.957 INFO:teuthology.orchestra.run.smithi073.stdout: "error" 2023-11-30T23:27:44.957 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.957 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.958 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.958 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.958 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.958 INFO:teuthology.orchestra.run.smithi073.stdout: "standby_error_status_code": { 2023-11-30T23:27:44.958 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "standby_error_status_code", 2023-11-30T23:27:44.958 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.958 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.958 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.959 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "500", 2023-11-30T23:27:44.959 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "400", 2023-11-30T23:27:44.959 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "599", 2023-11-30T23:27:44.959 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.959 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.959 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.959 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.959 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.959 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.960 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.960 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_support", 2023-11-30T23:27:44.960 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.960 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.960 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.960 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.960 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.961 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.961 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.961 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.961 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.961 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.961 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.961 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.961 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.961 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.962 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.962 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.962 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.962 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.962 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.962 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.962 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.962 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.963 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.963 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.963 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.963 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.963 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.963 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.963 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.963 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.964 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.964 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.964 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.964 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.964 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.964 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.964 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.965 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.965 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.965 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.965 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.965 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.965 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.965 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.965 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.965 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.966 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.966 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.966 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.966 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.966 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.966 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.966 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.966 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.966 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.967 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.967 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.967 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.967 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.967 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.967 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.967 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.967 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.968 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.968 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.968 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.968 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.968 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.968 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.968 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_snap_create": { 2023-11-30T23:27:44.969 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_snap_create", 2023-11-30T23:27:44.969 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:44.969 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.969 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.969 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10", 2023-11-30T23:27:44.969 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.969 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.969 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.969 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.970 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.970 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.970 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.970 INFO:teuthology.orchestra.run.smithi073.stdout: "mirror_snapshot_schedule": { 2023-11-30T23:27:44.970 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mirror_snapshot_schedule", 2023-11-30T23:27:44.970 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.970 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.971 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.971 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.971 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.971 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.971 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.971 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.971 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.971 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.971 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.972 INFO:teuthology.orchestra.run.smithi073.stdout: "trash_purge_schedule": { 2023-11-30T23:27:44.972 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "trash_purge_schedule", 2023-11-30T23:27:44.972 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.972 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.972 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.972 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.972 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.972 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.973 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.973 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.973 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.973 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.973 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.973 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.973 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.974 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "restful", 2023-11-30T23:27:44.974 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.974 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.974 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.974 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_auth": { 2023-11-30T23:27:44.974 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enable_auth", 2023-11-30T23:27:44.974 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.974 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.975 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.975 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:44.975 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.975 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.975 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.975 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.975 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.975 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.975 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.976 INFO:teuthology.orchestra.run.smithi073.stdout: "key_file": { 2023-11-30T23:27:44.976 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "key_file", 2023-11-30T23:27:44.976 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.976 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.976 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.976 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.976 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.977 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.977 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.977 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.977 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.977 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.977 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.977 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.977 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.978 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.978 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.978 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.978 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.978 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.978 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.978 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.978 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.978 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.979 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.979 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.979 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.979 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.979 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.979 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.979 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.979 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.980 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.980 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.980 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.980 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.980 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.980 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.980 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.980 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.981 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.981 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.981 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.981 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.981 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.981 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.981 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.981 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.982 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.982 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.982 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.982 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.982 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.982 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.982 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.982 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.983 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.983 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.983 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.983 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.983 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.983 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.983 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.983 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.983 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.984 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.984 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.984 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.984 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.984 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.984 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.984 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.984 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.985 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.985 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.985 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.985 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.985 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.985 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.985 INFO:teuthology.orchestra.run.smithi073.stdout: "server_addr": { 2023-11-30T23:27:44.985 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_addr", 2023-11-30T23:27:44.986 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.986 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.986 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.986 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.986 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.986 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.986 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.986 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.986 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.987 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.987 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.987 INFO:teuthology.orchestra.run.smithi073.stdout: "server_port": { 2023-11-30T23:27:44.987 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "server_port", 2023-11-30T23:27:44.987 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.987 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.987 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:44.988 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.988 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.988 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.988 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.988 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.988 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.988 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.988 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.988 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.989 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:44.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:44.989 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "selftest", 2023-11-30T23:27:44.989 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:44.989 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:44.989 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:44.989 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:44.989 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:44.990 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.990 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.990 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.990 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:44.990 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.990 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.990 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.993 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.993 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.993 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.994 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.994 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.994 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.994 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.994 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.994 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.994 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.994 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.995 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:44.995 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:44.995 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.995 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.995 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.995 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.995 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.995 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.996 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:44.996 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.996 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.996 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.996 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.996 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:44.996 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:44.996 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:44.997 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.997 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.997 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:44.997 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.997 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:44.997 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:44.997 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:44.997 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:44.997 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:44.998 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:44.998 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:44.998 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:44.998 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:44.998 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:44.998 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:44.998 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:44.998 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:44.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:44.999 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:44.999 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:44.999 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:44.999 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:44.999 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:44.999 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:44.999 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:44.999 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.000 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.000 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.000 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.000 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.000 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.000 INFO:teuthology.orchestra.run.smithi073.stdout: "roption1": { 2023-11-30T23:27:45.000 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption1", 2023-11-30T23:27:45.000 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.001 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.001 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.001 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.001 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.001 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.001 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.002 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.002 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.002 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.002 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.002 INFO:teuthology.orchestra.run.smithi073.stdout: "roption2": { 2023-11-30T23:27:45.002 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "roption2", 2023-11-30T23:27:45.002 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.002 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.003 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.003 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "xyz", 2023-11-30T23:27:45.003 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.003 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.003 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.003 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.003 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.003 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.004 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.004 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption1": { 2023-11-30T23:27:45.004 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption1", 2023-11-30T23:27:45.004 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.004 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.004 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.004 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.004 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.005 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.005 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.005 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.005 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.005 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.005 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.005 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption2": { 2023-11-30T23:27:45.005 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption2", 2023-11-30T23:27:45.006 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:45.006 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.006 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.006 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.006 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.006 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.006 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.006 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.006 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.007 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.007 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.007 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption3": { 2023-11-30T23:27:45.007 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption3", 2023-11-30T23:27:45.007 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "float", 2023-11-30T23:27:45.007 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.007 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.008 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.008 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.008 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.008 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.008 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.008 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.008 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.008 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.009 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption4": { 2023-11-30T23:27:45.009 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption4", 2023-11-30T23:27:45.009 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.009 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.009 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.009 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.009 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.009 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.009 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.010 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.010 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.010 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.010 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.010 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption5": { 2023-11-30T23:27:45.010 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption5", 2023-11-30T23:27:45.010 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.010 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.011 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.011 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.011 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.011 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.011 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.011 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.011 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.011 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.011 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.012 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption6": { 2023-11-30T23:27:45.012 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption6", 2023-11-30T23:27:45.012 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.012 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.012 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.012 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:45.012 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.012 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.013 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.013 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.013 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.013 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.013 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.013 INFO:teuthology.orchestra.run.smithi073.stdout: "rwoption7": { 2023-11-30T23:27:45.013 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rwoption7", 2023-11-30T23:27:45.013 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:45.014 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.014 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.014 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.014 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "1", 2023-11-30T23:27:45.014 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "42", 2023-11-30T23:27:45.014 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.014 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.014 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.015 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.015 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.015 INFO:teuthology.orchestra.run.smithi073.stdout: "testkey": { 2023-11-30T23:27:45.015 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testkey", 2023-11-30T23:27:45.015 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.015 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.015 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.015 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.016 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.016 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.016 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.016 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.016 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.016 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.016 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.016 INFO:teuthology.orchestra.run.smithi073.stdout: "testlkey": { 2023-11-30T23:27:45.017 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testlkey", 2023-11-30T23:27:45.017 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.017 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.017 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.017 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.017 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.017 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.017 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.017 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout: "testnewline": { 2023-11-30T23:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "testnewline", 2023-11-30T23:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.018 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.019 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.019 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.019 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.019 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.019 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.019 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.019 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.019 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.019 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.020 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:45.020 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snap_schedule", 2023-11-30T23:27:45.020 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:45.020 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:45.020 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:45.020 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_m_granularity": { 2023-11-30T23:27:45.021 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "allow_m_granularity", 2023-11-30T23:27:45.021 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.021 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.021 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.021 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.021 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.021 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.021 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.021 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "allow minute scheduled snapshots", 2023-11-30T23:27:45.022 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.022 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.022 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.022 INFO:teuthology.orchestra.run.smithi073.stdout: "dump_on_update": { 2023-11-30T23:27:45.022 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "dump_on_update", 2023-11-30T23:27:45.022 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.022 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.022 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.023 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.023 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.023 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.023 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.023 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "dump database to debug log on update", 2023-11-30T23:27:45.023 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.023 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.023 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.024 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:45.024 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:45.024 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.024 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.024 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.024 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.024 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.024 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.025 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:45.025 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:45.025 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:45.025 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:45.025 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:45.025 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:45.025 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:45.025 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.025 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.026 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.026 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.026 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.026 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:45.026 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:45.026 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.026 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.026 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.027 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.027 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.027 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.027 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.027 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.027 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.027 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.027 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.028 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:45.028 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:45.028 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.028 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.028 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.028 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:45.028 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.028 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.028 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:45.029 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:45.029 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:45.029 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:45.029 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:45.029 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:45.029 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:45.029 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.029 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.030 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.030 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.030 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.030 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:45.030 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:45.030 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.030 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.030 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.031 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.031 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.031 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.031 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.031 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.031 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.031 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.031 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.031 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.032 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:45.032 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "stats", 2023-11-30T23:27:45.032 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:45.032 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:45.032 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:45.032 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:45.033 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:45.033 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.033 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.033 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.033 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.033 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.033 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.033 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:45.033 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.034 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.035 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.036 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:45.037 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.038 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.039 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.040 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "status", 2023-11-30T23:27:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:45.041 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:45.042 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.043 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.044 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:45.045 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:45.046 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telegraf", 2023-11-30T23:27:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "address": { 2023-11-30T23:27:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "address", 2023-11-30T23:27:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-11-30T23:27:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-11-30T23:27:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-11-30T23:27:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "15", 2023-11-30T23:27:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "telemetry", 2023-11-30T23:27:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_basic": { 2023-11-30T23:27:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_basic", 2023-11-30T23:27:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share basic cluster information (size, version)", 2023-11-30T23:27:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_crash": { 2023-11-30T23:27:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_crash", 2023-11-30T23:27:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-11-30T23:27:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_device": { 2023-11-30T23:27:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_device", 2023-11-30T23:27:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "True", 2023-11-30T23:27:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-11-30T23:27:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_ident": { 2023-11-30T23:27:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_ident", 2023-11-30T23:27:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-11-30T23:27:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "channel_perf": { 2023-11-30T23:27:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "channel_perf", 2023-11-30T23:27:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Share various performance metrics of a cluster", 2023-11-30T23:27:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "contact": { 2023-11-30T23:27:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "contact", 2023-11-30T23:27:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "description": { 2023-11-30T23:27:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "description", 2023-11-30T23:27:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "device_url": { 2023-11-30T23:27:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "device_url", 2023-11-30T23:27:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-11-30T23:27:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "enabled": { 2023-11-30T23:27:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "enabled", 2023-11-30T23:27:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-11-30T23:27:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-11-30T23:27:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "24", 2023-11-30T23:27:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "8", 2023-11-30T23:27:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: "last_opt_revision": { 2023-11-30T23:27:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "last_opt_revision", 2023-11-30T23:27:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:45.078 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "1", 2023-11-30T23:27:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.079 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard": { 2023-11-30T23:27:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard", 2023-11-30T23:27:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.080 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.081 INFO:teuthology.orchestra.run.smithi073.stdout: "leaderboard_description": { 2023-11-30T23:27:45.082 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "leaderboard_description", 2023-11-30T23:27:45.082 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.082 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.082 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.083 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.084 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.084 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.084 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:45.084 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:45.084 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.085 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:45.086 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:45.086 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:45.086 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:45.086 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:45.086 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:45.087 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:45.087 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.087 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.087 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.087 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.088 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.089 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.089 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.089 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.089 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.090 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.090 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.090 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.090 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.091 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:45.091 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:45.091 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.091 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.091 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.092 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:45.092 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.092 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.092 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:45.092 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:45.092 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.093 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.094 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.094 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.094 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.094 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:45.094 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.095 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: "organization": { 2023-11-30T23:27:45.096 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "organization", 2023-11-30T23:27:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.097 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.098 INFO:teuthology.orchestra.run.smithi073.stdout: "proxy": { 2023-11-30T23:27:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "proxy", 2023-11-30T23:27:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.099 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: "url": { 2023-11-30T23:27:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "url", 2023-11-30T23:27:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-11-30T23:27:45.101 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.102 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.102 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.102 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.102 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.102 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.102 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "test_orchestrator", 2023-11-30T23:27:45.103 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.104 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:45.105 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.106 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "volumes", 2023-11-30T23:27:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.118 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.119 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:45.120 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:45.121 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.123 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.124 INFO:teuthology.orchestra.run.smithi073.stdout: "max_concurrent_clones": { 2023-11-30T23:27:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "max_concurrent_clones", 2023-11-30T23:27:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "4", 2023-11-30T23:27:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.125 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Number of asynchronous cloner threads", 2023-11-30T23:27:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: "snapshot_clone_delay": { 2023-11-30T23:27:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "snapshot_clone_delay", 2023-11-30T23:27:45.126 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "0", 2023-11-30T23:27:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-11-30T23:27:45.127 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix", 2023-11-30T23:27:45.128 INFO:teuthology.orchestra.run.smithi073.stdout: "can_run": true, 2023-11-30T23:27:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: "error_string": "", 2023-11-30T23:27:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: "module_options": { 2023-11-30T23:27:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: "discovery_interval": { 2023-11-30T23:27:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "discovery_interval", 2023-11-30T23:27:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "uint", 2023-11-30T23:27:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.129 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "100", 2023-11-30T23:27:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.130 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: "identifier": { 2023-11-30T23:27:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "identifier", 2023-11-30T23:27:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.131 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.132 INFO:teuthology.orchestra.run.smithi073.stdout: "interval": { 2023-11-30T23:27:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "interval", 2023-11-30T23:27:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "secs", 2023-11-30T23:27:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "60", 2023-11-30T23:27:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.133 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: "log_level": { 2023-11-30T23:27:45.134 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_level", 2023-11-30T23:27:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:45.135 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.136 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster": { 2023-11-30T23:27:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster", 2023-11-30T23:27:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.137 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.138 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_cluster_level": { 2023-11-30T23:27:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_cluster_level", 2023-11-30T23:27:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.139 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "info", 2023-11-30T23:27:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [ 2023-11-30T23:27:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: "", 2023-11-30T23:27:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: "critical", 2023-11-30T23:27:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: "debug", 2023-11-30T23:27:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: "error", 2023-11-30T23:27:45.140 INFO:teuthology.orchestra.run.smithi073.stdout: "info", 2023-11-30T23:27:45.141 INFO:teuthology.orchestra.run.smithi073.stdout: "warning" 2023-11-30T23:27:45.141 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.141 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.141 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.141 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.141 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.141 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": { 2023-11-30T23:27:45.142 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "log_to_file", 2023-11-30T23:27:45.142 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "bool", 2023-11-30T23:27:45.142 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.142 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2023-11-30T23:27:45.142 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "False", 2023-11-30T23:27:45.142 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.142 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.142 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.143 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.143 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.143 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.143 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.143 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_host": { 2023-11-30T23:27:45.143 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_host", 2023-11-30T23:27:45.143 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.144 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.144 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.144 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "", 2023-11-30T23:27:45.144 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.144 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.144 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.144 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.144 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.145 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.145 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.145 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_port": { 2023-11-30T23:27:45.145 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_port", 2023-11-30T23:27:45.145 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "int", 2023-11-30T23:27:45.145 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.145 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.146 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "10051", 2023-11-30T23:27:45.146 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.146 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.146 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.146 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.146 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.146 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.146 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.147 INFO:teuthology.orchestra.run.smithi073.stdout: "zabbix_sender": { 2023-11-30T23:27:45.147 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "zabbix_sender", 2023-11-30T23:27:45.147 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "str", 2023-11-30T23:27:45.147 INFO:teuthology.orchestra.run.smithi073.stdout: "level": "advanced", 2023-11-30T23:27:45.147 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 0, 2023-11-30T23:27:45.147 INFO:teuthology.orchestra.run.smithi073.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-11-30T23:27:45.147 INFO:teuthology.orchestra.run.smithi073.stdout: "min": "", 2023-11-30T23:27:45.148 INFO:teuthology.orchestra.run.smithi073.stdout: "max": "", 2023-11-30T23:27:45.148 INFO:teuthology.orchestra.run.smithi073.stdout: "enum_allowed": [], 2023-11-30T23:27:45.148 INFO:teuthology.orchestra.run.smithi073.stdout: "desc": "", 2023-11-30T23:27:45.148 INFO:teuthology.orchestra.run.smithi073.stdout: "long_desc": "", 2023-11-30T23:27:45.148 INFO:teuthology.orchestra.run.smithi073.stdout: "tags": [], 2023-11-30T23:27:45.148 INFO:teuthology.orchestra.run.smithi073.stdout: "see_also": [] 2023-11-30T23:27:45.148 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.149 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.149 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.149 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.149 INFO:teuthology.orchestra.run.smithi073.stdout: "services": {}, 2023-11-30T23:27:45.149 INFO:teuthology.orchestra.run.smithi073.stdout: "always_on_modules": { 2023-11-30T23:27:45.149 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus": [ 2023-11-30T23:27:45.149 INFO:teuthology.orchestra.run.smithi073.stdout: "balancer", 2023-11-30T23:27:45.149 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2023-11-30T23:27:45.149 INFO:teuthology.orchestra.run.smithi073.stdout: "devicehealth", 2023-11-30T23:27:45.150 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator", 2023-11-30T23:27:45.150 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscaler", 2023-11-30T23:27:45.150 INFO:teuthology.orchestra.run.smithi073.stdout: "progress", 2023-11-30T23:27:45.150 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_support", 2023-11-30T23:27:45.150 INFO:teuthology.orchestra.run.smithi073.stdout: "status", 2023-11-30T23:27:45.150 INFO:teuthology.orchestra.run.smithi073.stdout: "telemetry", 2023-11-30T23:27:45.150 INFO:teuthology.orchestra.run.smithi073.stdout: "volumes" 2023-11-30T23:27:45.151 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.151 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific": [ 2023-11-30T23:27:45.151 INFO:teuthology.orchestra.run.smithi073.stdout: "balancer", 2023-11-30T23:27:45.151 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2023-11-30T23:27:45.151 INFO:teuthology.orchestra.run.smithi073.stdout: "devicehealth", 2023-11-30T23:27:45.151 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator", 2023-11-30T23:27:45.151 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscaler", 2023-11-30T23:27:45.151 INFO:teuthology.orchestra.run.smithi073.stdout: "progress", 2023-11-30T23:27:45.152 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_support", 2023-11-30T23:27:45.152 INFO:teuthology.orchestra.run.smithi073.stdout: "status", 2023-11-30T23:27:45.152 INFO:teuthology.orchestra.run.smithi073.stdout: "telemetry", 2023-11-30T23:27:45.152 INFO:teuthology.orchestra.run.smithi073.stdout: "volumes" 2023-11-30T23:27:45.152 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.152 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy": [ 2023-11-30T23:27:45.152 INFO:teuthology.orchestra.run.smithi073.stdout: "balancer", 2023-11-30T23:27:45.152 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2023-11-30T23:27:45.153 INFO:teuthology.orchestra.run.smithi073.stdout: "devicehealth", 2023-11-30T23:27:45.153 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator", 2023-11-30T23:27:45.153 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscaler", 2023-11-30T23:27:45.153 INFO:teuthology.orchestra.run.smithi073.stdout: "progress", 2023-11-30T23:27:45.153 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_support", 2023-11-30T23:27:45.153 INFO:teuthology.orchestra.run.smithi073.stdout: "status", 2023-11-30T23:27:45.153 INFO:teuthology.orchestra.run.smithi073.stdout: "telemetry", 2023-11-30T23:27:45.153 INFO:teuthology.orchestra.run.smithi073.stdout: "volumes" 2023-11-30T23:27:45.154 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2023-11-30T23:27:45.154 INFO:teuthology.orchestra.run.smithi073.stdout: "reef": [ 2023-11-30T23:27:45.154 INFO:teuthology.orchestra.run.smithi073.stdout: "balancer", 2023-11-30T23:27:45.154 INFO:teuthology.orchestra.run.smithi073.stdout: "crash", 2023-11-30T23:27:45.154 INFO:teuthology.orchestra.run.smithi073.stdout: "devicehealth", 2023-11-30T23:27:45.154 INFO:teuthology.orchestra.run.smithi073.stdout: "orchestrator", 2023-11-30T23:27:45.154 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscaler", 2023-11-30T23:27:45.155 INFO:teuthology.orchestra.run.smithi073.stdout: "progress", 2023-11-30T23:27:45.155 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_support", 2023-11-30T23:27:45.155 INFO:teuthology.orchestra.run.smithi073.stdout: "status", 2023-11-30T23:27:45.155 INFO:teuthology.orchestra.run.smithi073.stdout: "telemetry", 2023-11-30T23:27:45.155 INFO:teuthology.orchestra.run.smithi073.stdout: "volumes" 2023-11-30T23:27:45.155 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-30T23:27:45.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.155 INFO:teuthology.orchestra.run.smithi073.stdout: "last_failure_osd_epoch": 0, 2023-11-30T23:27:45.156 INFO:teuthology.orchestra.run.smithi073.stdout: "active_clients": [ 2023-11-30T23:27:45.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:45.156 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "devicehealth", 2023-11-30T23:27:45.157 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-11-30T23:27:45.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:45.158 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-11-30T23:27:45.158 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2023-11-30T23:27:45.158 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3254063293 2023-11-30T23:27:45.158 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.158 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-30T23:27:45.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:45.158 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "libcephsqlite", 2023-11-30T23:27:45.159 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-11-30T23:27:45.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:45.159 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-11-30T23:27:45.159 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2023-11-30T23:27:45.159 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 96674514 2023-11-30T23:27:45.159 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.159 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-30T23:27:45.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:45.160 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "rbd_support", 2023-11-30T23:27:45.160 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-11-30T23:27:45.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:45.160 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-11-30T23:27:45.160 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2023-11-30T23:27:45.160 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3191558438 2023-11-30T23:27:45.160 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.161 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-30T23:27:45.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:45.161 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "volumes", 2023-11-30T23:27:45.161 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2023-11-30T23:27:45.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-11-30T23:27:45.161 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2023-11-30T23:27:45.161 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2023-11-30T23:27:45.162 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1962912587 2023-11-30T23:27:45.162 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.162 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-30T23:27:45.162 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.162 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-11-30T23:27:45.162 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-30T23:27:45.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.846+0000 7fd25d403700 1 -- 172.21.15.73:0/3243739871 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd238065b00 msgr2=0x7fd238067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:45.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.846+0000 7fd25d403700 1 --2- 172.21.15.73:0/3243739871 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd238065b00 0x7fd238067fc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd240009c30 tx=0x7fd240009240 comp rx=0 tx=0).stop 2023-11-30T23:27:45.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.846+0000 7fd25d403700 1 -- 172.21.15.73:0/3243739871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2580722f0 msgr2=0x7fd2580b5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:45.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.846+0000 7fd25d403700 1 --2- 172.21.15.73:0/3243739871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2580722f0 0x7fd2580b5ce0 secure :-1 s=READY pgs=4215 cs=0 l=1 rev1=1 crypto rx=0x7fd2580b1cc0 tx=0x7fd250004770 comp rx=0 tx=0).stop 2023-11-30T23:27:45.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.846+0000 7fd25d403700 1 -- 172.21.15.73:0/3243739871 shutdown_connections 2023-11-30T23:27:45.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.846+0000 7fd25d403700 1 --2- 172.21.15.73:0/3243739871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2580722f0 0x7fd2580b5ce0 unknown :-1 s=CLOSED pgs=4215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:45.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.846+0000 7fd25d403700 1 --2- 172.21.15.73:0/3243739871 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd238065b00 0x7fd238067fc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:45.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.846+0000 7fd25d403700 1 --2- 172.21.15.73:0/3243739871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd25806ed80 0x7fd2580b8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:45.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.846+0000 7fd25d403700 1 --2- 172.21.15.73:0/3243739871 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd25806e050 0x7fd2581d9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:45.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.846+0000 7fd25d403700 1 -- 172.21.15.73:0/3243739871 >> 172.21.15.73:0/3243739871 conn(0x7fd2580b45a0 msgr2=0x7fd258148240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:45.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.846+0000 7fd25d403700 1 -- 172.21.15.73:0/3243739871 shutdown_connections 2023-11-30T23:27:45.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:43.846+0000 7fd25d403700 1 -- 172.21.15.73:0/3243739871 wait complete. 2023-11-30T23:27:45.170 DEBUG:tasks.check_counter:Getting stats from a 2023-11-30T23:27:45.170 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2023-11-30T23:27:45.295 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-30T23:27:45.295 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2023-11-30T23:27:45.295 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 4, 2023-11-30T23:27:45.295 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 4, 2023-11-30T23:27:45.296 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 1568, 2023-11-30T23:27:45.296 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 448, 2023-11-30T23:27:45.296 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 4, 2023-11-30T23:27:45.296 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 0, 2023-11-30T23:27:45.296 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.001826662, 2023-11-30T23:27:45.296 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.000038750, 2023-11-30T23:27:45.297 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.000871258, 2023-11-30T23:27:45.297 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-11-30T23:27:45.297 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2023-11-30T23:27:45.297 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 3, 2023-11-30T23:27:45.297 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.001511094, 2023-11-30T23:27:45.297 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000503698 2023-11-30T23:27:45.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.298 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2023-11-30T23:27:45.298 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-11-30T23:27:45.298 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-11-30T23:27:45.298 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-11-30T23:27:45.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.298 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 1568, 2023-11-30T23:27:45.298 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 448 2023-11-30T23:27:45.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.298 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2023-11-30T23:27:45.299 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 1, 2023-11-30T23:27:45.299 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 184, 2023-11-30T23:27:45.299 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 160, 2023-11-30T23:27:45.299 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 108208, 2023-11-30T23:27:45.299 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 3, 2023-11-30T23:27:45.299 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 2, 2023-11-30T23:27:45.299 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.019999243, 2023-11-30T23:27:45.299 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.015150222, 2023-11-30T23:27:45.299 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.002427925, 2023-11-30T23:27:45.300 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-11-30T23:27:45.300 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2023-11-30T23:27:45.300 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 182, 2023-11-30T23:27:45.300 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.010175857, 2023-11-30T23:27:45.300 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000055911 2023-11-30T23:27:45.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.301 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2023-11-30T23:27:45.301 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-11-30T23:27:45.301 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-11-30T23:27:45.301 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-11-30T23:27:45.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.301 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 160, 2023-11-30T23:27:45.301 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 108208 2023-11-30T23:27:45.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.301 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2023-11-30T23:27:45.302 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 244, 2023-11-30T23:27:45.302 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 241, 2023-11-30T23:27:45.302 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 155883, 2023-11-30T23:27:45.302 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 138243, 2023-11-30T23:27:45.302 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 2, 2023-11-30T23:27:45.302 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 1, 2023-11-30T23:27:45.302 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.052758778, 2023-11-30T23:27:45.302 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.021660345, 2023-11-30T23:27:45.303 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.016565666, 2023-11-30T23:27:45.303 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.010456355, 2023-11-30T23:27:45.303 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2023-11-30T23:27:45.303 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 241, 2023-11-30T23:27:45.303 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.012241458, 2023-11-30T23:27:45.303 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000050794 2023-11-30T23:27:45.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.303 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2023-11-30T23:27:45.304 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-11-30T23:27:45.304 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-11-30T23:27:45.304 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-11-30T23:27:45.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.304 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 155776, 2023-11-30T23:27:45.304 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 138112 2023-11-30T23:27:45.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.304 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2023-11-30T23:27:45.304 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 0, 2023-11-30T23:27:45.305 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2023-11-30T23:27:45.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.305 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2023-11-30T23:27:45.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2023-11-30T23:27:45.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2023-11-30T23:27:45.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2023-11-30T23:27:45.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2023-11-30T23:27:45.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2023-11-30T23:27:45.306 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2023-11-30T23:27:45.306 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2023-11-30T23:27:45.306 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2023-11-30T23:27:45.306 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2023-11-30T23:27:45.306 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2023-11-30T23:27:45.306 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2023-11-30T23:27:45.306 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2023-11-30T23:27:45.306 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2023-11-30T23:27:45.307 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2023-11-30T23:27:45.307 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2023-11-30T23:27:45.307 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2023-11-30T23:27:45.307 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2023-11-30T23:27:45.307 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2023-11-30T23:27:45.307 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2023-11-30T23:27:45.307 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2023-11-30T23:27:45.307 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2023-11-30T23:27:45.308 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2023-11-30T23:27:45.308 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2023-11-30T23:27:45.308 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2023-11-30T23:27:45.308 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2023-11-30T23:27:45.308 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2023-11-30T23:27:45.308 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2023-11-30T23:27:45.308 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2023-11-30T23:27:45.308 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2023-11-30T23:27:45.308 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2023-11-30T23:27:45.309 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2023-11-30T23:27:45.309 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2023-11-30T23:27:45.309 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2023-11-30T23:27:45.309 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2023-11-30T23:27:45.309 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2023-11-30T23:27:45.309 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2023-11-30T23:27:45.309 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 148967, 2023-11-30T23:27:45.309 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 29, 2023-11-30T23:27:45.310 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2023-11-30T23:27:45.310 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2023-11-30T23:27:45.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2023-11-30T23:27:45.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2023-11-30T23:27:45.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2023-11-30T23:27:45.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2023-11-30T23:27:45.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2023-11-30T23:27:45.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2023-11-30T23:27:45.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 0, 2023-11-30T23:27:45.311 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 0, 2023-11-30T23:27:45.311 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2023-11-30T23:27:45.311 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2023-11-30T23:27:45.311 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2023-11-30T23:27:45.311 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2023-11-30T23:27:45.311 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 928, 2023-11-30T23:27:45.311 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 2, 2023-11-30T23:27:45.311 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2023-11-30T23:27:45.312 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2023-11-30T23:27:45.312 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2023-11-30T23:27:45.312 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2023-11-30T23:27:45.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-11-30T23:27:45.312 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-11-30T23:27:45.312 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2023-11-30T23:27:45.312 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2023-11-30T23:27:45.312 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2023-11-30T23:27:45.313 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 244, 2023-11-30T23:27:45.313 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 121421, 2023-11-30T23:27:45.313 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2023-11-30T23:27:45.313 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 244, 2023-11-30T23:27:45.313 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2023-11-30T23:27:45.313 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2023-11-30T23:27:45.313 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 244, 2023-11-30T23:27:45.313 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 121421, 2023-11-30T23:27:45.313 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2023-11-30T23:27:45.314 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2023-11-30T23:27:45.314 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2023-11-30T23:27:45.314 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2023-11-30T23:27:45.314 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.314 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-11-30T23:27:45.314 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-30T23:27:45.315 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2023-11-30T23:27:45.315 DEBUG:tasks.check_counter:Getting stats from b 2023-11-30T23:27:45.316 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2023-11-30T23:27:45.424 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-11-30T23:27:45.425 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-0": { 2023-11-30T23:27:45.425 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 88821, 2023-11-30T23:27:45.425 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 106782, 2023-11-30T23:27:45.425 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 27399548, 2023-11-30T23:27:45.425 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 254955474, 2023-11-30T23:27:45.425 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 713, 2023-11-30T23:27:45.425 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 3, 2023-11-30T23:27:45.426 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 11.188939164, 2023-11-30T23:27:45.426 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 4.290934233, 2023-11-30T23:27:45.426 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 3.957919092, 2023-11-30T23:27:45.426 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 2.314583467, 2023-11-30T23:27:45.426 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-11-30T23:27:45.426 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 106781, 2023-11-30T23:27:45.427 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 37.264224302, 2023-11-30T23:27:45.427 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000348978 2023-11-30T23:27:45.427 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.427 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-11-30T23:27:45.427 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 70917, 2023-11-30T23:27:45.427 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.023571028, 2023-11-30T23:27:45.427 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000332 2023-11-30T23:27:45.427 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.428 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 0, 2023-11-30T23:27:45.428 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 0 2023-11-30T23:27:45.428 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.428 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-1": { 2023-11-30T23:27:45.428 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 276219, 2023-11-30T23:27:45.428 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 333475, 2023-11-30T23:27:45.428 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 83011805, 2023-11-30T23:27:45.428 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 293932109, 2023-11-30T23:27:45.429 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 986, 2023-11-30T23:27:45.429 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 4, 2023-11-30T23:27:45.429 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 33.445800629, 2023-11-30T23:27:45.429 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 14.597245864, 2023-11-30T23:27:45.429 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 21.527672939, 2023-11-30T23:27:45.429 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 1.555037977, 2023-11-30T23:27:45.429 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-11-30T23:27:45.429 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 333475, 2023-11-30T23:27:45.430 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 49.051613686, 2023-11-30T23:27:45.430 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000147092 2023-11-30T23:27:45.430 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.430 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-11-30T23:27:45.430 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 512997, 2023-11-30T23:27:45.430 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.162412018, 2023-11-30T23:27:45.430 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000316 2023-11-30T23:27:45.431 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.431 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 196880, 2023-11-30T23:27:45.431 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 156832 2023-11-30T23:27:45.431 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.431 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-2": { 2023-11-30T23:27:45.431 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 70083, 2023-11-30T23:27:45.431 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 69101, 2023-11-30T23:27:45.431 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 17671568, 2023-11-30T23:27:45.432 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 281049133, 2023-11-30T23:27:45.432 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 626, 2023-11-30T23:27:45.432 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 4, 2023-11-30T23:27:45.432 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 8.208017935, 2023-11-30T23:27:45.432 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 2.878671692, 2023-11-30T23:27:45.432 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 1.765863380, 2023-11-30T23:27:45.432 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 2.655936099, 2023-11-30T23:27:45.433 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-11-30T23:27:45.433 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 69100, 2023-11-30T23:27:45.433 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 42.139495139, 2023-11-30T23:27:45.433 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000609833 2023-11-30T23:27:45.433 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.433 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-11-30T23:27:45.433 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 6212, 2023-11-30T23:27:45.433 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.001784638, 2023-11-30T23:27:45.433 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000287 2023-11-30T23:27:45.434 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.434 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 160, 2023-11-30T23:27:45.434 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 400640 2023-11-30T23:27:45.434 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.434 INFO:teuthology.orchestra.run.smithi156.stdout: "cct": { 2023-11-30T23:27:45.434 INFO:teuthology.orchestra.run.smithi156.stdout: "total_workers": 1, 2023-11-30T23:27:45.434 INFO:teuthology.orchestra.run.smithi156.stdout: "unhealthy_workers": 0 2023-11-30T23:27:45.435 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.435 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-MDSRank": { 2023-11-30T23:27:45.435 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-11-30T23:27:45.435 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-11-30T23:27:45.435 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 149932, 2023-11-30T23:27:45.435 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 89.278738866, 2023-11-30T23:27:45.435 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000595461 2023-11-30T23:27:45.435 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-11-30T23:27:45.436 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.440 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-PurgeQueue": { 2023-11-30T23:27:45.441 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-11-30T23:27:45.441 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-11-30T23:27:45.441 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 23472, 2023-11-30T23:27:45.441 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 8.992584577, 2023-11-30T23:27:45.441 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000383119 2023-11-30T23:27:45.441 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-11-30T23:27:45.441 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.442 INFO:teuthology.orchestra.run.smithi156.stdout: "mds": { 2023-11-30T23:27:45.442 INFO:teuthology.orchestra.run.smithi156.stdout: "request": 114266, 2023-11-30T23:27:45.442 INFO:teuthology.orchestra.run.smithi156.stdout: "reply": 114266, 2023-11-30T23:27:45.442 INFO:teuthology.orchestra.run.smithi156.stdout: "reply_latency": { 2023-11-30T23:27:45.442 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 114266, 2023-11-30T23:27:45.442 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 234.791382443, 2023-11-30T23:27:45.442 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.002054779 2023-11-30T23:27:45.443 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.443 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_reply": 0, 2023-11-30T23:27:45.443 INFO:teuthology.orchestra.run.smithi156.stdout: "forward": 0, 2023-11-30T23:27:45.443 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_complete": 0, 2023-11-30T23:27:45.443 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_keys": 0, 2023-11-30T23:27:45.443 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_commit": 1861, 2023-11-30T23:27:45.444 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_split": 156, 2023-11-30T23:27:45.444 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_merge": 0, 2023-11-30T23:27:45.444 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes": 45578, 2023-11-30T23:27:45.444 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_top": 55, 2023-11-30T23:27:45.444 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_bottom": 45523, 2023-11-30T23:27:45.444 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pin_tail": 0, 2023-11-30T23:27:45.444 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pinned": 45499, 2023-11-30T23:27:45.444 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_expired": 0, 2023-11-30T23:27:45.444 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_with_caps": 5, 2023-11-30T23:27:45.445 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": 5, 2023-11-30T23:27:45.445 INFO:teuthology.orchestra.run.smithi156.stdout: "subtrees": 2, 2023-11-30T23:27:45.445 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse": 142132, 2023-11-30T23:27:45.445 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_hit": 141402, 2023-11-30T23:27:45.445 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_forward": 0, 2023-11-30T23:27:45.445 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_discover": 0, 2023-11-30T23:27:45.445 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_dir_fetch": 0, 2023-11-30T23:27:45.445 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_remote_ino": 0, 2023-11-30T23:27:45.446 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_lock": 17, 2023-11-30T23:27:45.446 INFO:teuthology.orchestra.run.smithi156.stdout: "load_cent": 14184, 2023-11-30T23:27:45.446 INFO:teuthology.orchestra.run.smithi156.stdout: "q": 0, 2023-11-30T23:27:45.446 INFO:teuthology.orchestra.run.smithi156.stdout: "exported": 0, 2023-11-30T23:27:45.446 INFO:teuthology.orchestra.run.smithi156.stdout: "exported_inodes": 0, 2023-11-30T23:27:45.446 INFO:teuthology.orchestra.run.smithi156.stdout: "imported": 0, 2023-11-30T23:27:45.446 INFO:teuthology.orchestra.run.smithi156.stdout: "imported_inodes": 0, 2023-11-30T23:27:45.447 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_dir_fetch": 0, 2023-11-30T23:27:45.447 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_backtrace_fetch": 1016, 2023-11-30T23:27:45.447 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_peer_discover": 0, 2023-11-30T23:27:45.447 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rfiles": 147, 2023-11-30T23:27:45.447 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rbytes": 16904814, 2023-11-30T23:27:45.447 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rsnaps": 4, 2023-11-30T23:27:45.447 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_fetch": 0, 2023-11-30T23:27:45.447 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_set_tag": 0, 2023-11-30T23:27:45.447 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_repaired": 0, 2023-11-30T23:27:45.448 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_inotable_repaired": 0, 2023-11-30T23:27:45.448 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_inodes": 0, 2023-11-30T23:27:45.448 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_base_inodes": 0, 2023-11-30T23:27:45.448 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dirfrag_rstats": 0, 2023-11-30T23:27:45.448 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_file_inodes": 0, 2023-11-30T23:27:45.448 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_inode_file_caps": 0, 2023-11-30T23:27:45.448 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_revoke": 35839, 2023-11-30T23:27:45.449 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_grant": 90493, 2023-11-30T23:27:45.449 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_trunc": 7, 2023-11-30T23:27:45.449 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-11-30T23:27:45.449 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flush_ack": 1, 2023-11-30T23:27:45.449 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps": 131653, 2023-11-30T23:27:45.449 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps_dirty": 42485, 2023-11-30T23:27:45.449 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_cap_release": 192, 2023-11-30T23:27:45.450 INFO:teuthology.orchestra.run.smithi156.stdout: "process_request_cap_release": 84953 2023-11-30T23:27:45.450 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.450 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_cache": { 2023-11-30T23:27:45.450 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update": 0, 2023-11-30T23:27:45.450 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update_receipt": 0, 2023-11-30T23:27:45.450 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_try_discover": 0, 2023-11-30T23:27:45.450 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_send_discover": 0, 2023-11-30T23:27:45.450 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_handle_discover": 0, 2023-11-30T23:27:45.451 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays": 7, 2023-11-30T23:27:45.451 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_delayed": 0, 2023-11-30T23:27:45.451 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_enqueuing": 0, 2023-11-30T23:27:45.451 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_created": 27564, 2023-11-30T23:27:45.451 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_enqueued": 27555, 2023-11-30T23:27:45.451 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_reintegrated": 9, 2023-11-30T23:27:45.451 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_migrated": 0, 2023-11-30T23:27:45.451 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_processing": 0, 2023-11-30T23:27:45.452 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_enqueued": 0, 2023-11-30T23:27:45.452 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_prioritized": 0, 2023-11-30T23:27:45.452 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_started": 0, 2023-11-30T23:27:45.452 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_completed": 0, 2023-11-30T23:27:45.452 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_enqueue_scrub": 0, 2023-11-30T23:27:45.452 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_exportdir": 0, 2023-11-30T23:27:45.452 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_flush": 0, 2023-11-30T23:27:45.452 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragmentdir": 156, 2023-11-30T23:27:45.453 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragstats": 0, 2023-11-30T23:27:45.453 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_inodestats": 0 2023-11-30T23:27:45.453 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.453 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_log": { 2023-11-30T23:27:45.453 INFO:teuthology.orchestra.run.smithi156.stdout: "evadd": 198937, 2023-11-30T23:27:45.453 INFO:teuthology.orchestra.run.smithi156.stdout: "evex": 110270, 2023-11-30T23:27:45.453 INFO:teuthology.orchestra.run.smithi156.stdout: "evtrm": 110270, 2023-11-30T23:27:45.453 INFO:teuthology.orchestra.run.smithi156.stdout: "ev": 88667, 2023-11-30T23:27:45.454 INFO:teuthology.orchestra.run.smithi156.stdout: "evexg": 0, 2023-11-30T23:27:45.454 INFO:teuthology.orchestra.run.smithi156.stdout: "evexd": 1024, 2023-11-30T23:27:45.454 INFO:teuthology.orchestra.run.smithi156.stdout: "segadd": 276, 2023-11-30T23:27:45.454 INFO:teuthology.orchestra.run.smithi156.stdout: "segex": 148, 2023-11-30T23:27:45.454 INFO:teuthology.orchestra.run.smithi156.stdout: "segtrm": 148, 2023-11-30T23:27:45.454 INFO:teuthology.orchestra.run.smithi156.stdout: "seg": 129, 2023-11-30T23:27:45.454 INFO:teuthology.orchestra.run.smithi156.stdout: "segexg": 0, 2023-11-30T23:27:45.455 INFO:teuthology.orchestra.run.smithi156.stdout: "segexd": 1, 2023-11-30T23:27:45.455 INFO:teuthology.orchestra.run.smithi156.stdout: "expos": 327146370, 2023-11-30T23:27:45.455 INFO:teuthology.orchestra.run.smithi156.stdout: "wrpos": 595057069, 2023-11-30T23:27:45.455 INFO:teuthology.orchestra.run.smithi156.stdout: "rdpos": 0, 2023-11-30T23:27:45.455 INFO:teuthology.orchestra.run.smithi156.stdout: "jlat": { 2023-11-30T23:27:45.455 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 74452, 2023-11-30T23:27:45.455 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 291.171227682, 2023-11-30T23:27:45.456 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.003910858 2023-11-30T23:27:45.456 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.456 INFO:teuthology.orchestra.run.smithi156.stdout: "replayed": 0 2023-11-30T23:27:45.456 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.456 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_mem": { 2023-11-30T23:27:45.456 INFO:teuthology.orchestra.run.smithi156.stdout: "ino": 30407, 2023-11-30T23:27:45.457 INFO:teuthology.orchestra.run.smithi156.stdout: "ino+": 68135, 2023-11-30T23:27:45.457 INFO:teuthology.orchestra.run.smithi156.stdout: "ino-": 37728, 2023-11-30T23:27:45.457 INFO:teuthology.orchestra.run.smithi156.stdout: "dir": 556, 2023-11-30T23:27:45.457 INFO:teuthology.orchestra.run.smithi156.stdout: "dir+": 1546, 2023-11-30T23:27:45.457 INFO:teuthology.orchestra.run.smithi156.stdout: "dir-": 990, 2023-11-30T23:27:45.457 INFO:teuthology.orchestra.run.smithi156.stdout: "dn": 45574, 2023-11-30T23:27:45.457 INFO:teuthology.orchestra.run.smithi156.stdout: "dn+": 95671, 2023-11-30T23:27:45.457 INFO:teuthology.orchestra.run.smithi156.stdout: "dn-": 50097, 2023-11-30T23:27:45.458 INFO:teuthology.orchestra.run.smithi156.stdout: "cap": 0, 2023-11-30T23:27:45.458 INFO:teuthology.orchestra.run.smithi156.stdout: "cap+": 33873, 2023-11-30T23:27:45.458 INFO:teuthology.orchestra.run.smithi156.stdout: "cap-": 33873, 2023-11-30T23:27:45.458 INFO:teuthology.orchestra.run.smithi156.stdout: "rss": 226044, 2023-11-30T23:27:45.458 INFO:teuthology.orchestra.run.smithi156.stdout: "heap": 207224 2023-11-30T23:27:45.458 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.458 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_server": { 2023-11-30T23:27:45.458 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_client_request": 146281, 2023-11-30T23:27:45.459 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_server_request": 0, 2023-11-30T23:27:45.459 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_request": 114266, 2023-11-30T23:27:45.459 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_session": 35783, 2023-11-30T23:27:45.459 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_peer_request": 0, 2023-11-30T23:27:45.459 INFO:teuthology.orchestra.run.smithi156.stdout: "req_create_latency": { 2023-11-30T23:27:45.459 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 27427, 2023-11-30T23:27:45.459 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 39.963361789, 2023-11-30T23:27:45.460 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001457081 2023-11-30T23:27:45.460 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.460 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getattr_latency": { 2023-11-30T23:27:45.460 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 3274, 2023-11-30T23:27:45.460 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 18.556178627, 2023-11-30T23:27:45.460 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.005667739 2023-11-30T23:27:45.461 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.461 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getfilelock_latency": { 2023-11-30T23:27:45.461 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 7, 2023-11-30T23:27:45.461 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.001968620, 2023-11-30T23:27:45.461 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000281231 2023-11-30T23:27:45.461 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.461 INFO:teuthology.orchestra.run.smithi156.stdout: "req_link_latency": { 2023-11-30T23:27:45.461 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 6, 2023-11-30T23:27:45.462 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.011814278, 2023-11-30T23:27:45.462 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001969046 2023-11-30T23:27:45.462 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.462 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookup_latency": { 2023-11-30T23:27:45.462 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 24463, 2023-11-30T23:27:45.462 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 13.554838682, 2023-11-30T23:27:45.462 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000554095 2023-11-30T23:27:45.462 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.463 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookuphash_latency": { 2023-11-30T23:27:45.463 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-11-30T23:27:45.463 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-11-30T23:27:45.463 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-11-30T23:27:45.463 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.463 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupino_latency": { 2023-11-30T23:27:45.463 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 520, 2023-11-30T23:27:45.464 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.793875775, 2023-11-30T23:27:45.464 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001526684 2023-11-30T23:27:45.464 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.464 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupname_latency": { 2023-11-30T23:27:45.464 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-11-30T23:27:45.464 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-11-30T23:27:45.465 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-11-30T23:27:45.465 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.465 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupparent_latency": { 2023-11-30T23:27:45.465 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 4, 2023-11-30T23:27:45.465 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000299475, 2023-11-30T23:27:45.465 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000074868 2023-11-30T23:27:45.465 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.466 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupsnap_latency": { 2023-11-30T23:27:45.466 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 223, 2023-11-30T23:27:45.466 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.122823710, 2023-11-30T23:27:45.466 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000550778 2023-11-30T23:27:45.466 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.466 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lssnap_latency": { 2023-11-30T23:27:45.466 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-11-30T23:27:45.467 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-11-30T23:27:45.467 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-11-30T23:27:45.467 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.467 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mkdir_latency": { 2023-11-30T23:27:45.467 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 299, 2023-11-30T23:27:45.467 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.933504546, 2023-11-30T23:27:45.467 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.003122088 2023-11-30T23:27:45.468 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.468 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mknod_latency": { 2023-11-30T23:27:45.468 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-11-30T23:27:45.468 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-11-30T23:27:45.468 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-11-30T23:27:45.468 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.468 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mksnap_latency": { 2023-11-30T23:27:45.469 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 34, 2023-11-30T23:27:45.469 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.621496948, 2023-11-30T23:27:45.469 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.018279322 2023-11-30T23:27:45.469 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.469 INFO:teuthology.orchestra.run.smithi156.stdout: "req_open_latency": { 2023-11-30T23:27:45.469 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 15124, 2023-11-30T23:27:45.469 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 19.171471811, 2023-11-30T23:27:45.470 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001267619 2023-11-30T23:27:45.470 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.470 INFO:teuthology.orchestra.run.smithi156.stdout: "req_readdir_latency": { 2023-11-30T23:27:45.470 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 2244, 2023-11-30T23:27:45.470 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 29.654509751, 2023-11-30T23:27:45.470 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.013215022 2023-11-30T23:27:45.470 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.471 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rename_latency": { 2023-11-30T23:27:45.471 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 20, 2023-11-30T23:27:45.471 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.112263296, 2023-11-30T23:27:45.471 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.005613164 2023-11-30T23:27:45.471 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.471 INFO:teuthology.orchestra.run.smithi156.stdout: "req_renamesnap_latency": { 2023-11-30T23:27:45.471 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 2, 2023-11-30T23:27:45.472 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.018008925, 2023-11-30T23:27:45.472 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.009004462 2023-11-30T23:27:45.472 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.472 INFO:teuthology.orchestra.run.smithi156.stdout: "req_snapdiff_latency": { 2023-11-30T23:27:45.472 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1083, 2023-11-30T23:27:45.472 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 1.627971809, 2023-11-30T23:27:45.473 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001503205 2023-11-30T23:27:45.473 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.473 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmdir_latency": { 2023-11-30T23:27:45.473 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 272, 2023-11-30T23:27:45.473 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 2.704310258, 2023-11-30T23:27:45.473 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.009942317 2023-11-30T23:27:45.473 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.474 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmsnap_latency": { 2023-11-30T23:27:45.474 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 30, 2023-11-30T23:27:45.474 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.340767009, 2023-11-30T23:27:45.474 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.011358900 2023-11-30T23:27:45.474 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.474 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmxattr_latency": { 2023-11-30T23:27:45.474 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 56, 2023-11-30T23:27:45.475 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.068228369, 2023-11-30T23:27:45.475 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001218363 2023-11-30T23:27:45.475 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.475 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setattr_latency": { 2023-11-30T23:27:45.475 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 11635, 2023-11-30T23:27:45.475 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 56.064446367, 2023-11-30T23:27:45.475 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.004818603 2023-11-30T23:27:45.475 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.476 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setdirlayout_latency": { 2023-11-30T23:27:45.476 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-11-30T23:27:45.476 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-11-30T23:27:45.476 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-11-30T23:27:45.476 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.476 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setfilelock_latency": { 2023-11-30T23:27:45.476 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 120, 2023-11-30T23:27:45.476 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.201912215, 2023-11-30T23:27:45.476 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001682601 2023-11-30T23:27:45.477 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.477 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setlayout_latency": { 2023-11-30T23:27:45.477 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-11-30T23:27:45.477 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-11-30T23:27:45.477 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-11-30T23:27:45.477 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.477 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setxattr_latency": { 2023-11-30T23:27:45.477 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 76, 2023-11-30T23:27:45.478 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.113820426, 2023-11-30T23:27:45.478 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001497637 2023-11-30T23:27:45.478 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.478 INFO:teuthology.orchestra.run.smithi156.stdout: "req_symlink_latency": { 2023-11-30T23:27:45.478 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 26, 2023-11-30T23:27:45.478 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.024785841, 2023-11-30T23:27:45.478 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000953301 2023-11-30T23:27:45.479 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.479 INFO:teuthology.orchestra.run.smithi156.stdout: "req_unlink_latency": { 2023-11-30T23:27:45.479 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 27313, 2023-11-30T23:27:45.479 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 50.126979022, 2023-11-30T23:27:45.479 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001835279 2023-11-30T23:27:45.479 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.479 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_revoke_eviction": 0, 2023-11-30T23:27:45.479 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_acquisition_throttle": 0, 2023-11-30T23:27:45.480 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getvxattr_latency": { 2023-11-30T23:27:45.480 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 8, 2023-11-30T23:27:45.480 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.001744894, 2023-11-30T23:27:45.480 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000218111 2023-11-30T23:27:45.480 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-11-30T23:27:45.480 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.480 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_sessions": { 2023-11-30T23:27:45.481 INFO:teuthology.orchestra.run.smithi156.stdout: "session_count": 0, 2023-11-30T23:27:45.481 INFO:teuthology.orchestra.run.smithi156.stdout: "session_add": 2306, 2023-11-30T23:27:45.481 INFO:teuthology.orchestra.run.smithi156.stdout: "session_remove": 2306, 2023-11-30T23:27:45.481 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_open": 0, 2023-11-30T23:27:45.481 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_stale": 0, 2023-11-30T23:27:45.481 INFO:teuthology.orchestra.run.smithi156.stdout: "total_load": 11954, 2023-11-30T23:27:45.481 INFO:teuthology.orchestra.run.smithi156.stdout: "average_load": 11954, 2023-11-30T23:27:45.481 INFO:teuthology.orchestra.run.smithi156.stdout: "avg_session_uptime": 1, 2023-11-30T23:27:45.481 INFO:teuthology.orchestra.run.smithi156.stdout: "mdthresh_evicted": 0 2023-11-30T23:27:45.482 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.482 INFO:teuthology.orchestra.run.smithi156.stdout: "mempool": { 2023-11-30T23:27:45.482 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_bytes": 0, 2023-11-30T23:27:45.482 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_items": 0, 2023-11-30T23:27:45.482 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_bytes": 0, 2023-11-30T23:27:45.482 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_items": 0, 2023-11-30T23:27:45.482 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_bytes": 0, 2023-11-30T23:27:45.482 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_items": 0, 2023-11-30T23:27:45.483 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_bytes": 0, 2023-11-30T23:27:45.483 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_items": 0, 2023-11-30T23:27:45.483 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_bytes": 0, 2023-11-30T23:27:45.483 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_items": 0, 2023-11-30T23:27:45.483 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_bytes": 0, 2023-11-30T23:27:45.483 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_items": 0, 2023-11-30T23:27:45.483 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_bytes": 0, 2023-11-30T23:27:45.483 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_items": 0, 2023-11-30T23:27:45.484 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_bytes": 0, 2023-11-30T23:27:45.484 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_items": 0, 2023-11-30T23:27:45.484 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_bytes": 0, 2023-11-30T23:27:45.484 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_items": 0, 2023-11-30T23:27:45.484 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_bytes": 0, 2023-11-30T23:27:45.484 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_items": 0, 2023-11-30T23:27:45.484 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_bytes": 0, 2023-11-30T23:27:45.484 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_items": 0, 2023-11-30T23:27:45.484 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_bytes": 0, 2023-11-30T23:27:45.485 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_items": 0, 2023-11-30T23:27:45.485 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_bytes": 0, 2023-11-30T23:27:45.485 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_items": 0, 2023-11-30T23:27:45.485 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_bytes": 0, 2023-11-30T23:27:45.485 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_items": 0, 2023-11-30T23:27:45.485 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_bytes": 0, 2023-11-30T23:27:45.485 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_items": 0, 2023-11-30T23:27:45.485 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_bytes": 0, 2023-11-30T23:27:45.486 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_items": 0, 2023-11-30T23:27:45.486 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_bytes": 0, 2023-11-30T23:27:45.486 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_items": 0, 2023-11-30T23:27:45.486 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_bytes": 0, 2023-11-30T23:27:45.486 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_items": 0, 2023-11-30T23:27:45.486 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_bytes": 415733, 2023-11-30T23:27:45.486 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_items": 138, 2023-11-30T23:27:45.486 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_bytes": 0, 2023-11-30T23:27:45.487 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_items": 0, 2023-11-30T23:27:45.487 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_bytes": 0, 2023-11-30T23:27:45.487 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_items": 0, 2023-11-30T23:27:45.487 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_bytes": 0, 2023-11-30T23:27:45.487 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_items": 0, 2023-11-30T23:27:45.487 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_bytes": 0, 2023-11-30T23:27:45.487 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_items": 0, 2023-11-30T23:27:45.487 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_bytes": 5904, 2023-11-30T23:27:45.488 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_items": 87, 2023-11-30T23:27:45.488 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_bytes": 0, 2023-11-30T23:27:45.488 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_items": 0, 2023-11-30T23:27:45.488 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_bytes": 0, 2023-11-30T23:27:45.488 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_items": 0, 2023-11-30T23:27:45.488 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_bytes": 94412106, 2023-11-30T23:27:45.488 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_items": 405104, 2023-11-30T23:27:45.489 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_bytes": 0, 2023-11-30T23:27:45.489 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_items": 0, 2023-11-30T23:27:45.489 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_bytes": 0, 2023-11-30T23:27:45.489 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_items": 0 2023-11-30T23:27:45.489 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.489 INFO:teuthology.orchestra.run.smithi156.stdout: "objecter": { 2023-11-30T23:27:45.490 INFO:teuthology.orchestra.run.smithi156.stdout: "op_active": 0, 2023-11-30T23:27:45.490 INFO:teuthology.orchestra.run.smithi156.stdout: "op_laggy": 0, 2023-11-30T23:27:45.490 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send": 150433, 2023-11-30T23:27:45.490 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send_bytes": 613700975, 2023-11-30T23:27:45.490 INFO:teuthology.orchestra.run.smithi156.stdout: "op_resend": 37, 2023-11-30T23:27:45.490 INFO:teuthology.orchestra.run.smithi156.stdout: "op_reply": 150433, 2023-11-30T23:27:45.490 INFO:teuthology.orchestra.run.smithi156.stdout: "op_latency": { 2023-11-30T23:27:45.491 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 150433, 2023-11-30T23:27:45.491 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 3407.004699892, 2023-11-30T23:27:45.491 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.022647987 2023-11-30T23:27:45.491 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.491 INFO:teuthology.orchestra.run.smithi156.stdout: "op_inflight": 0, 2023-11-30T23:27:45.491 INFO:teuthology.orchestra.run.smithi156.stdout: "oplen_avg": { 2023-11-30T23:27:45.491 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 150433, 2023-11-30T23:27:45.491 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 162770 2023-11-30T23:27:45.492 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.492 INFO:teuthology.orchestra.run.smithi156.stdout: "op": 150433, 2023-11-30T23:27:45.492 INFO:teuthology.orchestra.run.smithi156.stdout: "op_r": 1531, 2023-11-30T23:27:45.492 INFO:teuthology.orchestra.run.smithi156.stdout: "op_w": 148902, 2023-11-30T23:27:45.492 INFO:teuthology.orchestra.run.smithi156.stdout: "op_rmw": 0, 2023-11-30T23:27:45.492 INFO:teuthology.orchestra.run.smithi156.stdout: "op_pg": 0, 2023-11-30T23:27:45.492 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_stat": 522, 2023-11-30T23:27:45.493 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_create": 4563, 2023-11-30T23:27:45.493 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_read": 515, 2023-11-30T23:27:45.493 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_write": 74967, 2023-11-30T23:27:45.493 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writefull": 318, 2023-11-30T23:27:45.493 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writesame": 0, 2023-11-30T23:27:45.493 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_append": 0, 2023-11-30T23:27:45.493 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_zero": 0, 2023-11-30T23:27:45.494 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_truncate": 4, 2023-11-30T23:27:45.494 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_delete": 67019, 2023-11-30T23:27:45.494 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_mapext": 0, 2023-11-30T23:27:45.494 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_sparse_read": 0, 2023-11-30T23:27:45.494 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_clonerange": 0, 2023-11-30T23:27:45.494 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_getxattr": 1016, 2023-11-30T23:27:45.494 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_setxattr": 9135, 2023-11-30T23:27:45.495 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_cmpxattr": 0, 2023-11-30T23:27:45.495 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_rmxattr": 0, 2023-11-30T23:27:45.495 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_resetxattrs": 0, 2023-11-30T23:27:45.495 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_call": 0, 2023-11-30T23:27:45.495 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_watch": 0, 2023-11-30T23:27:45.495 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_notify": 0, 2023-11-30T23:27:45.495 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_src_cmpxattr": 0, 2023-11-30T23:27:45.496 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls": 0, 2023-11-30T23:27:45.496 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls_filter": 0, 2023-11-30T23:27:45.496 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_other": 6, 2023-11-30T23:27:45.496 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_active": 0, 2023-11-30T23:27:45.496 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_send": 0, 2023-11-30T23:27:45.496 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_resend": 0, 2023-11-30T23:27:45.496 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_ping": 0, 2023-11-30T23:27:45.496 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_active": 0, 2023-11-30T23:27:45.497 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_send": 0, 2023-11-30T23:27:45.497 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_resend": 0, 2023-11-30T23:27:45.497 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_active": 0, 2023-11-30T23:27:45.497 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_send": 0, 2023-11-30T23:27:45.497 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_resend": 0, 2023-11-30T23:27:45.497 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_active": 0, 2023-11-30T23:27:45.497 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_send": 0, 2023-11-30T23:27:45.498 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_resend": 0, 2023-11-30T23:27:45.498 INFO:teuthology.orchestra.run.smithi156.stdout: "command_active": 0, 2023-11-30T23:27:45.498 INFO:teuthology.orchestra.run.smithi156.stdout: "command_send": 0, 2023-11-30T23:27:45.498 INFO:teuthology.orchestra.run.smithi156.stdout: "command_resend": 0, 2023-11-30T23:27:45.498 INFO:teuthology.orchestra.run.smithi156.stdout: "map_epoch": 48, 2023-11-30T23:27:45.498 INFO:teuthology.orchestra.run.smithi156.stdout: "map_full": 0, 2023-11-30T23:27:45.498 INFO:teuthology.orchestra.run.smithi156.stdout: "map_inc": 29, 2023-11-30T23:27:45.499 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_sessions": 8, 2023-11-30T23:27:45.499 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_open": 8, 2023-11-30T23:27:45.499 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_close": 0, 2023-11-30T23:27:45.499 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_laggy": 0, 2023-11-30T23:27:45.499 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_wr": 3993, 2023-11-30T23:27:45.499 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_rd": 0, 2023-11-30T23:27:45.499 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_del": 712 2023-11-30T23:27:45.500 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.500 INFO:teuthology.orchestra.run.smithi156.stdout: "oft": { 2023-11-30T23:27:45.500 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_objs": 1, 2023-11-30T23:27:45.500 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_kv_pairs": 0, 2023-11-30T23:27:45.500 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_updates": 0, 2023-11-30T23:27:45.500 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_removes": 0 2023-11-30T23:27:45.500 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.501 INFO:teuthology.orchestra.run.smithi156.stdout: "osd-slow-ops": { 2023-11-30T23:27:45.501 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_ops_count": 114422 2023-11-30T23:27:45.501 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.501 INFO:teuthology.orchestra.run.smithi156.stdout: "purge_queue": { 2023-11-30T23:27:45.501 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops": 0, 2023-11-30T23:27:45.501 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops_high_water": 544, 2023-11-30T23:27:45.501 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing": 0, 2023-11-30T23:27:45.502 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_high_water": 32, 2023-11-30T23:27:45.502 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executed": 27555, 2023-11-30T23:27:45.502 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_item_in_journal": 0 2023-11-30T23:27:45.502 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.502 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-11-30T23:27:45.502 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-11-30T23:27:45.502 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-11-30T23:27:45.503 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-11-30T23:27:45.503 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 435119, 2023-11-30T23:27:45.503 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 88903957, 2023-11-30T23:27:45.503 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-11-30T23:27:45.503 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 435119, 2023-11-30T23:27:45.503 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-11-30T23:27:45.503 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-11-30T23:27:45.503 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 435119, 2023-11-30T23:27:45.504 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 88903957, 2023-11-30T23:27:45.504 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-11-30T23:27:45.504 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-11-30T23:27:45.504 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-11-30T23:27:45.504 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-11-30T23:27:45.504 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-11-30T23:27:45.504 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.504 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_bytes": { 2023-11-30T23:27:45.505 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-11-30T23:27:45.505 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-11-30T23:27:45.505 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-11-30T23:27:45.505 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-11-30T23:27:45.505 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-11-30T23:27:45.505 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-11-30T23:27:45.505 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-11-30T23:27:45.505 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 150433, 2023-11-30T23:27:45.505 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 616870742, 2023-11-30T23:27:45.506 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 150433, 2023-11-30T23:27:45.506 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 616870742, 2023-11-30T23:27:45.506 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-11-30T23:27:45.506 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-11-30T23:27:45.506 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-11-30T23:27:45.506 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-11-30T23:27:45.506 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-11-30T23:27:45.506 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.507 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_ops": { 2023-11-30T23:27:45.507 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-11-30T23:27:45.507 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 1024, 2023-11-30T23:27:45.507 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-11-30T23:27:45.507 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-11-30T23:27:45.507 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-11-30T23:27:45.507 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-11-30T23:27:45.507 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-11-30T23:27:45.507 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 150433, 2023-11-30T23:27:45.508 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 150433, 2023-11-30T23:27:45.508 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 150433, 2023-11-30T23:27:45.508 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 150433, 2023-11-30T23:27:45.508 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-11-30T23:27:45.508 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-11-30T23:27:45.508 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-11-30T23:27:45.508 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-11-30T23:27:45.508 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-11-30T23:27:45.509 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.509 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle": { 2023-11-30T23:27:45.509 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-11-30T23:27:45.509 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-11-30T23:27:45.509 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-11-30T23:27:45.509 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 27555, 2023-11-30T23:27:45.509 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 3169767, 2023-11-30T23:27:45.510 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-11-30T23:27:45.510 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 27555, 2023-11-30T23:27:45.510 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-11-30T23:27:45.510 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-11-30T23:27:45.510 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 515, 2023-11-30T23:27:45.510 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 3169767, 2023-11-30T23:27:45.510 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-11-30T23:27:45.511 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-11-30T23:27:45.511 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-11-30T23:27:45.511 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-11-30T23:27:45.511 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-11-30T23:27:45.511 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-11-30T23:27:45.511 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle-0x559637ee8d20": { 2023-11-30T23:27:45.511 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 2396, 2023-11-30T23:27:45.511 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-11-30T23:27:45.512 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-11-30T23:27:45.512 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 198937, 2023-11-30T23:27:45.512 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 590862765, 2023-11-30T23:27:45.512 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-11-30T23:27:45.512 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 198937, 2023-11-30T23:27:45.512 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-11-30T23:27:45.512 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-11-30T23:27:45.513 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 74452, 2023-11-30T23:27:45.513 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 590860369, 2023-11-30T23:27:45.513 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-11-30T23:27:45.513 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-11-30T23:27:45.513 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-11-30T23:27:45.513 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-11-30T23:27:45.513 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-11-30T23:27:45.513 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-11-30T23:27:45.514 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-11-30T23:27:45.515 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=156 2023-11-30T23:27:45.516 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-30T23:27:45.580 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-30T23:27:45.580 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T23:27:45.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.698+0000 7f9cc0ca5700 1 Processor -- start 2023-11-30T23:27:45.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.698+0000 7f9cc0ca5700 1 -- start start 2023-11-30T23:27:45.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.698+0000 7f9cc0ca5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc06ed80 0x7f9cbc0b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:45.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.698+0000 7f9cc0ca5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cbc13ecd0 con 0x7f9cbc0724c0 2023-11-30T23:27:45.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.698+0000 7f9cc0ca5700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cbc06f160 con 0x7f9cbc06e050 2023-11-30T23:27:45.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.698+0000 7f9cc0ca5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc0b4340 con 0x7f9cbc06ed80 2023-11-30T23:27:45.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cbbfff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9cbc0724c0 0x7f9cbc147b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48478/0 (socket says 172.21.15.73:48478) 2023-11-30T23:27:45.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cbbfff700 1 -- 172.21.15.73:0/1593779593 learned_addr learned my addr 172.21.15.73:0/1593779593 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:27:45.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cbb7fe700 1 --2- 172.21.15.73:0/1593779593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc06ed80 0x7f9cbc0b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:45.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cba7fc700 1 -- 172.21.15.73:0/1593779593 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8025809 0 0) 0x7f9cbc13ecd0 con 0x7f9cbc0724c0 2023-11-30T23:27:45.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cba7fc700 1 -- 172.21.15.73:0/1593779593 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ca40035d0 con 0x7f9cbc0724c0 2023-11-30T23:27:45.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cba7fc700 1 -- 172.21.15.73:0/1593779593 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232819002 0 0) 0x7f9cbc06f160 con 0x7f9cbc06e050 2023-11-30T23:27:45.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cba7fc700 1 -- 172.21.15.73:0/1593779593 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cbc13ecd0 con 0x7f9cbc06e050 2023-11-30T23:27:45.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cbb7fe700 1 -- 172.21.15.73:0/1593779593 >> v1:172.21.15.156:6789/0 conn(0x7f9cbc06e050 legacy=0x7f9cbc071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:45.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cbb7fe700 1 -- 172.21.15.73:0/1593779593 >> v1:172.21.15.73:6789/0 conn(0x7f9cbc0724c0 legacy=0x7f9cbc147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:45.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cbb7fe700 1 -- 172.21.15.73:0/1593779593 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc0b3900 con 0x7f9cbc06ed80 2023-11-30T23:27:45.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cbb7fe700 1 --2- 172.21.15.73:0/1593779593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc06ed80 0x7f9cbc0b1670 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00098b0 tx=0x7f9cb0009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e9bfeb12c6ddb74 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:45.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cba7fc700 1 -- 172.21.15.73:0/1593779593 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0011830 con 0x7f9cbc06ed80 2023-11-30T23:27:45.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cba7fc700 1 -- 172.21.15.73:0/1593779593 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb0011990 con 0x7f9cbc06ed80 2023-11-30T23:27:45.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cba7fc700 1 -- 172.21.15.73:0/1593779593 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0011d00 con 0x7f9cbc06ed80 2023-11-30T23:27:45.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cc0ca5700 1 -- 172.21.15.73:0/1593779593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc06ed80 msgr2=0x7f9cbc0b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:45.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cc0ca5700 1 --2- 172.21.15.73:0/1593779593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc06ed80 0x7f9cbc0b1670 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00098b0 tx=0x7f9cb0009bc0 comp rx=0 tx=0).stop 2023-11-30T23:27:45.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cc0ca5700 1 -- 172.21.15.73:0/1593779593 shutdown_connections 2023-11-30T23:27:45.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cc0ca5700 1 --2- 172.21.15.73:0/1593779593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc06ed80 0x7f9cbc0b1670 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:45.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cc0ca5700 1 -- 172.21.15.73:0/1593779593 >> 172.21.15.73:0/1593779593 conn(0x7f9cbc0b45a0 msgr2=0x7f9cbc0b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:45.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cc0ca5700 1 -- 172.21.15.73:0/1593779593 shutdown_connections 2023-11-30T23:27:45.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.702+0000 7f9cc0ca5700 1 -- 172.21.15.73:0/1593779593 wait complete. 2023-11-30T23:27:45.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cc0ca5700 1 Processor -- start 2023-11-30T23:27:45.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cc0ca5700 1 -- start start 2023-11-30T23:27:45.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cc0ca5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cbc06e050 0x7f9cbc1d0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:45.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cc0ca5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cbc06ed80 0x7f9cbc13bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:45.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cc0ca5700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc0724c0 0x7f9cbc13c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:45.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cc0ca5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc147410 con 0x7f9cbc06e050 2023-11-30T23:27:45.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cc0ca5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc145e30 con 0x7f9cbc06ed80 2023-11-30T23:27:45.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cc0ca5700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc145b50 con 0x7f9cbc0724c0 2023-11-30T23:27:45.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cbb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cbc06e050 0x7f9cbc1d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:45.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cbbfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc0724c0 0x7f9cbc13c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:45.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cbb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cbc06e050 0x7f9cbc1d0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60758/0 (socket says 172.21.15.73:60758) 2023-11-30T23:27:45.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cbb7fe700 1 -- 172.21.15.73:0/784740523 learned_addr learned my addr 172.21.15.73:0/784740523 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:45.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cbaffd700 1 --2- 172.21.15.73:0/784740523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cbc06ed80 0x7f9cbc13bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:45.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cbbfff700 1 -- 172.21.15.73:0/784740523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cbc06ed80 msgr2=0x7f9cbc13bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:45.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cbbfff700 1 --2- 172.21.15.73:0/784740523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cbc06ed80 0x7f9cbc13bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:45.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cbbfff700 1 -- 172.21.15.73:0/784740523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cbc06e050 msgr2=0x7f9cbc1d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:45.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cbbfff700 1 --2- 172.21.15.73:0/784740523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cbc06e050 0x7f9cbc1d0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cbbfff700 1 -- 172.21.15.73:0/784740523 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb00094b0 con 0x7f9cbc0724c0 2023-11-30T23:27:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cbb7fe700 1 --2- 172.21.15.73:0/784740523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cbc06e050 0x7f9cbc1d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:27:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cbbfff700 1 --2- 172.21.15.73:0/784740523 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc0724c0 0x7f9cbc13c050 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0b3780 tx=0x7f9cb400c670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9ca3fff700 1 -- 172.21.15.73:0/784740523 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4005b00 con 0x7f9cbc0724c0 2023-11-30T23:27:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9ca3fff700 1 -- 172.21.15.73:0/784740523 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb4005c60 con 0x7f9cbc0724c0 2023-11-30T23:27:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cc0ca5700 1 -- 172.21.15.73:0/784740523 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cbc1df0c0 con 0x7f9cbc0724c0 2023-11-30T23:27:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9ca3fff700 1 -- 172.21.15.73:0/784740523 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb40070d0 con 0x7f9cbc0724c0 2023-11-30T23:27:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.706+0000 7f9cc0ca5700 1 -- 172.21.15.73:0/784740523 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cbc0af390 con 0x7f9cbc0724c0 2023-11-30T23:27:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.710+0000 7f9cc0ca5700 1 -- 172.21.15.73:0/784740523 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cbc0af580 con 0x7f9cbc0724c0 2023-11-30T23:27:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.710+0000 7f9ca3fff700 1 -- 172.21.15.73:0/784740523 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9cb4007230 con 0x7f9cbc0724c0 2023-11-30T23:27:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.710+0000 7f9ca3fff700 1 --2- 172.21.15.73:0/784740523 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9ca8065ad0 0x7f9ca8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.710+0000 7f9ca3fff700 1 -- 172.21.15.73:0/784740523 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f9cb4082440 con 0x7f9cbc0724c0 2023-11-30T23:27:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.710+0000 7f9cbb7fe700 1 --2- 172.21.15.73:0/784740523 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9ca8065ad0 0x7f9ca8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:45.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.710+0000 7f9cbb7fe700 1 --2- 172.21.15.73:0/784740523 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9ca8065ad0 0x7f9ca8067f90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0000c00 tx=0x7f9cb0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:45.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.722+0000 7f9ca3fff700 1 -- 172.21.15.73:0/784740523 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f9cb404fd60 con 0x7f9cbc0724c0 2023-11-30T23:27:45.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.882+0000 7f9cc0ca5700 1 -- 172.21.15.73:0/784740523 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9cbc0b3ec0 con 0x7f9ca8065ad0 2023-11-30T23:27:45.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.894+0000 7f9ca3fff700 1 -- 172.21.15.73:0/784740523 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+293494 (secure 0 0 0) 0x7f9cb00116b0 con 0x7f9ca8065ad0 2023-11-30T23:27:45.901 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:27:45.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.902+0000 7f9cc0ca5700 1 -- 172.21.15.73:0/784740523 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9ca8065ad0 msgr2=0x7f9ca8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:45.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.902+0000 7f9cc0ca5700 1 --2- 172.21.15.73:0/784740523 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9ca8065ad0 0x7f9ca8067f90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0000c00 tx=0x7f9cb0008030 comp rx=0 tx=0).stop 2023-11-30T23:27:45.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.902+0000 7f9cc0ca5700 1 -- 172.21.15.73:0/784740523 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc0724c0 msgr2=0x7f9cbc13c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:45.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.902+0000 7f9cc0ca5700 1 --2- 172.21.15.73:0/784740523 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc0724c0 0x7f9cbc13c050 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0b3780 tx=0x7f9cb400c670 comp rx=0 tx=0).stop 2023-11-30T23:27:45.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.902+0000 7f9cc0ca5700 1 -- 172.21.15.73:0/784740523 shutdown_connections 2023-11-30T23:27:45.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.902+0000 7f9cc0ca5700 1 --2- 172.21.15.73:0/784740523 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f9cbc0724c0 0x7f9cbc13c050 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:45.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.902+0000 7f9cc0ca5700 1 --2- 172.21.15.73:0/784740523 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f9ca8065ad0 0x7f9ca8067f90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:45.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.902+0000 7f9cc0ca5700 1 --2- 172.21.15.73:0/784740523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cbc06ed80 0x7f9cbc13bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:45.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.902+0000 7f9cc0ca5700 1 --2- 172.21.15.73:0/784740523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cbc06e050 0x7f9cbc1d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:45.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.902+0000 7f9cc0ca5700 1 -- 172.21.15.73:0/784740523 >> 172.21.15.73:0/784740523 conn(0x7f9cbc0b45a0 msgr2=0x7f9cbc066490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:45.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.902+0000 7f9cc0ca5700 1 -- 172.21.15.73:0/784740523 shutdown_connections 2023-11-30T23:27:45.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:45.902+0000 7f9cc0ca5700 1 -- 172.21.15.73:0/784740523 wait complete. 2023-11-30T23:27:45.910 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-11-30T23:27:45.922 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":497,"stamp":"2023-11-30T23:27:44.670372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":275982203,"num_objects":743,"num_object_clones":28,"num_object_copies":1486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":743,"num_whiteouts":15,"num_read":1184,"num_read_kb":3541,"num_write":155907,"num_write_kb":668809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":540,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307605,"ondisk_log_size":307605,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2753952,"kb_used_data":543520,"kb_used_omap":0,"kb_used_meta":2210368,"kb_avail":752220768,"statfs":{"total":773094113280,"available":770274066432,"internally_reserved":0,"allocated":556564480,"data_stored":553942070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2263416832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,1,1,10,9,24,13],"upper_bound":256},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2058097,"num_objects":6,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":3,"num_read":6,"num_read_kb":7,"num_write":131,"num_write_kb":2089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.274157"},"pg_stats":[{"pgid":"3.3f","version":"48'3481","reported_seq":2875,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.507965+0000","last_change":"2023-11-30T23:27:40.777020+0000","last_active":"2023-11-30T23:27:41.507965+0000","last_peered":"2023-11-30T23:27:41.507965+0000","last_clean":"2023-11-30T23:27:41.507965+0000","last_became_active":"2023-11-30T23:12:47.512980+0000","last_became_peered":"2023-11-30T23:12:47.512980+0000","last_unstale":"2023-11-30T23:27:41.507965+0000","last_undegraded":"2023-11-30T23:27:41.507965+0000","last_fullsized":"2023-11-30T23:27:41.507965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:18:44.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0061607720000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1134,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3e","version":"48'3347","reported_seq":2773,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.552577+0000","last_change":"2023-11-30T23:27:40.483369+0000","last_active":"2023-11-30T23:27:41.552577+0000","last_peered":"2023-11-30T23:27:41.552577+0000","last_clean":"2023-11-30T23:27:41.552577+0000","last_became_active":"2023-11-30T23:12:47.508771+0000","last_became_peered":"2023-11-30T23:12:47.508771+0000","last_unstale":"2023-11-30T23:27:41.552577+0000","last_undegraded":"2023-11-30T23:27:41.552577+0000","last_fullsized":"2023-11-30T23:27:41.552577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3347,"log_dups_size":0,"ondisk_log_size":3347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055178039999999998,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1093,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3d","version":"48'3513","reported_seq":2913,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.509222+0000","last_change":"2023-11-30T23:27:40.561105+0000","last_active":"2023-11-30T23:27:41.509222+0000","last_peered":"2023-11-30T23:27:41.509222+0000","last_clean":"2023-11-30T23:27:41.509222+0000","last_became_active":"2023-11-30T23:12:47.507829+0000","last_became_peered":"2023-11-30T23:12:47.507829+0000","last_unstale":"2023-11-30T23:27:41.509222+0000","last_undegraded":"2023-11-30T23:27:41.509222+0000","last_fullsized":"2023-11-30T23:27:41.509222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3513,"log_dups_size":0,"ondisk_log_size":3513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:39.696562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031269901000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3c","version":"48'3599","reported_seq":2961,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.540422+0000","last_change":"2023-11-30T23:27:40.523535+0000","last_active":"2023-11-30T23:27:41.540422+0000","last_peered":"2023-11-30T23:27:41.540422+0000","last_clean":"2023-11-30T23:27:41.540422+0000","last_became_active":"2023-11-30T23:12:47.522208+0000","last_became_peered":"2023-11-30T23:12:47.522208+0000","last_unstale":"2023-11-30T23:27:41.540422+0000","last_undegraded":"2023-11-30T23:27:41.540422+0000","last_fullsized":"2023-11-30T23:27:41.540422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3599,"log_dups_size":0,"ondisk_log_size":3599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020703408,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3b","version":"48'3346","reported_seq":2724,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.454983+0000","last_change":"2023-11-30T23:27:40.475732+0000","last_active":"2023-11-30T23:27:41.454983+0000","last_peered":"2023-11-30T23:27:41.454983+0000","last_clean":"2023-11-30T23:27:41.454983+0000","last_became_active":"2023-11-30T23:13:30.302763+0000","last_became_peered":"2023-11-30T23:13:30.302763+0000","last_unstale":"2023-11-30T23:27:41.454983+0000","last_undegraded":"2023-11-30T23:27:41.454983+0000","last_fullsized":"2023-11-30T23:27:41.454983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3346,"log_dups_size":0,"ondisk_log_size":3346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:50:13.635575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047963988999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3a","version":"48'3402","reported_seq":2815,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.564969+0000","last_change":"2023-11-30T23:27:40.521728+0000","last_active":"2023-11-30T23:27:41.564969+0000","last_peered":"2023-11-30T23:27:41.564969+0000","last_clean":"2023-11-30T23:27:41.564969+0000","last_became_active":"2023-11-30T23:12:47.513491+0000","last_became_peered":"2023-11-30T23:12:47.513491+0000","last_unstale":"2023-11-30T23:27:41.564969+0000","last_undegraded":"2023-11-30T23:27:41.564969+0000","last_fullsized":"2023-11-30T23:27:41.564969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:18:44.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019296939999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.39","version":"48'3534","reported_seq":2940,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.521776+0000","last_change":"2023-11-30T23:27:40.773622+0000","last_active":"2023-11-30T23:27:41.521776+0000","last_peered":"2023-11-30T23:27:41.521776+0000","last_clean":"2023-11-30T23:27:41.521776+0000","last_became_active":"2023-11-30T23:12:47.507747+0000","last_became_peered":"2023-11-30T23:12:47.507747+0000","last_unstale":"2023-11-30T23:27:41.521776+0000","last_undegraded":"2023-11-30T23:27:41.521776+0000","last_fullsized":"2023-11-30T23:27:41.521776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3534,"log_dups_size":0,"ondisk_log_size":3534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:27.789422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0077627249999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.38","version":"48'3400","reported_seq":2784,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.559582+0000","last_change":"2023-11-30T23:27:40.523065+0000","last_active":"2023-11-30T23:27:41.559582+0000","last_peered":"2023-11-30T23:27:41.559582+0000","last_clean":"2023-11-30T23:27:41.559582+0000","last_became_active":"2023-11-30T23:12:47.523430+0000","last_became_peered":"2023-11-30T23:12:47.523430+0000","last_unstale":"2023-11-30T23:27:41.559582+0000","last_undegraded":"2023-11-30T23:27:41.559582+0000","last_fullsized":"2023-11-30T23:27:41.559582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3400,"log_dups_size":0,"ondisk_log_size":3400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:26:33.640383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023650336000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.37","version":"48'3724","reported_seq":3059,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.524998+0000","last_change":"2023-11-30T23:27:40.778901+0000","last_active":"2023-11-30T23:27:41.524998+0000","last_peered":"2023-11-30T23:27:41.524998+0000","last_clean":"2023-11-30T23:27:41.524998+0000","last_became_active":"2023-11-30T23:12:47.521393+0000","last_became_peered":"2023-11-30T23:12:47.521393+0000","last_unstale":"2023-11-30T23:27:41.524998+0000","last_undegraded":"2023-11-30T23:27:41.524998+0000","last_fullsized":"2023-11-30T23:27:41.524998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3724,"log_dups_size":0,"ondisk_log_size":3724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:23:17.254251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078674580000000008,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1228,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.36","version":"48'3647","reported_seq":3113,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.566188+0000","last_change":"2023-11-30T23:27:40.786256+0000","last_active":"2023-11-30T23:27:41.566188+0000","last_peered":"2023-11-30T23:27:41.566188+0000","last_clean":"2023-11-30T23:27:41.566188+0000","last_became_active":"2023-11-30T23:12:47.522618+0000","last_became_peered":"2023-11-30T23:12:47.522618+0000","last_unstale":"2023-11-30T23:27:41.566188+0000","last_undegraded":"2023-11-30T23:27:41.566188+0000","last_fullsized":"2023-11-30T23:27:41.566188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3647,"log_dups_size":0,"ondisk_log_size":3647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016421781999999999,"stat_sum":{"num_bytes":4110,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":1106,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.35","version":"48'3243","reported_seq":2730,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.542802+0000","last_change":"2023-11-30T23:27:40.786282+0000","last_active":"2023-11-30T23:27:41.542802+0000","last_peered":"2023-11-30T23:27:41.542802+0000","last_clean":"2023-11-30T23:27:41.542802+0000","last_became_active":"2023-11-30T23:13:30.304972+0000","last_became_peered":"2023-11-30T23:13:30.304972+0000","last_unstale":"2023-11-30T23:27:41.542802+0000","last_undegraded":"2023-11-30T23:27:41.542802+0000","last_fullsized":"2023-11-30T23:27:41.542802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3243,"log_dups_size":0,"ondisk_log_size":3243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:28:50.030806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016353854000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.34","version":"48'3479","reported_seq":2853,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.605834+0000","last_change":"2023-11-30T23:27:40.778402+0000","last_active":"2023-11-30T23:27:41.605834+0000","last_peered":"2023-11-30T23:27:41.605834+0000","last_clean":"2023-11-30T23:27:41.605834+0000","last_became_active":"2023-11-30T23:12:47.513401+0000","last_became_peered":"2023-11-30T23:12:47.513401+0000","last_unstale":"2023-11-30T23:27:41.605834+0000","last_undegraded":"2023-11-30T23:27:41.605834+0000","last_fullsized":"2023-11-30T23:27:41.605834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3479,"log_dups_size":0,"ondisk_log_size":3479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:22.086661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011359997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.33","version":"48'3375","reported_seq":2824,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.507105+0000","last_change":"2023-11-30T23:27:40.524064+0000","last_active":"2023-11-30T23:27:41.507105+0000","last_peered":"2023-11-30T23:27:41.507105+0000","last_clean":"2023-11-30T23:27:41.507105+0000","last_became_active":"2023-11-30T23:12:47.513714+0000","last_became_peered":"2023-11-30T23:12:47.513714+0000","last_unstale":"2023-11-30T23:27:41.507105+0000","last_undegraded":"2023-11-30T23:27:41.507105+0000","last_fullsized":"2023-11-30T23:27:41.507105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3375,"log_dups_size":0,"ondisk_log_size":3375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:20:31.102899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024370613999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1066,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.32","version":"48'3643","reported_seq":3000,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.495022+0000","last_change":"2023-11-30T23:27:40.553372+0000","last_active":"2023-11-30T23:27:41.495022+0000","last_peered":"2023-11-30T23:27:41.495022+0000","last_clean":"2023-11-30T23:27:41.495022+0000","last_became_active":"2023-11-30T23:12:47.506967+0000","last_became_peered":"2023-11-30T23:12:47.506967+0000","last_unstale":"2023-11-30T23:27:41.495022+0000","last_undegraded":"2023-11-30T23:27:41.495022+0000","last_fullsized":"2023-11-30T23:27:41.495022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3643,"log_dups_size":0,"ondisk_log_size":3643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025050587999999999,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.31","version":"48'3636","reported_seq":2966,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.543572+0000","last_change":"2023-11-30T23:27:40.490577+0000","last_active":"2023-11-30T23:27:41.543572+0000","last_peered":"2023-11-30T23:27:41.543572+0000","last_clean":"2023-11-30T23:27:41.543572+0000","last_became_active":"2023-11-30T23:12:47.513018+0000","last_became_peered":"2023-11-30T23:12:47.513018+0000","last_unstale":"2023-11-30T23:27:41.543572+0000","last_undegraded":"2023-11-30T23:27:41.543572+0000","last_fullsized":"2023-11-30T23:27:41.543572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3636,"log_dups_size":0,"ondisk_log_size":3636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059143527000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1251,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.30","version":"48'3670","reported_seq":3017,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.490898+0000","last_change":"2023-11-30T23:27:40.518027+0000","last_active":"2023-11-30T23:27:41.490898+0000","last_peered":"2023-11-30T23:27:41.490898+0000","last_clean":"2023-11-30T23:27:41.490898+0000","last_became_active":"2023-11-30T23:12:47.520518+0000","last_became_peered":"2023-11-30T23:12:47.520518+0000","last_unstale":"2023-11-30T23:27:41.490898+0000","last_undegraded":"2023-11-30T23:27:41.490898+0000","last_fullsized":"2023-11-30T23:27:41.490898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3670,"log_dups_size":0,"ondisk_log_size":3670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:27.789422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016206259000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2f","version":"48'3892","reported_seq":3186,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.543071+0000","last_change":"2023-11-30T23:27:40.522656+0000","last_active":"2023-11-30T23:27:41.543071+0000","last_peered":"2023-11-30T23:27:41.543071+0000","last_clean":"2023-11-30T23:27:41.543071+0000","last_became_active":"2023-11-30T23:12:47.516382+0000","last_became_peered":"2023-11-30T23:12:47.516382+0000","last_unstale":"2023-11-30T23:27:41.543071+0000","last_undegraded":"2023-11-30T23:27:41.543071+0000","last_fullsized":"2023-11-30T23:27:41.543071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:54:46.925262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020102808999999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2e","version":"48'3336","reported_seq":2814,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.542236+0000","last_change":"2023-11-30T23:27:40.437357+0000","last_active":"2023-11-30T23:27:41.542236+0000","last_peered":"2023-11-30T23:27:41.542236+0000","last_clean":"2023-11-30T23:27:41.542236+0000","last_became_active":"2023-11-30T23:12:47.509340+0000","last_became_peered":"2023-11-30T23:12:47.509340+0000","last_unstale":"2023-11-30T23:27:41.542236+0000","last_undegraded":"2023-11-30T23:27:41.542236+0000","last_fullsized":"2023-11-30T23:27:41.542236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3336,"log_dups_size":0,"ondisk_log_size":3336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:29.167074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0085862969999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1061,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2d","version":"48'3630","reported_seq":2999,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.551783+0000","last_change":"2023-11-30T23:27:40.776746+0000","last_active":"2023-11-30T23:27:41.551783+0000","last_peered":"2023-11-30T23:27:41.551783+0000","last_clean":"2023-11-30T23:27:41.551783+0000","last_became_active":"2023-11-30T23:12:47.506733+0000","last_became_peered":"2023-11-30T23:12:47.506733+0000","last_unstale":"2023-11-30T23:27:41.551783+0000","last_undegraded":"2023-11-30T23:27:41.551783+0000","last_fullsized":"2023-11-30T23:27:41.551783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3630,"log_dups_size":0,"ondisk_log_size":3630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010198370999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2c","version":"48'3600","reported_seq":2958,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.532354+0000","last_change":"2023-11-30T23:27:40.784471+0000","last_active":"2023-11-30T23:27:41.532354+0000","last_peered":"2023-11-30T23:27:41.532354+0000","last_clean":"2023-11-30T23:27:41.532354+0000","last_became_active":"2023-11-30T23:12:47.518819+0000","last_became_peered":"2023-11-30T23:12:47.518819+0000","last_unstale":"2023-11-30T23:27:41.532354+0000","last_undegraded":"2023-11-30T23:27:41.532354+0000","last_fullsized":"2023-11-30T23:27:41.532354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014700833,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2b","version":"48'3683","reported_seq":3063,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.589510+0000","last_change":"2023-11-30T23:27:40.567066+0000","last_active":"2023-11-30T23:27:41.589510+0000","last_peered":"2023-11-30T23:27:41.589510+0000","last_clean":"2023-11-30T23:27:41.589510+0000","last_became_active":"2023-11-30T23:12:47.514223+0000","last_became_peered":"2023-11-30T23:12:47.514223+0000","last_unstale":"2023-11-30T23:27:41.589510+0000","last_undegraded":"2023-11-30T23:27:41.589510+0000","last_fullsized":"2023-11-30T23:27:41.589510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3683,"log_dups_size":0,"ondisk_log_size":3683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:34:32.232378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036942162000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2a","version":"48'4029","reported_seq":3322,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.555237+0000","last_change":"2023-11-30T23:27:40.526135+0000","last_active":"2023-11-30T23:27:41.555237+0000","last_peered":"2023-11-30T23:27:41.555237+0000","last_clean":"2023-11-30T23:27:41.555237+0000","last_became_active":"2023-11-30T23:12:47.520228+0000","last_became_peered":"2023-11-30T23:12:47.520228+0000","last_unstale":"2023-11-30T23:27:41.555237+0000","last_undegraded":"2023-11-30T23:27:41.555237+0000","last_fullsized":"2023-11-30T23:27:41.555237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":4029,"log_dups_size":0,"ondisk_log_size":4029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:26:06.870586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023056817,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1244,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.29","version":"48'3705","reported_seq":3079,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.556013+0000","last_change":"2023-11-30T23:27:40.526288+0000","last_active":"2023-11-30T23:27:41.556013+0000","last_peered":"2023-11-30T23:27:41.556013+0000","last_clean":"2023-11-30T23:27:41.556013+0000","last_became_active":"2023-11-30T23:12:47.515247+0000","last_became_peered":"2023-11-30T23:12:47.515247+0000","last_unstale":"2023-11-30T23:27:41.556013+0000","last_undegraded":"2023-11-30T23:27:41.556013+0000","last_fullsized":"2023-11-30T23:27:41.556013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3705,"log_dups_size":0,"ondisk_log_size":3705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026511877,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.28","version":"48'3602","reported_seq":2953,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.491995+0000","last_change":"2023-11-30T23:27:40.526691+0000","last_active":"2023-11-30T23:27:41.491995+0000","last_peered":"2023-11-30T23:27:41.491995+0000","last_clean":"2023-11-30T23:27:41.491995+0000","last_became_active":"2023-11-30T23:12:47.511097+0000","last_became_peered":"2023-11-30T23:12:47.511097+0000","last_unstale":"2023-11-30T23:27:41.491995+0000","last_undegraded":"2023-11-30T23:27:41.491995+0000","last_fullsized":"2023-11-30T23:27:41.491995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023833039,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.27","version":"48'3199","reported_seq":2626,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.508825+0000","last_change":"2023-11-30T23:27:40.532323+0000","last_active":"2023-11-30T23:27:41.508825+0000","last_peered":"2023-11-30T23:27:41.508825+0000","last_clean":"2023-11-30T23:27:41.508825+0000","last_became_active":"2023-11-30T23:12:47.510404+0000","last_became_peered":"2023-11-30T23:12:47.510404+0000","last_unstale":"2023-11-30T23:27:41.508825+0000","last_undegraded":"2023-11-30T23:27:41.508825+0000","last_fullsized":"2023-11-30T23:27:41.508825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3199,"log_dups_size":0,"ondisk_log_size":3199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031984205000000002,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.26","version":"48'3855","reported_seq":3185,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.553421+0000","last_change":"2023-11-30T23:27:40.788046+0000","last_active":"2023-11-30T23:27:41.553421+0000","last_peered":"2023-11-30T23:27:41.553421+0000","last_clean":"2023-11-30T23:27:41.553421+0000","last_became_active":"2023-11-30T23:12:47.516539+0000","last_became_peered":"2023-11-30T23:12:47.516539+0000","last_unstale":"2023-11-30T23:27:41.553421+0000","last_undegraded":"2023-11-30T23:27:41.553421+0000","last_fullsized":"2023-11-30T23:27:41.553421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3855,"log_dups_size":0,"ondisk_log_size":3855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018080019999999999,"stat_sum":{"num_bytes":4105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.25","version":"48'3361","reported_seq":2773,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.550930+0000","last_change":"2023-11-30T23:27:40.486640+0000","last_active":"2023-11-30T23:27:41.550930+0000","last_peered":"2023-11-30T23:27:41.550930+0000","last_clean":"2023-11-30T23:27:41.550930+0000","last_became_active":"2023-11-30T23:12:47.506284+0000","last_became_peered":"2023-11-30T23:12:47.506284+0000","last_unstale":"2023-11-30T23:27:41.550930+0000","last_undegraded":"2023-11-30T23:27:41.550930+0000","last_fullsized":"2023-11-30T23:27:41.550930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3361,"log_dups_size":0,"ondisk_log_size":3361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058342590999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.24","version":"48'3356","reported_seq":2745,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.586450+0000","last_change":"2023-11-30T23:27:40.535487+0000","last_active":"2023-11-30T23:27:41.586450+0000","last_peered":"2023-11-30T23:27:41.586450+0000","last_clean":"2023-11-30T23:27:41.586450+0000","last_became_active":"2023-11-30T23:12:47.511800+0000","last_became_peered":"2023-11-30T23:12:47.511800+0000","last_unstale":"2023-11-30T23:27:41.586450+0000","last_undegraded":"2023-11-30T23:27:41.586450+0000","last_fullsized":"2023-11-30T23:27:41.586450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3356,"log_dups_size":0,"ondisk_log_size":3356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034899355,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1130,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.23","version":"48'3593","reported_seq":3000,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.582018+0000","last_change":"2023-11-30T23:27:40.562740+0000","last_active":"2023-11-30T23:27:41.582018+0000","last_peered":"2023-11-30T23:27:41.582018+0000","last_clean":"2023-11-30T23:27:41.582018+0000","last_became_active":"2023-11-30T23:12:47.512978+0000","last_became_peered":"2023-11-30T23:12:47.512978+0000","last_unstale":"2023-11-30T23:27:41.582018+0000","last_undegraded":"2023-11-30T23:27:41.582018+0000","last_fullsized":"2023-11-30T23:27:41.582018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3593,"log_dups_size":0,"ondisk_log_size":3593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032442869999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1122,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.22","version":"48'3350","reported_seq":2778,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.539520+0000","last_change":"2023-11-30T23:27:40.524098+0000","last_active":"2023-11-30T23:27:41.539520+0000","last_peered":"2023-11-30T23:27:41.539520+0000","last_clean":"2023-11-30T23:27:41.539520+0000","last_became_active":"2023-11-30T23:12:47.511699+0000","last_became_peered":"2023-11-30T23:12:47.511699+0000","last_unstale":"2023-11-30T23:27:41.539520+0000","last_undegraded":"2023-11-30T23:27:41.539520+0000","last_fullsized":"2023-11-30T23:27:41.539520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3350,"log_dups_size":0,"ondisk_log_size":3350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021133078,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.21","version":"48'4043","reported_seq":3292,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.508821+0000","last_change":"2023-11-30T23:27:40.435514+0000","last_active":"2023-11-30T23:27:41.508821+0000","last_peered":"2023-11-30T23:27:41.508821+0000","last_clean":"2023-11-30T23:27:41.508821+0000","last_became_active":"2023-11-30T23:12:47.521604+0000","last_became_peered":"2023-11-30T23:12:47.521604+0000","last_unstale":"2023-11-30T23:27:41.508821+0000","last_undegraded":"2023-11-30T23:27:41.508821+0000","last_fullsized":"2023-11-30T23:27:41.508821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":4043,"log_dups_size":0,"ondisk_log_size":4043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:02.220181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081020610000000007,"stat_sum":{"num_bytes":4121,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1336,"num_write_kb":721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.20","version":"48'3908","reported_seq":3229,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.519616+0000","last_change":"2023-11-30T23:27:40.784516+0000","last_active":"2023-11-30T23:27:41.519616+0000","last_peered":"2023-11-30T23:27:41.519616+0000","last_clean":"2023-11-30T23:27:41.519616+0000","last_became_active":"2023-11-30T23:12:47.517283+0000","last_became_peered":"2023-11-30T23:12:47.517283+0000","last_unstale":"2023-11-30T23:27:41.519616+0000","last_undegraded":"2023-11-30T23:27:41.519616+0000","last_fullsized":"2023-11-30T23:27:41.519616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3908,"log_dups_size":0,"ondisk_log_size":3908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016665117,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1a","version":"48'3480","reported_seq":2876,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.528598+0000","last_change":"2023-11-30T23:27:40.776963+0000","last_active":"2023-11-30T23:27:41.528598+0000","last_peered":"2023-11-30T23:27:41.528598+0000","last_clean":"2023-11-30T23:27:41.528598+0000","last_became_active":"2023-11-30T23:12:47.508725+0000","last_became_peered":"2023-11-30T23:12:47.508725+0000","last_unstale":"2023-11-30T23:27:41.528598+0000","last_undegraded":"2023-11-30T23:27:41.528598+0000","last_fullsized":"2023-11-30T23:27:41.528598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3480,"log_dups_size":0,"ondisk_log_size":3480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:54.893320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010267352,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1134,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1b","version":"43'3981","reported_seq":4025,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.721302+0000","last_change":"2023-11-30T23:12:47.139071+0000","last_active":"2023-11-30T23:27:39.721302+0000","last_peered":"2023-11-30T23:27:39.721302+0000","last_clean":"2023-11-30T23:27:39.721302+0000","last_became_active":"2023-11-30T23:12:47.138768+0000","last_became_peered":"2023-11-30T23:12:47.138768+0000","last_unstale":"2023-11-30T23:27:39.721302+0000","last_undegraded":"2023-11-30T23:27:39.721302+0000","last_fullsized":"2023-11-30T23:27:39.721302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3981,"log_dups_size":0,"ondisk_log_size":3981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":4054,"num_write_kb":19067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"48'3595","reported_seq":2987,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.585088+0000","last_change":"2023-11-30T23:27:40.568024+0000","last_active":"2023-11-30T23:27:41.585088+0000","last_peered":"2023-11-30T23:27:41.585088+0000","last_clean":"2023-11-30T23:27:41.585088+0000","last_became_active":"2023-11-30T23:12:47.516214+0000","last_became_peered":"2023-11-30T23:12:47.516214+0000","last_unstale":"2023-11-30T23:27:41.585088+0000","last_undegraded":"2023-11-30T23:27:41.585088+0000","last_fullsized":"2023-11-30T23:27:41.585088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037604525,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1a","version":"48'4545","reported_seq":4589,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.794216+0000","last_change":"2023-11-30T23:12:47.130416+0000","last_active":"2023-11-30T23:27:41.794216+0000","last_peered":"2023-11-30T23:27:41.794216+0000","last_clean":"2023-11-30T23:27:41.794216+0000","last_became_active":"2023-11-30T23:12:47.129771+0000","last_became_peered":"2023-11-30T23:12:47.129771+0000","last_unstale":"2023-11-30T23:27:41.794216+0000","last_undegraded":"2023-11-30T23:27:41.794216+0000","last_fullsized":"2023-11-30T23:27:41.794216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4545,"log_dups_size":0,"ondisk_log_size":4545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7852113,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":4619,"num_write_kb":33825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"41'851","reported_seq":896,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.716599+0000","last_change":"2023-11-30T23:12:47.133733+0000","last_active":"2023-11-30T23:27:39.716599+0000","last_peered":"2023-11-30T23:27:39.716599+0000","last_clean":"2023-11-30T23:27:39.716599+0000","last_became_active":"2023-11-30T23:12:47.133440+0000","last_became_peered":"2023-11-30T23:12:47.133440+0000","last_unstale":"2023-11-30T23:27:39.716599+0000","last_undegraded":"2023-11-30T23:27:39.716599+0000","last_fullsized":"2023-11-30T23:27:39.716599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:48.913175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":928,"num_write_kb":12986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"48'3961","reported_seq":3213,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.571914+0000","last_change":"2023-11-30T23:27:40.521787+0000","last_active":"2023-11-30T23:27:41.571914+0000","last_peered":"2023-11-30T23:27:41.571914+0000","last_clean":"2023-11-30T23:27:41.571914+0000","last_became_active":"2023-11-30T23:12:47.507617+0000","last_became_peered":"2023-11-30T23:12:47.507617+0000","last_unstale":"2023-11-30T23:27:41.571914+0000","last_undegraded":"2023-11-30T23:27:41.571914+0000","last_fullsized":"2023-11-30T23:27:41.571914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3961,"log_dups_size":0,"ondisk_log_size":3961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:08:47.117163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022313091,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1298,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.18","version":"42'3803","reported_seq":3848,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.379869+0000","last_change":"2023-11-30T23:12:47.132638+0000","last_active":"2023-11-30T23:27:40.379869+0000","last_peered":"2023-11-30T23:27:40.379869+0000","last_clean":"2023-11-30T23:27:40.379869+0000","last_became_active":"2023-11-30T23:12:47.132351+0000","last_became_peered":"2023-11-30T23:12:47.132351+0000","last_unstale":"2023-11-30T23:27:40.379869+0000","last_undegraded":"2023-11-30T23:27:40.379869+0000","last_fullsized":"2023-11-30T23:27:40.379869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3803,"log_dups_size":0,"ondisk_log_size":3803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":3859,"num_write_kb":38490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"48'3665","reported_seq":3062,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.554274+0000","last_change":"2023-11-30T23:27:40.479741+0000","last_active":"2023-11-30T23:27:41.554274+0000","last_peered":"2023-11-30T23:27:41.554274+0000","last_clean":"2023-11-30T23:27:41.554274+0000","last_became_active":"2023-11-30T23:12:47.506082+0000","last_became_peered":"2023-11-30T23:12:47.506082+0000","last_unstale":"2023-11-30T23:27:41.554274+0000","last_undegraded":"2023-11-30T23:27:41.554274+0000","last_fullsized":"2023-11-30T23:27:41.554274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052118631999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.17","version":"43'1096","reported_seq":1141,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.687772+0000","last_change":"2023-11-30T23:12:47.139722+0000","last_active":"2023-11-30T23:27:39.687772+0000","last_peered":"2023-11-30T23:27:39.687772+0000","last_clean":"2023-11-30T23:27:39.687772+0000","last_became_active":"2023-11-30T23:12:47.139400+0000","last_became_peered":"2023-11-30T23:12:47.139400+0000","last_unstale":"2023-11-30T23:27:39.687772+0000","last_undegraded":"2023-11-30T23:27:39.687772+0000","last_fullsized":"2023-11-30T23:27:39.687772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1096,"log_dups_size":0,"ondisk_log_size":1096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":1152,"num_write_kb":13161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"48'3679","reported_seq":3043,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.532898+0000","last_change":"2023-11-30T23:27:40.435297+0000","last_active":"2023-11-30T23:27:41.532898+0000","last_peered":"2023-11-30T23:27:41.532898+0000","last_clean":"2023-11-30T23:27:41.532898+0000","last_became_active":"2023-11-30T23:13:30.596915+0000","last_became_peered":"2023-11-30T23:13:30.596915+0000","last_unstale":"2023-11-30T23:27:41.532898+0000","last_undegraded":"2023-11-30T23:27:41.532898+0000","last_fullsized":"2023-11-30T23:27:41.532898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3679,"log_dups_size":0,"ondisk_log_size":3679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:51:12.828715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066900809999999996,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.16","version":"48'1872","reported_seq":1917,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.502065+0000","last_change":"2023-11-30T23:12:47.139328+0000","last_active":"2023-11-30T23:27:40.502065+0000","last_peered":"2023-11-30T23:27:40.502065+0000","last_clean":"2023-11-30T23:27:40.502065+0000","last_became_active":"2023-11-30T23:12:47.139047+0000","last_became_peered":"2023-11-30T23:12:47.139047+0000","last_unstale":"2023-11-30T23:27:40.502065+0000","last_undegraded":"2023-11-30T23:27:40.502065+0000","last_fullsized":"2023-11-30T23:27:40.502065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1872,"log_dups_size":0,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":1932,"num_write_kb":25642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"48'3570","reported_seq":2951,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.513410+0000","last_change":"2023-11-30T23:27:40.558523+0000","last_active":"2023-11-30T23:27:41.513410+0000","last_peered":"2023-11-30T23:27:41.513410+0000","last_clean":"2023-11-30T23:27:41.513410+0000","last_became_active":"2023-11-30T23:12:47.522711+0000","last_became_peered":"2023-11-30T23:12:47.522711+0000","last_unstale":"2023-11-30T23:27:41.513410+0000","last_undegraded":"2023-11-30T23:27:41.513410+0000","last_fullsized":"2023-11-30T23:27:41.513410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:19:43.387626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.028725985999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.15","version":"48'3057","reported_seq":3102,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.616806+0000","last_change":"2023-11-30T23:12:47.140794+0000","last_active":"2023-11-30T23:27:41.616806+0000","last_peered":"2023-11-30T23:27:41.616806+0000","last_clean":"2023-11-30T23:27:41.616806+0000","last_became_active":"2023-11-30T23:12:47.140531+0000","last_became_peered":"2023-11-30T23:12:47.140531+0000","last_unstale":"2023-11-30T23:27:41.616806+0000","last_undegraded":"2023-11-30T23:27:41.616806+0000","last_fullsized":"2023-11-30T23:27:41.616806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3057,"log_dups_size":0,"ondisk_log_size":3057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:53.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":3128,"num_write_kb":22065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"48'3770","reported_seq":3130,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.604302+0000","last_change":"2023-11-30T23:27:40.777802+0000","last_active":"2023-11-30T23:27:41.604302+0000","last_peered":"2023-11-30T23:27:41.604302+0000","last_clean":"2023-11-30T23:27:41.604302+0000","last_became_active":"2023-11-30T23:12:47.513983+0000","last_became_peered":"2023-11-30T23:12:47.513983+0000","last_unstale":"2023-11-30T23:27:41.604302+0000","last_undegraded":"2023-11-30T23:27:41.604302+0000","last_fullsized":"2023-11-30T23:27:41.604302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3770,"log_dups_size":0,"ondisk_log_size":3770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:39.696562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010376995,"stat_sum":{"num_bytes":9,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1166,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.14","version":"48'3844","reported_seq":3889,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.769905+0000","last_change":"2023-11-30T23:12:47.140168+0000","last_active":"2023-11-30T23:27:40.769905+0000","last_peered":"2023-11-30T23:27:40.769905+0000","last_clean":"2023-11-30T23:27:40.769905+0000","last_became_active":"2023-11-30T23:12:47.139799+0000","last_became_peered":"2023-11-30T23:12:47.139799+0000","last_unstale":"2023-11-30T23:27:40.769905+0000","last_undegraded":"2023-11-30T23:27:40.769905+0000","last_fullsized":"2023-11-30T23:27:40.769905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3844,"log_dups_size":0,"ondisk_log_size":3844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":3910,"num_write_kb":30388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"48'3523","reported_seq":2900,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.550105+0000","last_change":"2023-11-30T23:27:40.772832+0000","last_active":"2023-11-30T23:27:41.550105+0000","last_peered":"2023-11-30T23:27:41.550105+0000","last_clean":"2023-11-30T23:27:41.550105+0000","last_became_active":"2023-11-30T23:12:47.503333+0000","last_became_peered":"2023-11-30T23:12:47.503333+0000","last_unstale":"2023-11-30T23:27:41.550105+0000","last_undegraded":"2023-11-30T23:27:41.550105+0000","last_fullsized":"2023-11-30T23:27:41.550105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3523,"log_dups_size":0,"ondisk_log_size":3523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070303589999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.13","version":"41'1920","reported_seq":1965,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.521393+0000","last_change":"2023-11-30T23:12:47.136931+0000","last_active":"2023-11-30T23:27:39.521393+0000","last_peered":"2023-11-30T23:27:39.521393+0000","last_clean":"2023-11-30T23:27:39.521393+0000","last_became_active":"2023-11-30T23:12:47.136620+0000","last_became_peered":"2023-11-30T23:12:47.136620+0000","last_unstale":"2023-11-30T23:27:39.521393+0000","last_undegraded":"2023-11-30T23:27:39.521393+0000","last_fullsized":"2023-11-30T23:27:39.521393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1920,"log_dups_size":0,"ondisk_log_size":1920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:22:43.069951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":2012,"num_write_kb":17264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"48'3603","reported_seq":2975,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.494947+0000","last_change":"2023-11-30T23:27:40.557057+0000","last_active":"2023-11-30T23:27:41.494947+0000","last_peered":"2023-11-30T23:27:41.494947+0000","last_clean":"2023-11-30T23:27:41.494947+0000","last_became_active":"2023-11-30T23:12:47.503294+0000","last_became_peered":"2023-11-30T23:12:47.503294+0000","last_unstale":"2023-11-30T23:27:41.494947+0000","last_undegraded":"2023-11-30T23:27:41.494947+0000","last_fullsized":"2023-11-30T23:27:41.494947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3603,"log_dups_size":0,"ondisk_log_size":3603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.028538382000000001,"stat_sum":{"num_bytes":8235,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1203,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.12","version":"44'82","reported_seq":127,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.377591+0000","last_change":"2023-11-30T23:12:47.140575+0000","last_active":"2023-11-30T23:27:40.377591+0000","last_peered":"2023-11-30T23:27:40.377591+0000","last_clean":"2023-11-30T23:27:40.377591+0000","last_became_active":"2023-11-30T23:12:47.140125+0000","last_became_peered":"2023-11-30T23:12:47.140125+0000","last_unstale":"2023-11-30T23:27:40.377591+0000","last_undegraded":"2023-11-30T23:27:40.377591+0000","last_fullsized":"2023-11-30T23:27:40.377591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":140,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"48'3957","reported_seq":3285,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.497842+0000","last_change":"2023-11-30T23:27:40.777472+0000","last_active":"2023-11-30T23:27:41.497842+0000","last_peered":"2023-11-30T23:27:41.497842+0000","last_clean":"2023-11-30T23:27:41.497842+0000","last_became_active":"2023-11-30T23:12:47.515427+0000","last_became_peered":"2023-11-30T23:12:47.515427+0000","last_unstale":"2023-11-30T23:27:41.497842+0000","last_undegraded":"2023-11-30T23:27:41.497842+0000","last_fullsized":"2023-11-30T23:27:41.497842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3957,"log_dups_size":0,"ondisk_log_size":3957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:26:06.870586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066010289999999996,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.11","version":"41'1117","reported_seq":1162,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.686919+0000","last_change":"2023-11-30T23:12:47.129492+0000","last_active":"2023-11-30T23:27:39.686919+0000","last_peered":"2023-11-30T23:27:39.686919+0000","last_clean":"2023-11-30T23:27:39.686919+0000","last_became_active":"2023-11-30T23:12:47.129180+0000","last_became_peered":"2023-11-30T23:12:47.129180+0000","last_unstale":"2023-11-30T23:27:39.686919+0000","last_undegraded":"2023-11-30T23:27:39.686919+0000","last_fullsized":"2023-11-30T23:27:39.686919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1117,"log_dups_size":0,"ondisk_log_size":1117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":1162,"num_write_kb":9042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"48'3496","reported_seq":2885,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.525719+0000","last_change":"2023-11-30T23:27:40.782626+0000","last_active":"2023-11-30T23:27:41.525719+0000","last_peered":"2023-11-30T23:27:41.525719+0000","last_clean":"2023-11-30T23:27:41.525719+0000","last_became_active":"2023-11-30T23:12:47.516980+0000","last_became_peered":"2023-11-30T23:12:47.516980+0000","last_unstale":"2023-11-30T23:27:41.525719+0000","last_undegraded":"2023-11-30T23:27:41.525719+0000","last_fullsized":"2023-11-30T23:27:41.525719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3496,"log_dups_size":0,"ondisk_log_size":3496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014912678,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.10","version":"44'1300","reported_seq":1345,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.414975+0000","last_change":"2023-11-30T23:12:47.129703+0000","last_active":"2023-11-30T23:27:39.414975+0000","last_peered":"2023-11-30T23:27:39.414975+0000","last_clean":"2023-11-30T23:27:39.414975+0000","last_became_active":"2023-11-30T23:12:47.129349+0000","last_became_peered":"2023-11-30T23:12:47.129349+0000","last_unstale":"2023-11-30T23:27:39.414975+0000","last_undegraded":"2023-11-30T23:27:39.414975+0000","last_fullsized":"2023-11-30T23:27:39.414975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1300,"log_dups_size":0,"ondisk_log_size":1300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":1371,"num_write_kb":13381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"48'3743","reported_seq":3063,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.519400+0000","last_change":"2023-11-30T23:27:40.775036+0000","last_active":"2023-11-30T23:27:41.519400+0000","last_peered":"2023-11-30T23:27:41.519400+0000","last_clean":"2023-11-30T23:27:41.519400+0000","last_became_active":"2023-11-30T23:12:47.514140+0000","last_became_peered":"2023-11-30T23:12:47.514140+0000","last_unstale":"2023-11-30T23:27:41.519400+0000","last_undegraded":"2023-11-30T23:27:41.519400+0000","last_fullsized":"2023-11-30T23:27:41.519400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3743,"log_dups_size":0,"ondisk_log_size":3743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:54:46.925262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0087768900000000007,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1241,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.f","version":"48'1098","reported_seq":1143,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.768358+0000","last_change":"2023-11-30T23:12:47.136924+0000","last_active":"2023-11-30T23:27:40.768358+0000","last_peered":"2023-11-30T23:27:40.768358+0000","last_clean":"2023-11-30T23:27:40.768358+0000","last_became_active":"2023-11-30T23:12:47.136631+0000","last_became_peered":"2023-11-30T23:12:47.136631+0000","last_unstale":"2023-11-30T23:27:40.768358+0000","last_undegraded":"2023-11-30T23:27:40.768358+0000","last_fullsized":"2023-11-30T23:27:40.768358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1098,"log_dups_size":0,"ondisk_log_size":1098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:22:48.835054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":1176,"num_write_kb":13385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"48'3434","reported_seq":2834,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.454960+0000","last_change":"2023-11-30T23:27:40.773928+0000","last_active":"2023-11-30T23:27:41.454960+0000","last_peered":"2023-11-30T23:27:41.454960+0000","last_clean":"2023-11-30T23:27:41.454960+0000","last_became_active":"2023-11-30T23:12:47.514053+0000","last_became_peered":"2023-11-30T23:12:47.514053+0000","last_unstale":"2023-11-30T23:27:41.454960+0000","last_undegraded":"2023-11-30T23:27:41.454960+0000","last_fullsized":"2023-11-30T23:27:41.454960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0080231629999999998,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.e","version":"48'2035","reported_seq":2080,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.429021+0000","last_change":"2023-11-30T23:12:47.138008+0000","last_active":"2023-11-30T23:27:40.429021+0000","last_peered":"2023-11-30T23:27:40.429021+0000","last_clean":"2023-11-30T23:27:40.429021+0000","last_became_active":"2023-11-30T23:12:47.137695+0000","last_became_peered":"2023-11-30T23:12:47.137695+0000","last_unstale":"2023-11-30T23:27:40.429021+0000","last_undegraded":"2023-11-30T23:27:40.429021+0000","last_fullsized":"2023-11-30T23:27:40.429021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":2104,"num_write_kb":13092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"48'3567","reported_seq":2928,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.459047+0000","last_change":"2023-11-30T23:27:40.778859+0000","last_active":"2023-11-30T23:27:41.459047+0000","last_peered":"2023-11-30T23:27:41.459047+0000","last_clean":"2023-11-30T23:27:41.459047+0000","last_became_active":"2023-11-30T23:12:47.514822+0000","last_became_peered":"2023-11-30T23:12:47.514822+0000","last_unstale":"2023-11-30T23:27:41.459047+0000","last_undegraded":"2023-11-30T23:27:41.459047+0000","last_fullsized":"2023-11-30T23:27:41.459047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3567,"log_dups_size":0,"ondisk_log_size":3567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:02:36.020857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076646960000000004,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.d","version":"43'4595","reported_seq":4640,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.993417+0000","last_change":"2023-11-30T23:12:47.129184+0000","last_active":"2023-11-30T23:27:39.993417+0000","last_peered":"2023-11-30T23:27:39.993417+0000","last_clean":"2023-11-30T23:27:39.993417+0000","last_became_active":"2023-11-30T23:12:47.128682+0000","last_became_peered":"2023-11-30T23:12:47.128682+0000","last_unstale":"2023-11-30T23:27:39.993417+0000","last_undegraded":"2023-11-30T23:27:39.993417+0000","last_fullsized":"2023-11-30T23:27:39.993417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4595,"log_dups_size":0,"ondisk_log_size":4595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583127,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":4657,"num_write_kb":26783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"48'3659","reported_seq":2964,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.538071+0000","last_change":"2023-11-30T23:27:40.521110+0000","last_active":"2023-11-30T23:27:41.538071+0000","last_peered":"2023-11-30T23:27:41.538071+0000","last_clean":"2023-11-30T23:27:41.538071+0000","last_became_active":"2023-11-30T23:12:47.516317+0000","last_became_peered":"2023-11-30T23:12:47.516317+0000","last_unstale":"2023-11-30T23:27:41.538071+0000","last_undegraded":"2023-11-30T23:27:41.538071+0000","last_fullsized":"2023-11-30T23:27:41.538071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3659,"log_dups_size":0,"ondisk_log_size":3659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:20:31.102899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018738761999999999,"stat_sum":{"num_bytes":16384,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1262,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.c","version":"48'4363","reported_seq":4408,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.428422+0000","last_change":"2023-11-30T23:12:47.140679+0000","last_active":"2023-11-30T23:27:40.428422+0000","last_peered":"2023-11-30T23:27:40.428422+0000","last_clean":"2023-11-30T23:27:40.428422+0000","last_became_active":"2023-11-30T23:12:47.140400+0000","last_became_peered":"2023-11-30T23:12:47.140400+0000","last_unstale":"2023-11-30T23:27:40.428422+0000","last_undegraded":"2023-11-30T23:27:40.428422+0000","last_fullsized":"2023-11-30T23:27:40.428422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4363,"log_dups_size":0,"ondisk_log_size":4363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4418,"num_write_kb":27644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"48'3509","reported_seq":2933,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.557081+0000","last_change":"2023-11-30T23:27:40.776512+0000","last_active":"2023-11-30T23:27:41.557081+0000","last_peered":"2023-11-30T23:27:41.557081+0000","last_clean":"2023-11-30T23:27:41.557081+0000","last_became_active":"2023-11-30T23:12:47.521481+0000","last_became_peered":"2023-11-30T23:12:47.521481+0000","last_unstale":"2023-11-30T23:27:41.557081+0000","last_undegraded":"2023-11-30T23:27:41.557081+0000","last_fullsized":"2023-11-30T23:27:41.557081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3509,"log_dups_size":0,"ondisk_log_size":3509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:17:01.774183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010302225,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1071,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.408367+0000","last_change":"2023-11-30T23:12:36.558633+0000","last_active":"2023-11-30T23:27:39.408367+0000","last_peered":"2023-11-30T23:27:39.408367+0000","last_clean":"2023-11-30T23:27:39.408367+0000","last_became_active":"2023-11-30T23:12:36.556455+0000","last_became_peered":"2023-11-30T23:12:36.556455+0000","last_unstale":"2023-11-30T23:27:39.408367+0000","last_undegraded":"2023-11-30T23:27:39.408367+0000","last_fullsized":"2023-11-30T23:27:39.408367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:34.652815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:34.652815+0000","last_clean_scrub_stamp":"2023-11-30T23:12:34.652815+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:36:52.941511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"48'933","reported_seq":979,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.501554+0000","last_change":"2023-11-30T23:12:47.132985+0000","last_active":"2023-11-30T23:27:40.501554+0000","last_peered":"2023-11-30T23:27:40.501554+0000","last_clean":"2023-11-30T23:27:40.501554+0000","last_became_active":"2023-11-30T23:12:47.132365+0000","last_became_peered":"2023-11-30T23:12:47.132365+0000","last_unstale":"2023-11-30T23:27:40.501554+0000","last_undegraded":"2023-11-30T23:27:40.501554+0000","last_fullsized":"2023-11-30T23:27:40.501554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":1011,"num_write_kb":13216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"48'3463","reported_seq":2898,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.529496+0000","last_change":"2023-11-30T23:27:40.529546+0000","last_active":"2023-11-30T23:27:41.529496+0000","last_peered":"2023-11-30T23:27:41.529496+0000","last_clean":"2023-11-30T23:27:41.529496+0000","last_became_active":"2023-11-30T23:12:47.508677+0000","last_became_peered":"2023-11-30T23:12:47.508677+0000","last_unstale":"2023-11-30T23:27:41.529496+0000","last_undegraded":"2023-11-30T23:27:41.529496+0000","last_fullsized":"2023-11-30T23:27:41.529496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3463,"log_dups_size":0,"ondisk_log_size":3463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029660272000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1097,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.0","version":"43'3512","reported_seq":3558,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.408442+0000","last_change":"2023-11-30T23:12:47.148775+0000","last_active":"2023-11-30T23:27:39.408442+0000","last_peered":"2023-11-30T23:27:39.408442+0000","last_clean":"2023-11-30T23:27:39.408442+0000","last_became_active":"2023-11-30T23:12:47.148547+0000","last_became_peered":"2023-11-30T23:12:47.148547+0000","last_unstale":"2023-11-30T23:27:39.408442+0000","last_undegraded":"2023-11-30T23:27:39.408442+0000","last_fullsized":"2023-11-30T23:27:39.408442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3512,"log_dups_size":0,"ondisk_log_size":3512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:01.207700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":3602,"num_write_kb":26128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"48'3481","reported_seq":2873,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.532387+0000","last_change":"2023-11-30T23:27:40.549560+0000","last_active":"2023-11-30T23:27:41.532387+0000","last_peered":"2023-11-30T23:27:41.532387+0000","last_clean":"2023-11-30T23:27:41.532387+0000","last_became_active":"2023-11-30T23:12:47.515553+0000","last_became_peered":"2023-11-30T23:12:47.515553+0000","last_unstale":"2023-11-30T23:27:41.532387+0000","last_undegraded":"2023-11-30T23:27:41.532387+0000","last_fullsized":"2023-11-30T23:27:41.532387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:22.086661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021186228000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1162,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1","version":"48'2695","reported_seq":3256,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:42.508476+0000","last_change":"2023-11-30T23:12:47.136018+0000","last_active":"2023-11-30T23:27:42.508476+0000","last_peered":"2023-11-30T23:27:42.508476+0000","last_clean":"2023-11-30T23:27:42.508476+0000","last_became_active":"2023-11-30T23:12:47.135746+0000","last_became_peered":"2023-11-30T23:12:47.135746+0000","last_unstale":"2023-11-30T23:27:42.508476+0000","last_undegraded":"2023-11-30T23:27:42.508476+0000","last_fullsized":"2023-11-30T23:27:42.508476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2695,"log_dups_size":0,"ondisk_log_size":2695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3169767,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":530,"num_read_kb":3420,"num_write":2759,"num_write_kb":16501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"48'3593","reported_seq":2961,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.478806+0000","last_change":"2023-11-30T23:27:40.472409+0000","last_active":"2023-11-30T23:27:41.478806+0000","last_peered":"2023-11-30T23:27:41.478806+0000","last_clean":"2023-11-30T23:27:41.478806+0000","last_became_active":"2023-11-30T23:12:47.510024+0000","last_became_peered":"2023-11-30T23:12:47.510024+0000","last_unstale":"2023-11-30T23:27:41.478806+0000","last_undegraded":"2023-11-30T23:27:41.478806+0000","last_fullsized":"2023-11-30T23:27:41.478806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3593,"log_dups_size":0,"ondisk_log_size":3593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045211289000000002,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.2","version":"48'4582","reported_seq":4628,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.513804+0000","last_change":"2023-11-30T23:12:47.141605+0000","last_active":"2023-11-30T23:27:40.513804+0000","last_peered":"2023-11-30T23:27:40.513804+0000","last_clean":"2023-11-30T23:27:40.513804+0000","last_became_active":"2023-11-30T23:12:47.141115+0000","last_became_peered":"2023-11-30T23:12:47.141115+0000","last_unstale":"2023-11-30T23:27:40.513804+0000","last_undegraded":"2023-11-30T23:27:40.513804+0000","last_fullsized":"2023-11-30T23:27:40.513804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4582,"log_dups_size":0,"ondisk_log_size":4582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":4625,"num_write_kb":30671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"48'3767","reported_seq":3095,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.547202+0000","last_change":"2023-11-30T23:27:40.778459+0000","last_active":"2023-11-30T23:27:41.547202+0000","last_peered":"2023-11-30T23:27:41.547202+0000","last_clean":"2023-11-30T23:27:41.547202+0000","last_became_active":"2023-11-30T23:12:47.514572+0000","last_became_peered":"2023-11-30T23:12:47.514572+0000","last_unstale":"2023-11-30T23:27:41.547202+0000","last_undegraded":"2023-11-30T23:27:41.547202+0000","last_fullsized":"2023-11-30T23:27:41.547202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3767,"log_dups_size":0,"ondisk_log_size":3767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:29.167074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010674993000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.4","version":"41'153","reported_seq":199,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.992465+0000","last_change":"2023-11-30T23:12:47.141801+0000","last_active":"2023-11-30T23:27:39.992465+0000","last_peered":"2023-11-30T23:27:39.992465+0000","last_clean":"2023-11-30T23:27:39.992465+0000","last_became_active":"2023-11-30T23:12:47.141411+0000","last_became_peered":"2023-11-30T23:12:47.141411+0000","last_unstale":"2023-11-30T23:27:39.992465+0000","last_undegraded":"2023-11-30T23:27:39.992465+0000","last_fullsized":"2023-11-30T23:27:39.992465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":238,"num_write_kb":8770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"48'3575","reported_seq":2929,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.503471+0000","last_change":"2023-11-30T23:27:40.519690+0000","last_active":"2023-11-30T23:27:41.503471+0000","last_peered":"2023-11-30T23:27:41.503471+0000","last_clean":"2023-11-30T23:27:41.503471+0000","last_became_active":"2023-11-30T23:13:30.305367+0000","last_became_peered":"2023-11-30T23:13:30.305367+0000","last_unstale":"2023-11-30T23:27:41.503471+0000","last_undegraded":"2023-11-30T23:27:41.503471+0000","last_fullsized":"2023-11-30T23:27:41.503471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3575,"log_dups_size":0,"ondisk_log_size":3575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:54:08.569710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017828157000000001,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.5","version":"48'2056","reported_seq":2102,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.771097+0000","last_change":"2023-11-30T23:12:47.143317+0000","last_active":"2023-11-30T23:27:40.771097+0000","last_peered":"2023-11-30T23:27:40.771097+0000","last_clean":"2023-11-30T23:27:40.771097+0000","last_became_active":"2023-11-30T23:12:47.143061+0000","last_became_peered":"2023-11-30T23:12:47.143061+0000","last_unstale":"2023-11-30T23:27:40.771097+0000","last_undegraded":"2023-11-30T23:27:40.771097+0000","last_fullsized":"2023-11-30T23:27:40.771097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:38.684081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":2145,"num_write_kb":21845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"48'3505","reported_seq":2894,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.454978+0000","last_change":"2023-11-30T23:27:40.468495+0000","last_active":"2023-11-30T23:27:41.454978+0000","last_peered":"2023-11-30T23:27:41.454978+0000","last_clean":"2023-11-30T23:27:41.454978+0000","last_became_active":"2023-11-30T23:12:47.501516+0000","last_became_peered":"2023-11-30T23:12:47.501516+0000","last_unstale":"2023-11-30T23:27:41.454978+0000","last_undegraded":"2023-11-30T23:27:41.454978+0000","last_fullsized":"2023-11-30T23:27:41.454978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:34:32.232378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040930987000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.6","version":"48'2107","reported_seq":2152,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.428152+0000","last_change":"2023-11-30T23:12:47.135053+0000","last_active":"2023-11-30T23:27:40.428152+0000","last_peered":"2023-11-30T23:27:40.428152+0000","last_clean":"2023-11-30T23:27:40.428152+0000","last_became_active":"2023-11-30T23:12:47.134776+0000","last_became_peered":"2023-11-30T23:12:47.134776+0000","last_unstale":"2023-11-30T23:27:40.428152+0000","last_undegraded":"2023-11-30T23:27:40.428152+0000","last_fullsized":"2023-11-30T23:27:40.428152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2107,"log_dups_size":0,"ondisk_log_size":2107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":2450,"num_write_kb":16294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"48'3245","reported_seq":2657,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.522958+0000","last_change":"2023-11-30T23:27:40.533855+0000","last_active":"2023-11-30T23:27:41.522958+0000","last_peered":"2023-11-30T23:27:41.522958+0000","last_clean":"2023-11-30T23:27:41.522958+0000","last_became_active":"2023-11-30T23:12:47.498631+0000","last_became_peered":"2023-11-30T23:12:47.498631+0000","last_unstale":"2023-11-30T23:27:41.522958+0000","last_undegraded":"2023-11-30T23:27:41.522958+0000","last_fullsized":"2023-11-30T23:27:41.522958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3245,"log_dups_size":0,"ondisk_log_size":3245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033287613000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1095,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.7","version":"48'1686","reported_seq":1731,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.770201+0000","last_change":"2023-11-30T23:12:47.137707+0000","last_active":"2023-11-30T23:27:40.770201+0000","last_peered":"2023-11-30T23:27:40.770201+0000","last_clean":"2023-11-30T23:27:40.770201+0000","last_became_active":"2023-11-30T23:12:47.137406+0000","last_became_peered":"2023-11-30T23:12:47.137406+0000","last_unstale":"2023-11-30T23:27:40.770201+0000","last_undegraded":"2023-11-30T23:27:40.770201+0000","last_fullsized":"2023-11-30T23:27:40.770201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1686,"log_dups_size":0,"ondisk_log_size":1686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":1761,"num_write_kb":9276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"48'3472","reported_seq":2875,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.548715+0000","last_change":"2023-11-30T23:27:40.571283+0000","last_active":"2023-11-30T23:27:41.548715+0000","last_peered":"2023-11-30T23:27:41.548715+0000","last_clean":"2023-11-30T23:27:41.548715+0000","last_became_active":"2023-11-30T23:12:47.506447+0000","last_became_peered":"2023-11-30T23:12:47.506447+0000","last_unstale":"2023-11-30T23:27:41.548715+0000","last_undegraded":"2023-11-30T23:27:41.548715+0000","last_fullsized":"2023-11-30T23:27:41.548715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3472,"log_dups_size":0,"ondisk_log_size":3472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:35:21.183993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037907362999999999,"stat_sum":{"num_bytes":4105,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1170,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.8","version":"41'1548","reported_seq":1593,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.408276+0000","last_change":"2023-11-30T23:12:47.142532+0000","last_active":"2023-11-30T23:27:39.408276+0000","last_peered":"2023-11-30T23:27:39.408276+0000","last_clean":"2023-11-30T23:27:39.408276+0000","last_became_active":"2023-11-30T23:12:47.142135+0000","last_became_peered":"2023-11-30T23:12:47.142135+0000","last_unstale":"2023-11-30T23:27:39.408276+0000","last_undegraded":"2023-11-30T23:27:39.408276+0000","last_fullsized":"2023-11-30T23:27:39.408276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1548,"log_dups_size":0,"ondisk_log_size":1548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:53.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":1654,"num_write_kb":9390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"48'3431","reported_seq":2807,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.574838+0000","last_change":"2023-11-30T23:27:40.779072+0000","last_active":"2023-11-30T23:27:41.574838+0000","last_peered":"2023-11-30T23:27:41.574838+0000","last_clean":"2023-11-30T23:27:41.574838+0000","last_became_active":"2023-11-30T23:12:47.513966+0000","last_became_peered":"2023-11-30T23:12:47.513966+0000","last_unstale":"2023-11-30T23:27:41.574838+0000","last_undegraded":"2023-11-30T23:27:41.574838+0000","last_fullsized":"2023-11-30T23:27:41.574838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3431,"log_dups_size":0,"ondisk_log_size":3431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:02.220181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003646318,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.9","version":"41'2295","reported_seq":2340,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.992195+0000","last_change":"2023-11-30T23:12:47.140898+0000","last_active":"2023-11-30T23:27:39.992195+0000","last_peered":"2023-11-30T23:27:39.992195+0000","last_clean":"2023-11-30T23:27:39.992195+0000","last_became_active":"2023-11-30T23:12:47.140565+0000","last_became_peered":"2023-11-30T23:12:47.140565+0000","last_unstale":"2023-11-30T23:27:39.992195+0000","last_undegraded":"2023-11-30T23:27:39.992195+0000","last_fullsized":"2023-11-30T23:27:39.992195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":2336,"num_write_kb":17365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'3595","reported_seq":2941,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.559453+0000","last_change":"2023-11-30T23:27:40.526518+0000","last_active":"2023-11-30T23:27:41.559453+0000","last_peered":"2023-11-30T23:27:41.559453+0000","last_clean":"2023-11-30T23:27:41.559453+0000","last_became_active":"2023-11-30T23:12:47.501315+0000","last_became_peered":"2023-11-30T23:12:47.501315+0000","last_unstale":"2023-11-30T23:27:41.559453+0000","last_undegraded":"2023-11-30T23:27:41.559453+0000","last_fullsized":"2023-11-30T23:27:41.559453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026736012999999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.a","version":"44'2871","reported_seq":2916,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.993797+0000","last_change":"2023-11-30T23:12:47.140328+0000","last_active":"2023-11-30T23:27:39.993797+0000","last_peered":"2023-11-30T23:27:39.993797+0000","last_clean":"2023-11-30T23:27:39.993797+0000","last_became_active":"2023-11-30T23:12:47.140037+0000","last_became_peered":"2023-11-30T23:12:47.140037+0000","last_unstale":"2023-11-30T23:27:39.993797+0000","last_undegraded":"2023-11-30T23:27:39.993797+0000","last_fullsized":"2023-11-30T23:27:39.993797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:38.684081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":2935,"num_write_kb":26081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"48'3359","reported_seq":2771,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.559018+0000","last_change":"2023-11-30T23:27:40.530235+0000","last_active":"2023-11-30T23:27:41.559018+0000","last_peered":"2023-11-30T23:27:41.559018+0000","last_clean":"2023-11-30T23:27:41.559018+0000","last_became_active":"2023-11-30T23:12:47.507181+0000","last_became_peered":"2023-11-30T23:12:47.507181+0000","last_unstale":"2023-11-30T23:27:41.559018+0000","last_undegraded":"2023-11-30T23:27:41.559018+0000","last_fullsized":"2023-11-30T23:27:41.559018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030024714000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.b","version":"41'4584","reported_seq":4629,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.409866+0000","last_change":"2023-11-30T23:12:47.142027+0000","last_active":"2023-11-30T23:27:39.409866+0000","last_peered":"2023-11-30T23:27:39.409866+0000","last_clean":"2023-11-30T23:27:39.409866+0000","last_became_active":"2023-11-30T23:12:47.141664+0000","last_became_peered":"2023-11-30T23:12:47.141664+0000","last_unstale":"2023-11-30T23:27:39.409866+0000","last_undegraded":"2023-11-30T23:27:39.409866+0000","last_fullsized":"2023-11-30T23:27:39.409866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4584,"log_dups_size":0,"ondisk_log_size":4584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4647,"num_write_kb":30581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"48'3589","reported_seq":2929,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.511274+0000","last_change":"2023-11-30T23:27:40.782695+0000","last_active":"2023-11-30T23:27:41.511274+0000","last_peered":"2023-11-30T23:27:41.511274+0000","last_clean":"2023-11-30T23:27:41.511274+0000","last_became_active":"2023-11-30T23:12:47.516939+0000","last_became_peered":"2023-11-30T23:12:47.516939+0000","last_unstale":"2023-11-30T23:27:41.511274+0000","last_undegraded":"2023-11-30T23:27:41.511274+0000","last_fullsized":"2023-11-30T23:27:41.511274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3589,"log_dups_size":0,"ondisk_log_size":3589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014334588000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1d","version":"48'3872","reported_seq":3220,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.485190+0000","last_change":"2023-11-30T23:27:40.517369+0000","last_active":"2023-11-30T23:27:41.485190+0000","last_peered":"2023-11-30T23:27:41.485190+0000","last_clean":"2023-11-30T23:27:41.485190+0000","last_became_active":"2023-11-30T23:12:47.521310+0000","last_became_peered":"2023-11-30T23:12:47.521310+0000","last_unstale":"2023-11-30T23:27:41.485190+0000","last_undegraded":"2023-11-30T23:27:41.485190+0000","last_fullsized":"2023-11-30T23:27:41.485190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3872,"log_dups_size":0,"ondisk_log_size":3872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:08:47.117163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015666933000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1c","version":"43'622","reported_seq":666,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.409308+0000","last_change":"2023-11-30T23:12:47.143819+0000","last_active":"2023-11-30T23:27:39.409308+0000","last_peered":"2023-11-30T23:27:39.409308+0000","last_clean":"2023-11-30T23:27:39.409308+0000","last_became_active":"2023-11-30T23:12:47.143512+0000","last_became_peered":"2023-11-30T23:12:47.143512+0000","last_unstale":"2023-11-30T23:27:39.409308+0000","last_undegraded":"2023-11-30T23:27:39.409308+0000","last_fullsized":"2023-11-30T23:27:39.409308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:35:20.171512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":689,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"48'3820","reported_seq":3126,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.577995+0000","last_change":"2023-11-30T23:27:40.520201+0000","last_active":"2023-11-30T23:27:41.577995+0000","last_peered":"2023-11-30T23:27:41.577995+0000","last_clean":"2023-11-30T23:27:41.577995+0000","last_became_active":"2023-11-30T23:12:47.520322+0000","last_became_peered":"2023-11-30T23:12:47.520322+0000","last_unstale":"2023-11-30T23:27:41.577995+0000","last_undegraded":"2023-11-30T23:27:41.577995+0000","last_fullsized":"2023-11-30T23:27:41.577995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3820,"log_dups_size":0,"ondisk_log_size":3820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018218595000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1d","version":"41'4570","reported_seq":4614,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.409491+0000","last_change":"2023-11-30T23:12:47.142276+0000","last_active":"2023-11-30T23:27:39.409491+0000","last_peered":"2023-11-30T23:27:39.409491+0000","last_clean":"2023-11-30T23:27:39.409491+0000","last_became_active":"2023-11-30T23:12:47.141965+0000","last_became_peered":"2023-11-30T23:12:47.141965+0000","last_unstale":"2023-11-30T23:27:39.409491+0000","last_undegraded":"2023-11-30T23:27:39.409491+0000","last_fullsized":"2023-11-30T23:27:39.409491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4570,"log_dups_size":0,"ondisk_log_size":4570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:28.154593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4627,"num_write_kb":34948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"48'3352","reported_seq":2791,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.529314+0000","last_change":"2023-11-30T23:27:40.554745+0000","last_active":"2023-11-30T23:27:41.529314+0000","last_peered":"2023-11-30T23:27:41.529314+0000","last_clean":"2023-11-30T23:27:41.529314+0000","last_became_active":"2023-11-30T23:12:47.522002+0000","last_became_peered":"2023-11-30T23:12:47.522002+0000","last_unstale":"2023-11-30T23:27:41.529314+0000","last_undegraded":"2023-11-30T23:27:41.529314+0000","last_fullsized":"2023-11-30T23:27:41.529314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3352,"log_dups_size":0,"ondisk_log_size":3352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025109995999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1079,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1e","version":"43'4068","reported_seq":4114,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.717324+0000","last_change":"2023-11-30T23:12:47.139186+0000","last_active":"2023-11-30T23:27:39.717324+0000","last_peered":"2023-11-30T23:27:39.717324+0000","last_clean":"2023-11-30T23:27:39.717324+0000","last_became_active":"2023-11-30T23:12:47.138275+0000","last_became_peered":"2023-11-30T23:12:47.138275+0000","last_unstale":"2023-11-30T23:27:39.717324+0000","last_undegraded":"2023-11-30T23:27:39.717324+0000","last_fullsized":"2023-11-30T23:27:39.717324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4068,"log_dups_size":0,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:58:25.168678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":4121,"num_write_kb":30658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"48'3346","reported_seq":2746,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.529273+0000","last_change":"2023-11-30T23:27:40.538163+0000","last_active":"2023-11-30T23:27:41.529273+0000","last_peered":"2023-11-30T23:27:41.529273+0000","last_clean":"2023-11-30T23:27:41.529273+0000","last_became_active":"2023-11-30T23:12:47.508718+0000","last_became_peered":"2023-11-30T23:12:47.508718+0000","last_unstale":"2023-11-30T23:27:41.529273+0000","last_undegraded":"2023-11-30T23:27:41.529273+0000","last_fullsized":"2023-11-30T23:27:41.529273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3346,"log_dups_size":0,"ondisk_log_size":3346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037282159000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1f","version":"43'790","reported_seq":836,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.520769+0000","last_change":"2023-11-30T23:12:47.141150+0000","last_active":"2023-11-30T23:27:39.520769+0000","last_peered":"2023-11-30T23:27:39.520769+0000","last_clean":"2023-11-30T23:27:39.520769+0000","last_became_active":"2023-11-30T23:12:47.140891+0000","last_became_peered":"2023-11-30T23:12:47.140891+0000","last_unstale":"2023-11-30T23:27:39.520769+0000","last_undegraded":"2023-11-30T23:27:39.520769+0000","last_fullsized":"2023-11-30T23:27:39.520769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:22:48.835054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":847,"num_write_kb":12818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":74679,"num_write_kb":40592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228857,"ondisk_log_size":228857,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":275264647,"num_objects":614,"num_object_clones":0,"num_object_copies":1228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":614,"num_whiteouts":0,"num_read":1037,"num_read_kb":3420,"num_write":81069,"num_write_kb":625801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":540,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":550592512,"data_stored":550529294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78631,"ondisk_log_size":78631,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575033,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438952,"kb_used_data":70816,"kb_used_omap":0,"kb_used_meta":368128,"kb_avail":93932888,"statfs":{"total":96636764160,"available":96187277312,"internally_reserved":0,"allocated":72515584,"data_stored":72178287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":376963072},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69499999999999995,"15min":0.70399999999999996},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":1.1639999999999999,"5min":0.84699999999999998,"15min":0.78900000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":6.9429999999999996,"5min":6.9429999999999996,"15min":6.9429999999999996},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.81699999999999995,"15min":0.81399999999999995},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":7.0540000000000003,"5min":7.0540000000000003,"15min":7.0540000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.751},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.84699999999999998,"15min":0.83099999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":5.54,"5min":5.54,"15min":5.54},"last":0.373},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":5.5880000000000001,"5min":5.5880000000000001,"15min":5.5880000000000001},"last":0.437}]},{"osd":3,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":0.94999999999999996,"15min":0.90100000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":4.6440000000000001,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":1.022,"5min":0.95999999999999996,"15min":0.96299999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":4.6589999999999998,"5min":4.6589999999999998,"15min":4.6589999999999998},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.68799999999999994,"15min":0.77500000000000002},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.314},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3759999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.81100000000000005,"15min":0.88100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.313}]},{"osd":5,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.79200000000000004,"15min":0.875},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.6719999999999999,"5min":1.7110000000000001,"15min":1.7210000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.81599999999999995,"15min":0.88500000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6379999999999999,"5min":1.796,"15min":1.796},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.86599999999999999,"15min":0.94499999999999995},"min":{"1min":0.38300000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.694,"5min":1.694,"15min":2.9670000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.92300000000000004,"15min":0.97899999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":0.46700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575033,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345988,"kb_used_data":90172,"kb_used_omap":0,"kb_used_meta":255808,"kb_avail":94025852,"statfs":{"total":96636764160,"available":96282472448,"internally_reserved":0,"allocated":92336128,"data_stored":92014768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":261947392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70199999999999996,"15min":0.73199999999999998},"min":{"1min":0.27100000000000002,"5min":0.23999999999999999,"15min":0.221},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.5640000000000001},"last":1.306},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.77000000000000002,"15min":0.78400000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":3.4670000000000001,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.83199999999999996,"15min":0.86299999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":2.2210000000000001,"5min":5.851,"15min":12.172000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.33300000000000002},"max":{"1min":3.4420000000000002,"5min":3.4420000000000002,"15min":5.6980000000000004},"last":0.77900000000000003}]},{"osd":2,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.1800000000000002,"5min":2.327,"15min":2.327},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83999999999999997,"15min":0.86399999999999999},"min":{"1min":0.35999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.774},"last":1.3720000000000001}]},{"osd":3,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.873,"15min":0.873},"min":{"1min":0.434,"5min":0.434,"15min":0.38900000000000001},"max":{"1min":3.4889999999999999,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.871,"15min":0.86799999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":2.2029999999999998,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.83799999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.081,"5min":2.081,"15min":2.6429999999999998},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.878,"15min":0.88900000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35299999999999998},"max":{"1min":3.371,"5min":3.371,"15min":3.371},"last":1.0269999999999999}]},{"osd":5,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.83899999999999997,"15min":0.84899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.1549999999999998,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.91000000000000003,"15min":0.97599999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":2.194,"5min":2.2400000000000002,"15min":2.7040000000000002},"last":1.4330000000000001}]},{"osd":7,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.101,"15min":1.0509999999999999},"min":{"1min":0.45700000000000002,"5min":0.45600000000000002,"15min":0.42499999999999999},"max":{"1min":3.4169999999999998,"5min":11.220000000000001,"15min":11.220000000000001},"last":1.083},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.0940000000000001,"15min":1.1399999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.2370000000000001,"5min":12.874000000000001,"15min":30.405999999999999},"last":0.80000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575033,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":384292,"kb_used_data":86620,"kb_used_omap":0,"kb_used_meta":297664,"kb_avail":93987548,"statfs":{"total":96636764160,"available":96243249152,"internally_reserved":0,"allocated":88698880,"data_stored":88364629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304807936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.64200000000000002,"15min":0.70799999999999996},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.91200000000000003,"5min":1.1990000000000001,"15min":1.2330000000000001},"last":1.167},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.72599999999999998,"15min":0.76500000000000001},"min":{"1min":0.39700000000000002,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":3.5489999999999999,"5min":3.5489999999999999,"15min":4.508},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.77800000000000002,"15min":0.84499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96699999999999997,"5min":2.9740000000000002,"15min":6.9320000000000004},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.78000000000000003,"15min":0.88400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.94399999999999995,"5min":1.661,"15min":6.8780000000000001},"last":1.1970000000000001}]},{"osd":2,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.76300000000000001,"15min":0.80400000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.26700000000000002},"max":{"1min":1.04,"5min":1.7130000000000001,"15min":1.9690000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.77500000000000002,"15min":0.85099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0569999999999999,"5min":3.1379999999999999,"15min":4.6230000000000002},"last":1.0129999999999999}]},{"osd":3,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.81799999999999995,"15min":0.85299999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.345,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.82899999999999996,"15min":0.93200000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.997,"5min":3.0030000000000001,"15min":6.7400000000000002},"last":0.95899999999999996}]},{"osd":4,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.71399999999999997,"15min":0.80900000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.309},"max":{"1min":0.878,"5min":1.456,"15min":1.4930000000000001},"last":0.878},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.83099999999999996,"15min":0.86299999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.5820000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.98299999999999998}]},{"osd":6,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.84699999999999998,"15min":0.89000000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.3520000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.86499999999999999,"15min":0.93500000000000005},"min":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.8160000000000001,"5min":3.073,"15min":3.073},"last":1.2350000000000001}]},{"osd":7,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.89500000000000002,"15min":0.94599999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.012,"5min":2.895,"15min":2.895},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.92800000000000005,"15min":0.98199999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.6559999999999999,"5min":3.484,"15min":3.484},"last":1.2090000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575032,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":349332,"kb_used_data":65612,"kb_used_omap":0,"kb_used_meta":283712,"kb_avail":94022508,"statfs":{"total":96636764160,"available":96279048192,"internally_reserved":0,"allocated":67186688,"data_stored":66856744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":290521088},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":0.81100000000000005,"15min":0.751},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":12.91,"5min":12.91,"15min":12.91},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.345,"5min":0.83299999999999996,"15min":0.77300000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":12.962,"5min":12.962,"15min":12.962},"last":0.93600000000000005}]},{"osd":1,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.25600000000000001},"max":{"1min":4.8090000000000002,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.79900000000000004,"15min":0.78000000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":6.7839999999999998,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":1.1080000000000001}]},{"osd":2,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":0.83299999999999996,"15min":0.80900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":9.0229999999999997,"5min":9.0229999999999997,"15min":9.0229999999999997},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.143,"5min":0.92500000000000004,"15min":0.90500000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.33600000000000002},"max":{"1min":8.9990000000000006,"5min":8.9990000000000006,"15min":8.9990000000000006},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.86899999999999999,"15min":0.85399999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":5.0209999999999999,"5min":5.0209999999999999,"15min":5.0209999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80800000000000005,"15min":0.82799999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":2.9489999999999998,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":4.71,"5min":1.593,"15min":1.087},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":81.837000000000003,"5min":81.837000000000003,"15min":81.837000000000003},"last":0.76700000000000002},{"interface":"front","average":{"1min":4.8460000000000001,"5min":1.6930000000000001,"15min":1.179},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":81.751999999999995,"5min":81.751999999999995,"15min":81.751999999999995},"last":1.1479999999999999}]},{"osd":6,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":4.6379999999999999,"5min":1.5740000000000001,"15min":1.0920000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":79.655000000000001,"5min":79.655000000000001,"15min":79.655000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":4.7789999999999999,"5min":1.6830000000000001,"15min":1.2070000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":80.540000000000006,"5min":80.540000000000006,"15min":80.540000000000006},"last":1.032}]},{"osd":7,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":4.8399999999999999,"5min":1.7190000000000001,"15min":1.206},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":80.486000000000004,"5min":80.486000000000004,"15min":80.486000000000004},"last":0.90400000000000003},{"interface":"front","average":{"1min":5.0449999999999999,"5min":1.7150000000000001,"15min":1.2030000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":81.875,"5min":81.875,"15min":81.875},"last":0.86699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575033,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370920,"kb_used_data":61024,"kb_used_omap":0,"kb_used_meta":309888,"kb_avail":94000920,"statfs":{"total":96636764160,"available":96256942080,"internally_reserved":0,"allocated":62488576,"data_stored":62170691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":317325312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":2.6589999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.26900000000000002,"5min":0.24299999999999999,"15min":0.23999999999999999},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.4750000000000001},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.125,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.74299999999999999,"15min":0.77100000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0960000000000001,"5min":1.256,"15min":4.8150000000000004},"last":0.89800000000000002}]},{"osd":2,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.77200000000000002,"15min":0.76900000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.28000000000000003},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.82899999999999996,"15min":0.84399999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.1259999999999999,"5min":1.3580000000000001,"15min":4.8719999999999999},"last":1.0149999999999999}]},{"osd":4,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.88500000000000001,"15min":0.89300000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.31},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":2.536},"last":1.26},{"interface":"front","average":{"1min":1.099,"5min":0.96199999999999997,"15min":0.95999999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.378},"max":{"1min":4.6820000000000004,"5min":4.6820000000000004,"15min":4.6820000000000004},"last":1.3}]},{"osd":5,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.0580000000000001,"15min":1.0189999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.42099999999999999},"max":{"1min":8.8010000000000002,"5min":8.8010000000000002,"15min":8.8010000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.98799999999999999,"15min":1.04},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1499999999999999,"5min":1.8500000000000001,"15min":4.9909999999999997},"last":1.0820000000000001}]},{"osd":6,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.0429999999999999,"15min":1.022},"min":{"1min":0.52700000000000002,"5min":0.52100000000000002,"15min":0.378},"max":{"1min":3.6699999999999999,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":1.044},{"interface":"front","average":{"1min":0.88700000000000001,"5min":1.024,"15min":1.0660000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.45500000000000002},"max":{"1min":1.1870000000000001,"5min":2.3530000000000002,"15min":4.4379999999999997},"last":1.2130000000000001}]},{"osd":7,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.038,"15min":1.085},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2629999999999999,"5min":1.4910000000000001,"15min":5.0369999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.056,"15min":1.073},"min":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.214,"5min":2.214,"15min":2.5609999999999999},"last":1.1279999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575034,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224096,"kb_used_data":40536,"kb_used_omap":0,"kb_used_meta":183552,"kb_avail":94147744,"statfs":{"total":96636764160,"available":96407289856,"internally_reserved":0,"allocated":41508864,"data_stored":41194419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":187957248},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.72599999999999998,"5min":1.0629999999999999,"15min":1.413},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.65100000000000002,"15min":0.67400000000000004},"min":{"1min":0.222,"5min":0.222,"15min":0.17999999999999999},"max":{"1min":1.044,"5min":1.2110000000000001,"15min":1.4470000000000001},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.79100000000000004,"15min":0.73299999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":8.3480000000000008,"5min":8.3480000000000008,"15min":8.3480000000000008},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.74199999999999999,"15min":0.76100000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.224},"max":{"1min":1.0329999999999999,"5min":1.1850000000000001,"15min":11.457000000000001},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.79200000000000004,"15min":0.73299999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.4569999999999999,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.86199999999999999,"15min":0.84099999999999997},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.4319999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.093}]},{"osd":4,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.85699999999999998,"15min":0.88100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28299999999999997},"max":{"1min":1.151,"5min":1.5029999999999999,"15min":1.522},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.88,"15min":0.87},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.4540000000000002,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":1.0109999999999999,"15min":0.999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":1.0009999999999999,"15min":0.998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.754}]},{"osd":6,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0089999999999999,"15min":0.96599999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":4.9420000000000002,"5min":4.9420000000000002,"15min":4.9420000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.369,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":1.222}]},{"osd":7,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":1.0569999999999999,"15min":1.0549999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.498,"5min":1.498,"15min":1.762},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.179,"5min":1.0920000000000001,"15min":1.0469999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.4750000000000001,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.92400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575034,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396560,"kb_used_data":86600,"kb_used_omap":0,"kb_used_meta":309952,"kb_avail":93975280,"statfs":{"total":96636764160,"available":96230686720,"internally_reserved":0,"allocated":88678400,"data_stored":88352518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":317390848},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.183},"max":{"1min":2.7850000000000001,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.498,"5min":0.67000000000000004,"15min":0.65900000000000003},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.91700000000000004,"5min":1.222,"15min":1.222},"last":0.69099999999999995}]},{"osd":2,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66100000000000003,"15min":0.67300000000000004},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23000000000000001},"max":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.71399999999999997,"15min":0.72299999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.20699999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29099999999999998},"max":{"1min":0.96799999999999997,"5min":1.3720000000000001,"15min":1.431},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.78500000000000003,"15min":0.76100000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.498,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.624}]},{"osd":4,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.85499999999999998,"15min":0.88100000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.85699999999999998,"15min":0.88800000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.077,"5min":1.482,"15min":1.6919999999999999},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.84199999999999997,"15min":0.84999999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.5389999999999999,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.97299999999999998,"15min":0.99099999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.8879999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.93500000000000005,"15min":0.93300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.6000000000000001,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.012,"15min":1.026},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.9209999999999998,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.998,"15min":1.0069999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":1.1259999999999999,"5min":2.7549999999999999,"15min":2.7549999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.997,"15min":1.004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.5720000000000001,"5min":3.2280000000000002,"15min":3.2280000000000002},"last":0.94999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575033,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243812,"kb_used_data":42140,"kb_used_omap":0,"kb_used_meta":201664,"kb_avail":94128028,"statfs":{"total":96636764160,"available":96387100672,"internally_reserved":0,"allocated":43151360,"data_stored":42810014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":206503936},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,1,1,10,9,24,13],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.624,"15min":0.61099999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.20999999999999999},"max":{"1min":0.88,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65100000000000002,"15min":0.66200000000000003},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.486}]},{"osd":2,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.311,"5min":0.311,"15min":0.23699999999999999},"max":{"1min":1.046,"5min":1.8919999999999999,"15min":2.3479999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.76900000000000002,"15min":0.77300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":0.23499999999999999}]},{"osd":3,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.70599999999999996,"15min":0.71699999999999997},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.387,"5min":1.387,"15min":4.3170000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.85899999999999999,"15min":0.82699999999999996},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.99099999999999999,"5min":1.925,"15min":2.395},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.90800000000000003,"15min":0.89700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.86899999999999999,"15min":0.89700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":2.0640000000000001},"last":5.5720000000000001}]},{"osd":5,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.90200000000000002,"15min":0.91500000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.24,"5min":1.5629999999999999,"15min":1.871},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":1.054,"15min":1.0680000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.9350000000000001,"5min":3.165,"15min":6.0119999999999996},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":1.089,"15min":1.0720000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.0800000000000001,"5min":2.0840000000000001,"15min":2.5209999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.032,"15min":1.032},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.254,"5min":2.254,"15min":8.3490000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.0129999999999999,"15min":1.038},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":6.1529999999999996},"last":0.57999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41955328,"data_stored":41943678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":88088576,"data_stored":88080689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40919040,"data_stored":40918503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61898752,"data_stored":61890695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":66588672,"data_stored":66572640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":88084480,"data_stored":88080474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":91750400,"data_stored":91738865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":28760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":24621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":28708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":32788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":36947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":28695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":36961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T23:27:45.928 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T23:27:46.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.034+0000 7f86df001700 1 Processor -- start 2023-11-30T23:27:46.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.034+0000 7f86df001700 1 -- start start 2023-11-30T23:27:46.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.034+0000 7f86df001700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86d80b4ee0 0x7f86d8147090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.034+0000 7f86df001700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86d80b6910 0x7f86d814a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.034+0000 7f86df001700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d81475d0 con 0x7f86d80b3f10 2023-11-30T23:27:46.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.034+0000 7f86df001700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d80b5e70 con 0x7f86d80b6910 2023-11-30T23:27:46.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.034+0000 7f86df001700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d80b5c00 con 0x7f86d80b4ee0 2023-11-30T23:27:46.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.034+0000 7f86de800700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86d80b6910 0x7f86d814a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.034+0000 7f86de800700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86d80b6910 0x7f86d814a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60760/0 (socket says 172.21.15.73:60760) 2023-11-30T23:27:46.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.034+0000 7f86de800700 1 -- 172.21.15.73:0/2050284257 learned_addr learned my addr 172.21.15.73:0/2050284257 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:46.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.034+0000 7f86dd7fe700 1 --2- 172.21.15.73:0/2050284257 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86d80b4ee0 0x7f86d8147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.034+0000 7f86dcffd700 1 -- 172.21.15.73:0/2050284257 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440170280 0 0) 0x7f86d4001110 con 0x7f86d80b3f10 2023-11-30T23:27:46.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86dcffd700 1 -- 172.21.15.73:0/2050284257 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86c40035d0 con 0x7f86d80b3f10 2023-11-30T23:27:46.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86dd7fe700 1 -- 172.21.15.73:0/2050284257 >> v2:172.21.15.73:3300/0 conn(0x7f86d80b6910 msgr2=0x7f86d814a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:46.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86dd7fe700 1 --2- 172.21.15.73:0/2050284257 >> v2:172.21.15.73:3300/0 conn(0x7f86d80b6910 0x7f86d814a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86dd7fe700 1 -- 172.21.15.73:0/2050284257 >> v1:172.21.15.156:6789/0 conn(0x7f86d80b3f10 legacy=0x7f86d8149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:46.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86dd7fe700 1 -- 172.21.15.73:0/2050284257 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d80b42f0 con 0x7f86d80b4ee0 2023-11-30T23:27:46.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86de800700 1 --2- 172.21.15.73:0/2050284257 >> v2:172.21.15.73:3300/0 conn(0x7f86d80b6910 0x7f86d814a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:27:46.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86dd7fe700 1 --2- 172.21.15.73:0/2050284257 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86d80b4ee0 0x7f86d8147090 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009850 tx=0x7f86c8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27970ec53e39bfda server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:46.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86dcffd700 1 -- 172.21.15.73:0/2050284257 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c8011830 con 0x7f86d80b4ee0 2023-11-30T23:27:46.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86dcffd700 1 -- 172.21.15.73:0/2050284257 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c8011990 con 0x7f86d80b4ee0 2023-11-30T23:27:46.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86dcffd700 1 -- 172.21.15.73:0/2050284257 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c8011d40 con 0x7f86d80b4ee0 2023-11-30T23:27:46.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86df001700 1 -- 172.21.15.73:0/2050284257 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86d80b4ee0 msgr2=0x7f86d8147090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:46.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86df001700 1 --2- 172.21.15.73:0/2050284257 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86d80b4ee0 0x7f86d8147090 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009850 tx=0x7f86c8009b60 comp rx=0 tx=0).stop 2023-11-30T23:27:46.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86df001700 1 -- 172.21.15.73:0/2050284257 shutdown_connections 2023-11-30T23:27:46.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86df001700 1 --2- 172.21.15.73:0/2050284257 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86d80b4ee0 0x7f86d8147090 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86df001700 1 --2- 172.21.15.73:0/2050284257 >> v2:172.21.15.73:3300/0 conn(0x7f86d80b6910 0x7f86d814a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86df001700 1 -- 172.21.15.73:0/2050284257 >> 172.21.15.73:0/2050284257 conn(0x7f86d80b8a10 msgr2=0x7f86d80b8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:46.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86df001700 1 -- 172.21.15.73:0/2050284257 shutdown_connections 2023-11-30T23:27:46.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86df001700 1 -- 172.21.15.73:0/2050284257 wait complete. 2023-11-30T23:27:46.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86df001700 1 Processor -- start 2023-11-30T23:27:46.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.038+0000 7f86df001700 1 -- start start 2023-11-30T23:27:46.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86df001700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86d80b3f10 0x7f86d81cec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86df001700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86d80b4ee0 0x7f86d8142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86df001700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d80b6910 0x7f86d8143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86df001700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d81d00d0 con 0x7f86d80b6910 2023-11-30T23:27:46.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86df001700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d81d03b0 con 0x7f86d80b4ee0 2023-11-30T23:27:46.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86df001700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d81cc990 con 0x7f86d80b3f10 2023-11-30T23:27:46.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86de800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d80b6910 0x7f86d8143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86ddfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86d80b3f10 0x7f86d81cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86de800700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d80b6910 0x7f86d8143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60762/0 (socket says 172.21.15.73:60762) 2023-11-30T23:27:46.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86dd7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86d80b4ee0 0x7f86d8142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86de800700 1 -- 172.21.15.73:0/2342214611 learned_addr learned my addr 172.21.15.73:0/2342214611 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:46.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86ddfff700 1 -- 172.21.15.73:0/2342214611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86d80b4ee0 msgr2=0x7f86d8142b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:46.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86ddfff700 1 --2- 172.21.15.73:0/2342214611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86d80b4ee0 0x7f86d8142b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86ddfff700 1 -- 172.21.15.73:0/2342214611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d80b6910 msgr2=0x7f86d8143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:46.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86ddfff700 1 --2- 172.21.15.73:0/2342214611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d80b6910 0x7f86d8143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86ddfff700 1 -- 172.21.15.73:0/2342214611 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d0009b30 con 0x7f86d80b3f10 2023-11-30T23:27:46.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86ddfff700 1 --2- 172.21.15.73:0/2342214611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86d80b3f10 0x7f86d81cec10 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f86d400c700 tx=0x7f86d400ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:46.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86ce7fc700 1 -- 172.21.15.73:0/2342214611 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d40052d0 con 0x7f86d80b3f10 2023-11-30T23:27:46.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86ce7fc700 1 -- 172.21.15.73:0/2342214611 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d4005430 con 0x7f86d80b3f10 2023-11-30T23:27:46.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86df001700 1 -- 172.21.15.73:0/2342214611 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c80094b0 con 0x7f86d80b3f10 2023-11-30T23:27:46.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86ce7fc700 1 -- 172.21.15.73:0/2342214611 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d40055a0 con 0x7f86d80b3f10 2023-11-30T23:27:46.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86df001700 1 -- 172.21.15.73:0/2342214611 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d8142630 con 0x7f86d80b3f10 2023-11-30T23:27:46.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.042+0000 7f86df001700 1 -- 172.21.15.73:0/2342214611 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d804ed80 con 0x7f86d80b3f10 2023-11-30T23:27:46.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.046+0000 7f86ce7fc700 1 -- 172.21.15.73:0/2342214611 <== mon.2 v2:172.21.15.156:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f86d40038c0 con 0x7f86d80b3f10 2023-11-30T23:27:46.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.046+0000 7f86ce7fc700 1 --2- 172.21.15.73:0/2342214611 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f86bc065ad0 0x7f86bc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.046+0000 7f86ce7fc700 1 -- 172.21.15.73:0/2342214611 <== mon.2 v2:172.21.15.156:3301/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f86d4082380 con 0x7f86d80b3f10 2023-11-30T23:27:46.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.046+0000 7f86dd7fe700 1 --2- 172.21.15.73:0/2342214611 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f86bc065ad0 0x7f86bc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.046+0000 7f86dd7fe700 1 --2- 172.21.15.73:0/2342214611 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f86bc065ad0 0x7f86bc067f90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f86d80b52c0 tx=0x7f86c8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:46.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.054+0000 7f86ce7fc700 1 -- 172.21.15.73:0/2342214611 <== mon.2 v2:172.21.15.156:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f86d404fd20 con 0x7f86d80b3f10 2023-11-30T23:27:46.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.218+0000 7f86df001700 1 -- 172.21.15.73:0/2342214611 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f86d80b36c0 con 0x7f86bc065ad0 2023-11-30T23:27:46.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.230+0000 7f86ce7fc700 1 -- 172.21.15.73:0/2342214611 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+293494 (secure 0 0 0) 0x7f86c8011b00 con 0x7f86bc065ad0 2023-11-30T23:27:46.241 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:27:46.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.238+0000 7f86df001700 1 -- 172.21.15.73:0/2342214611 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f86bc065ad0 msgr2=0x7f86bc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:46.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.238+0000 7f86df001700 1 --2- 172.21.15.73:0/2342214611 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f86bc065ad0 0x7f86bc067f90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f86d80b52c0 tx=0x7f86c8008030 comp rx=0 tx=0).stop 2023-11-30T23:27:46.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.238+0000 7f86df001700 1 -- 172.21.15.73:0/2342214611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86d80b3f10 msgr2=0x7f86d81cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:46.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.238+0000 7f86df001700 1 --2- 172.21.15.73:0/2342214611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86d80b3f10 0x7f86d81cec10 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f86d400c700 tx=0x7f86d400ca10 comp rx=0 tx=0).stop 2023-11-30T23:27:46.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.238+0000 7f86df001700 1 -- 172.21.15.73:0/2342214611 shutdown_connections 2023-11-30T23:27:46.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.238+0000 7f86df001700 1 --2- 172.21.15.73:0/2342214611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d80b6910 0x7f86d8143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.238+0000 7f86df001700 1 --2- 172.21.15.73:0/2342214611 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f86bc065ad0 0x7f86bc067f90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.238+0000 7f86df001700 1 --2- 172.21.15.73:0/2342214611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86d80b4ee0 0x7f86d8142b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.238+0000 7f86df001700 1 --2- 172.21.15.73:0/2342214611 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f86d80b3f10 0x7f86d81cec10 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.238+0000 7f86df001700 1 -- 172.21.15.73:0/2342214611 >> 172.21.15.73:0/2342214611 conn(0x7f86d80b8a10 msgr2=0x7f86d81458c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:46.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.238+0000 7f86df001700 1 -- 172.21.15.73:0/2342214611 shutdown_connections 2023-11-30T23:27:46.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.238+0000 7f86df001700 1 -- 172.21.15.73:0/2342214611 wait complete. 2023-11-30T23:27:46.245 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-11-30T23:27:46.256 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":497,"stamp":"2023-11-30T23:27:44.670372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":275982203,"num_objects":743,"num_object_clones":28,"num_object_copies":1486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":743,"num_whiteouts":15,"num_read":1184,"num_read_kb":3541,"num_write":155907,"num_write_kb":668809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":540,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307605,"ondisk_log_size":307605,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2753952,"kb_used_data":543520,"kb_used_omap":0,"kb_used_meta":2210368,"kb_avail":752220768,"statfs":{"total":773094113280,"available":770274066432,"internally_reserved":0,"allocated":556564480,"data_stored":553942070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2263416832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,1,1,10,9,24,13],"upper_bound":256},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2058097,"num_objects":6,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":3,"num_read":6,"num_read_kb":7,"num_write":131,"num_write_kb":2089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.274157"},"pg_stats":[{"pgid":"3.3f","version":"48'3481","reported_seq":2875,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.507965+0000","last_change":"2023-11-30T23:27:40.777020+0000","last_active":"2023-11-30T23:27:41.507965+0000","last_peered":"2023-11-30T23:27:41.507965+0000","last_clean":"2023-11-30T23:27:41.507965+0000","last_became_active":"2023-11-30T23:12:47.512980+0000","last_became_peered":"2023-11-30T23:12:47.512980+0000","last_unstale":"2023-11-30T23:27:41.507965+0000","last_undegraded":"2023-11-30T23:27:41.507965+0000","last_fullsized":"2023-11-30T23:27:41.507965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:18:44.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0061607720000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1134,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3e","version":"48'3347","reported_seq":2773,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.552577+0000","last_change":"2023-11-30T23:27:40.483369+0000","last_active":"2023-11-30T23:27:41.552577+0000","last_peered":"2023-11-30T23:27:41.552577+0000","last_clean":"2023-11-30T23:27:41.552577+0000","last_became_active":"2023-11-30T23:12:47.508771+0000","last_became_peered":"2023-11-30T23:12:47.508771+0000","last_unstale":"2023-11-30T23:27:41.552577+0000","last_undegraded":"2023-11-30T23:27:41.552577+0000","last_fullsized":"2023-11-30T23:27:41.552577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3347,"log_dups_size":0,"ondisk_log_size":3347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055178039999999998,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1093,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3d","version":"48'3513","reported_seq":2913,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.509222+0000","last_change":"2023-11-30T23:27:40.561105+0000","last_active":"2023-11-30T23:27:41.509222+0000","last_peered":"2023-11-30T23:27:41.509222+0000","last_clean":"2023-11-30T23:27:41.509222+0000","last_became_active":"2023-11-30T23:12:47.507829+0000","last_became_peered":"2023-11-30T23:12:47.507829+0000","last_unstale":"2023-11-30T23:27:41.509222+0000","last_undegraded":"2023-11-30T23:27:41.509222+0000","last_fullsized":"2023-11-30T23:27:41.509222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3513,"log_dups_size":0,"ondisk_log_size":3513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:39.696562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031269901000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3c","version":"48'3599","reported_seq":2961,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.540422+0000","last_change":"2023-11-30T23:27:40.523535+0000","last_active":"2023-11-30T23:27:41.540422+0000","last_peered":"2023-11-30T23:27:41.540422+0000","last_clean":"2023-11-30T23:27:41.540422+0000","last_became_active":"2023-11-30T23:12:47.522208+0000","last_became_peered":"2023-11-30T23:12:47.522208+0000","last_unstale":"2023-11-30T23:27:41.540422+0000","last_undegraded":"2023-11-30T23:27:41.540422+0000","last_fullsized":"2023-11-30T23:27:41.540422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3599,"log_dups_size":0,"ondisk_log_size":3599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020703408,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3b","version":"48'3346","reported_seq":2724,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.454983+0000","last_change":"2023-11-30T23:27:40.475732+0000","last_active":"2023-11-30T23:27:41.454983+0000","last_peered":"2023-11-30T23:27:41.454983+0000","last_clean":"2023-11-30T23:27:41.454983+0000","last_became_active":"2023-11-30T23:13:30.302763+0000","last_became_peered":"2023-11-30T23:13:30.302763+0000","last_unstale":"2023-11-30T23:27:41.454983+0000","last_undegraded":"2023-11-30T23:27:41.454983+0000","last_fullsized":"2023-11-30T23:27:41.454983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3346,"log_dups_size":0,"ondisk_log_size":3346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:50:13.635575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047963988999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3a","version":"48'3402","reported_seq":2815,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.564969+0000","last_change":"2023-11-30T23:27:40.521728+0000","last_active":"2023-11-30T23:27:41.564969+0000","last_peered":"2023-11-30T23:27:41.564969+0000","last_clean":"2023-11-30T23:27:41.564969+0000","last_became_active":"2023-11-30T23:12:47.513491+0000","last_became_peered":"2023-11-30T23:12:47.513491+0000","last_unstale":"2023-11-30T23:27:41.564969+0000","last_undegraded":"2023-11-30T23:27:41.564969+0000","last_fullsized":"2023-11-30T23:27:41.564969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:18:44.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019296939999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.39","version":"48'3534","reported_seq":2940,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.521776+0000","last_change":"2023-11-30T23:27:40.773622+0000","last_active":"2023-11-30T23:27:41.521776+0000","last_peered":"2023-11-30T23:27:41.521776+0000","last_clean":"2023-11-30T23:27:41.521776+0000","last_became_active":"2023-11-30T23:12:47.507747+0000","last_became_peered":"2023-11-30T23:12:47.507747+0000","last_unstale":"2023-11-30T23:27:41.521776+0000","last_undegraded":"2023-11-30T23:27:41.521776+0000","last_fullsized":"2023-11-30T23:27:41.521776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3534,"log_dups_size":0,"ondisk_log_size":3534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:27.789422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0077627249999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.38","version":"48'3400","reported_seq":2784,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.559582+0000","last_change":"2023-11-30T23:27:40.523065+0000","last_active":"2023-11-30T23:27:41.559582+0000","last_peered":"2023-11-30T23:27:41.559582+0000","last_clean":"2023-11-30T23:27:41.559582+0000","last_became_active":"2023-11-30T23:12:47.523430+0000","last_became_peered":"2023-11-30T23:12:47.523430+0000","last_unstale":"2023-11-30T23:27:41.559582+0000","last_undegraded":"2023-11-30T23:27:41.559582+0000","last_fullsized":"2023-11-30T23:27:41.559582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3400,"log_dups_size":0,"ondisk_log_size":3400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:26:33.640383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023650336000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.37","version":"48'3724","reported_seq":3059,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.524998+0000","last_change":"2023-11-30T23:27:40.778901+0000","last_active":"2023-11-30T23:27:41.524998+0000","last_peered":"2023-11-30T23:27:41.524998+0000","last_clean":"2023-11-30T23:27:41.524998+0000","last_became_active":"2023-11-30T23:12:47.521393+0000","last_became_peered":"2023-11-30T23:12:47.521393+0000","last_unstale":"2023-11-30T23:27:41.524998+0000","last_undegraded":"2023-11-30T23:27:41.524998+0000","last_fullsized":"2023-11-30T23:27:41.524998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3724,"log_dups_size":0,"ondisk_log_size":3724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:23:17.254251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078674580000000008,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1228,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.36","version":"48'3647","reported_seq":3113,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.566188+0000","last_change":"2023-11-30T23:27:40.786256+0000","last_active":"2023-11-30T23:27:41.566188+0000","last_peered":"2023-11-30T23:27:41.566188+0000","last_clean":"2023-11-30T23:27:41.566188+0000","last_became_active":"2023-11-30T23:12:47.522618+0000","last_became_peered":"2023-11-30T23:12:47.522618+0000","last_unstale":"2023-11-30T23:27:41.566188+0000","last_undegraded":"2023-11-30T23:27:41.566188+0000","last_fullsized":"2023-11-30T23:27:41.566188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3647,"log_dups_size":0,"ondisk_log_size":3647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016421781999999999,"stat_sum":{"num_bytes":4110,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":1106,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.35","version":"48'3243","reported_seq":2730,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.542802+0000","last_change":"2023-11-30T23:27:40.786282+0000","last_active":"2023-11-30T23:27:41.542802+0000","last_peered":"2023-11-30T23:27:41.542802+0000","last_clean":"2023-11-30T23:27:41.542802+0000","last_became_active":"2023-11-30T23:13:30.304972+0000","last_became_peered":"2023-11-30T23:13:30.304972+0000","last_unstale":"2023-11-30T23:27:41.542802+0000","last_undegraded":"2023-11-30T23:27:41.542802+0000","last_fullsized":"2023-11-30T23:27:41.542802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3243,"log_dups_size":0,"ondisk_log_size":3243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:28:50.030806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016353854000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.34","version":"48'3479","reported_seq":2853,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.605834+0000","last_change":"2023-11-30T23:27:40.778402+0000","last_active":"2023-11-30T23:27:41.605834+0000","last_peered":"2023-11-30T23:27:41.605834+0000","last_clean":"2023-11-30T23:27:41.605834+0000","last_became_active":"2023-11-30T23:12:47.513401+0000","last_became_peered":"2023-11-30T23:12:47.513401+0000","last_unstale":"2023-11-30T23:27:41.605834+0000","last_undegraded":"2023-11-30T23:27:41.605834+0000","last_fullsized":"2023-11-30T23:27:41.605834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3479,"log_dups_size":0,"ondisk_log_size":3479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:22.086661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011359997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.33","version":"48'3375","reported_seq":2824,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.507105+0000","last_change":"2023-11-30T23:27:40.524064+0000","last_active":"2023-11-30T23:27:41.507105+0000","last_peered":"2023-11-30T23:27:41.507105+0000","last_clean":"2023-11-30T23:27:41.507105+0000","last_became_active":"2023-11-30T23:12:47.513714+0000","last_became_peered":"2023-11-30T23:12:47.513714+0000","last_unstale":"2023-11-30T23:27:41.507105+0000","last_undegraded":"2023-11-30T23:27:41.507105+0000","last_fullsized":"2023-11-30T23:27:41.507105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3375,"log_dups_size":0,"ondisk_log_size":3375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:20:31.102899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024370613999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1066,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.32","version":"48'3643","reported_seq":3000,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.495022+0000","last_change":"2023-11-30T23:27:40.553372+0000","last_active":"2023-11-30T23:27:41.495022+0000","last_peered":"2023-11-30T23:27:41.495022+0000","last_clean":"2023-11-30T23:27:41.495022+0000","last_became_active":"2023-11-30T23:12:47.506967+0000","last_became_peered":"2023-11-30T23:12:47.506967+0000","last_unstale":"2023-11-30T23:27:41.495022+0000","last_undegraded":"2023-11-30T23:27:41.495022+0000","last_fullsized":"2023-11-30T23:27:41.495022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3643,"log_dups_size":0,"ondisk_log_size":3643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025050587999999999,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.31","version":"48'3636","reported_seq":2966,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.543572+0000","last_change":"2023-11-30T23:27:40.490577+0000","last_active":"2023-11-30T23:27:41.543572+0000","last_peered":"2023-11-30T23:27:41.543572+0000","last_clean":"2023-11-30T23:27:41.543572+0000","last_became_active":"2023-11-30T23:12:47.513018+0000","last_became_peered":"2023-11-30T23:12:47.513018+0000","last_unstale":"2023-11-30T23:27:41.543572+0000","last_undegraded":"2023-11-30T23:27:41.543572+0000","last_fullsized":"2023-11-30T23:27:41.543572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3636,"log_dups_size":0,"ondisk_log_size":3636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059143527000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1251,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.30","version":"48'3670","reported_seq":3017,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.490898+0000","last_change":"2023-11-30T23:27:40.518027+0000","last_active":"2023-11-30T23:27:41.490898+0000","last_peered":"2023-11-30T23:27:41.490898+0000","last_clean":"2023-11-30T23:27:41.490898+0000","last_became_active":"2023-11-30T23:12:47.520518+0000","last_became_peered":"2023-11-30T23:12:47.520518+0000","last_unstale":"2023-11-30T23:27:41.490898+0000","last_undegraded":"2023-11-30T23:27:41.490898+0000","last_fullsized":"2023-11-30T23:27:41.490898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3670,"log_dups_size":0,"ondisk_log_size":3670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:27.789422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016206259000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2f","version":"48'3892","reported_seq":3186,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.543071+0000","last_change":"2023-11-30T23:27:40.522656+0000","last_active":"2023-11-30T23:27:41.543071+0000","last_peered":"2023-11-30T23:27:41.543071+0000","last_clean":"2023-11-30T23:27:41.543071+0000","last_became_active":"2023-11-30T23:12:47.516382+0000","last_became_peered":"2023-11-30T23:12:47.516382+0000","last_unstale":"2023-11-30T23:27:41.543071+0000","last_undegraded":"2023-11-30T23:27:41.543071+0000","last_fullsized":"2023-11-30T23:27:41.543071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:54:46.925262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020102808999999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2e","version":"48'3336","reported_seq":2814,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.542236+0000","last_change":"2023-11-30T23:27:40.437357+0000","last_active":"2023-11-30T23:27:41.542236+0000","last_peered":"2023-11-30T23:27:41.542236+0000","last_clean":"2023-11-30T23:27:41.542236+0000","last_became_active":"2023-11-30T23:12:47.509340+0000","last_became_peered":"2023-11-30T23:12:47.509340+0000","last_unstale":"2023-11-30T23:27:41.542236+0000","last_undegraded":"2023-11-30T23:27:41.542236+0000","last_fullsized":"2023-11-30T23:27:41.542236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3336,"log_dups_size":0,"ondisk_log_size":3336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:29.167074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0085862969999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1061,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2d","version":"48'3630","reported_seq":2999,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.551783+0000","last_change":"2023-11-30T23:27:40.776746+0000","last_active":"2023-11-30T23:27:41.551783+0000","last_peered":"2023-11-30T23:27:41.551783+0000","last_clean":"2023-11-30T23:27:41.551783+0000","last_became_active":"2023-11-30T23:12:47.506733+0000","last_became_peered":"2023-11-30T23:12:47.506733+0000","last_unstale":"2023-11-30T23:27:41.551783+0000","last_undegraded":"2023-11-30T23:27:41.551783+0000","last_fullsized":"2023-11-30T23:27:41.551783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3630,"log_dups_size":0,"ondisk_log_size":3630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010198370999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2c","version":"48'3600","reported_seq":2958,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.532354+0000","last_change":"2023-11-30T23:27:40.784471+0000","last_active":"2023-11-30T23:27:41.532354+0000","last_peered":"2023-11-30T23:27:41.532354+0000","last_clean":"2023-11-30T23:27:41.532354+0000","last_became_active":"2023-11-30T23:12:47.518819+0000","last_became_peered":"2023-11-30T23:12:47.518819+0000","last_unstale":"2023-11-30T23:27:41.532354+0000","last_undegraded":"2023-11-30T23:27:41.532354+0000","last_fullsized":"2023-11-30T23:27:41.532354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014700833,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2b","version":"48'3683","reported_seq":3063,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.589510+0000","last_change":"2023-11-30T23:27:40.567066+0000","last_active":"2023-11-30T23:27:41.589510+0000","last_peered":"2023-11-30T23:27:41.589510+0000","last_clean":"2023-11-30T23:27:41.589510+0000","last_became_active":"2023-11-30T23:12:47.514223+0000","last_became_peered":"2023-11-30T23:12:47.514223+0000","last_unstale":"2023-11-30T23:27:41.589510+0000","last_undegraded":"2023-11-30T23:27:41.589510+0000","last_fullsized":"2023-11-30T23:27:41.589510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3683,"log_dups_size":0,"ondisk_log_size":3683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:34:32.232378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036942162000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2a","version":"48'4029","reported_seq":3322,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.555237+0000","last_change":"2023-11-30T23:27:40.526135+0000","last_active":"2023-11-30T23:27:41.555237+0000","last_peered":"2023-11-30T23:27:41.555237+0000","last_clean":"2023-11-30T23:27:41.555237+0000","last_became_active":"2023-11-30T23:12:47.520228+0000","last_became_peered":"2023-11-30T23:12:47.520228+0000","last_unstale":"2023-11-30T23:27:41.555237+0000","last_undegraded":"2023-11-30T23:27:41.555237+0000","last_fullsized":"2023-11-30T23:27:41.555237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":4029,"log_dups_size":0,"ondisk_log_size":4029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:26:06.870586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023056817,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1244,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.29","version":"48'3705","reported_seq":3079,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.556013+0000","last_change":"2023-11-30T23:27:40.526288+0000","last_active":"2023-11-30T23:27:41.556013+0000","last_peered":"2023-11-30T23:27:41.556013+0000","last_clean":"2023-11-30T23:27:41.556013+0000","last_became_active":"2023-11-30T23:12:47.515247+0000","last_became_peered":"2023-11-30T23:12:47.515247+0000","last_unstale":"2023-11-30T23:27:41.556013+0000","last_undegraded":"2023-11-30T23:27:41.556013+0000","last_fullsized":"2023-11-30T23:27:41.556013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3705,"log_dups_size":0,"ondisk_log_size":3705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026511877,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.28","version":"48'3602","reported_seq":2953,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.491995+0000","last_change":"2023-11-30T23:27:40.526691+0000","last_active":"2023-11-30T23:27:41.491995+0000","last_peered":"2023-11-30T23:27:41.491995+0000","last_clean":"2023-11-30T23:27:41.491995+0000","last_became_active":"2023-11-30T23:12:47.511097+0000","last_became_peered":"2023-11-30T23:12:47.511097+0000","last_unstale":"2023-11-30T23:27:41.491995+0000","last_undegraded":"2023-11-30T23:27:41.491995+0000","last_fullsized":"2023-11-30T23:27:41.491995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023833039,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.27","version":"48'3199","reported_seq":2626,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.508825+0000","last_change":"2023-11-30T23:27:40.532323+0000","last_active":"2023-11-30T23:27:41.508825+0000","last_peered":"2023-11-30T23:27:41.508825+0000","last_clean":"2023-11-30T23:27:41.508825+0000","last_became_active":"2023-11-30T23:12:47.510404+0000","last_became_peered":"2023-11-30T23:12:47.510404+0000","last_unstale":"2023-11-30T23:27:41.508825+0000","last_undegraded":"2023-11-30T23:27:41.508825+0000","last_fullsized":"2023-11-30T23:27:41.508825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3199,"log_dups_size":0,"ondisk_log_size":3199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031984205000000002,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.26","version":"48'3855","reported_seq":3185,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.553421+0000","last_change":"2023-11-30T23:27:40.788046+0000","last_active":"2023-11-30T23:27:41.553421+0000","last_peered":"2023-11-30T23:27:41.553421+0000","last_clean":"2023-11-30T23:27:41.553421+0000","last_became_active":"2023-11-30T23:12:47.516539+0000","last_became_peered":"2023-11-30T23:12:47.516539+0000","last_unstale":"2023-11-30T23:27:41.553421+0000","last_undegraded":"2023-11-30T23:27:41.553421+0000","last_fullsized":"2023-11-30T23:27:41.553421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3855,"log_dups_size":0,"ondisk_log_size":3855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018080019999999999,"stat_sum":{"num_bytes":4105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.25","version":"48'3361","reported_seq":2773,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.550930+0000","last_change":"2023-11-30T23:27:40.486640+0000","last_active":"2023-11-30T23:27:41.550930+0000","last_peered":"2023-11-30T23:27:41.550930+0000","last_clean":"2023-11-30T23:27:41.550930+0000","last_became_active":"2023-11-30T23:12:47.506284+0000","last_became_peered":"2023-11-30T23:12:47.506284+0000","last_unstale":"2023-11-30T23:27:41.550930+0000","last_undegraded":"2023-11-30T23:27:41.550930+0000","last_fullsized":"2023-11-30T23:27:41.550930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3361,"log_dups_size":0,"ondisk_log_size":3361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058342590999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.24","version":"48'3356","reported_seq":2745,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.586450+0000","last_change":"2023-11-30T23:27:40.535487+0000","last_active":"2023-11-30T23:27:41.586450+0000","last_peered":"2023-11-30T23:27:41.586450+0000","last_clean":"2023-11-30T23:27:41.586450+0000","last_became_active":"2023-11-30T23:12:47.511800+0000","last_became_peered":"2023-11-30T23:12:47.511800+0000","last_unstale":"2023-11-30T23:27:41.586450+0000","last_undegraded":"2023-11-30T23:27:41.586450+0000","last_fullsized":"2023-11-30T23:27:41.586450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3356,"log_dups_size":0,"ondisk_log_size":3356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034899355,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1130,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.23","version":"48'3593","reported_seq":3000,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.582018+0000","last_change":"2023-11-30T23:27:40.562740+0000","last_active":"2023-11-30T23:27:41.582018+0000","last_peered":"2023-11-30T23:27:41.582018+0000","last_clean":"2023-11-30T23:27:41.582018+0000","last_became_active":"2023-11-30T23:12:47.512978+0000","last_became_peered":"2023-11-30T23:12:47.512978+0000","last_unstale":"2023-11-30T23:27:41.582018+0000","last_undegraded":"2023-11-30T23:27:41.582018+0000","last_fullsized":"2023-11-30T23:27:41.582018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3593,"log_dups_size":0,"ondisk_log_size":3593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032442869999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1122,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.22","version":"48'3350","reported_seq":2778,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.539520+0000","last_change":"2023-11-30T23:27:40.524098+0000","last_active":"2023-11-30T23:27:41.539520+0000","last_peered":"2023-11-30T23:27:41.539520+0000","last_clean":"2023-11-30T23:27:41.539520+0000","last_became_active":"2023-11-30T23:12:47.511699+0000","last_became_peered":"2023-11-30T23:12:47.511699+0000","last_unstale":"2023-11-30T23:27:41.539520+0000","last_undegraded":"2023-11-30T23:27:41.539520+0000","last_fullsized":"2023-11-30T23:27:41.539520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3350,"log_dups_size":0,"ondisk_log_size":3350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021133078,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.21","version":"48'4043","reported_seq":3292,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.508821+0000","last_change":"2023-11-30T23:27:40.435514+0000","last_active":"2023-11-30T23:27:41.508821+0000","last_peered":"2023-11-30T23:27:41.508821+0000","last_clean":"2023-11-30T23:27:41.508821+0000","last_became_active":"2023-11-30T23:12:47.521604+0000","last_became_peered":"2023-11-30T23:12:47.521604+0000","last_unstale":"2023-11-30T23:27:41.508821+0000","last_undegraded":"2023-11-30T23:27:41.508821+0000","last_fullsized":"2023-11-30T23:27:41.508821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":4043,"log_dups_size":0,"ondisk_log_size":4043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:02.220181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081020610000000007,"stat_sum":{"num_bytes":4121,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1336,"num_write_kb":721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.20","version":"48'3908","reported_seq":3229,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.519616+0000","last_change":"2023-11-30T23:27:40.784516+0000","last_active":"2023-11-30T23:27:41.519616+0000","last_peered":"2023-11-30T23:27:41.519616+0000","last_clean":"2023-11-30T23:27:41.519616+0000","last_became_active":"2023-11-30T23:12:47.517283+0000","last_became_peered":"2023-11-30T23:12:47.517283+0000","last_unstale":"2023-11-30T23:27:41.519616+0000","last_undegraded":"2023-11-30T23:27:41.519616+0000","last_fullsized":"2023-11-30T23:27:41.519616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3908,"log_dups_size":0,"ondisk_log_size":3908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016665117,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1a","version":"48'3480","reported_seq":2876,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.528598+0000","last_change":"2023-11-30T23:27:40.776963+0000","last_active":"2023-11-30T23:27:41.528598+0000","last_peered":"2023-11-30T23:27:41.528598+0000","last_clean":"2023-11-30T23:27:41.528598+0000","last_became_active":"2023-11-30T23:12:47.508725+0000","last_became_peered":"2023-11-30T23:12:47.508725+0000","last_unstale":"2023-11-30T23:27:41.528598+0000","last_undegraded":"2023-11-30T23:27:41.528598+0000","last_fullsized":"2023-11-30T23:27:41.528598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3480,"log_dups_size":0,"ondisk_log_size":3480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:54.893320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010267352,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1134,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1b","version":"43'3981","reported_seq":4025,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.721302+0000","last_change":"2023-11-30T23:12:47.139071+0000","last_active":"2023-11-30T23:27:39.721302+0000","last_peered":"2023-11-30T23:27:39.721302+0000","last_clean":"2023-11-30T23:27:39.721302+0000","last_became_active":"2023-11-30T23:12:47.138768+0000","last_became_peered":"2023-11-30T23:12:47.138768+0000","last_unstale":"2023-11-30T23:27:39.721302+0000","last_undegraded":"2023-11-30T23:27:39.721302+0000","last_fullsized":"2023-11-30T23:27:39.721302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3981,"log_dups_size":0,"ondisk_log_size":3981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":4054,"num_write_kb":19067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"48'3595","reported_seq":2987,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.585088+0000","last_change":"2023-11-30T23:27:40.568024+0000","last_active":"2023-11-30T23:27:41.585088+0000","last_peered":"2023-11-30T23:27:41.585088+0000","last_clean":"2023-11-30T23:27:41.585088+0000","last_became_active":"2023-11-30T23:12:47.516214+0000","last_became_peered":"2023-11-30T23:12:47.516214+0000","last_unstale":"2023-11-30T23:27:41.585088+0000","last_undegraded":"2023-11-30T23:27:41.585088+0000","last_fullsized":"2023-11-30T23:27:41.585088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037604525,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1a","version":"48'4545","reported_seq":4589,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.794216+0000","last_change":"2023-11-30T23:12:47.130416+0000","last_active":"2023-11-30T23:27:41.794216+0000","last_peered":"2023-11-30T23:27:41.794216+0000","last_clean":"2023-11-30T23:27:41.794216+0000","last_became_active":"2023-11-30T23:12:47.129771+0000","last_became_peered":"2023-11-30T23:12:47.129771+0000","last_unstale":"2023-11-30T23:27:41.794216+0000","last_undegraded":"2023-11-30T23:27:41.794216+0000","last_fullsized":"2023-11-30T23:27:41.794216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4545,"log_dups_size":0,"ondisk_log_size":4545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7852113,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":4619,"num_write_kb":33825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"41'851","reported_seq":896,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.716599+0000","last_change":"2023-11-30T23:12:47.133733+0000","last_active":"2023-11-30T23:27:39.716599+0000","last_peered":"2023-11-30T23:27:39.716599+0000","last_clean":"2023-11-30T23:27:39.716599+0000","last_became_active":"2023-11-30T23:12:47.133440+0000","last_became_peered":"2023-11-30T23:12:47.133440+0000","last_unstale":"2023-11-30T23:27:39.716599+0000","last_undegraded":"2023-11-30T23:27:39.716599+0000","last_fullsized":"2023-11-30T23:27:39.716599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:48.913175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":928,"num_write_kb":12986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"48'3961","reported_seq":3213,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.571914+0000","last_change":"2023-11-30T23:27:40.521787+0000","last_active":"2023-11-30T23:27:41.571914+0000","last_peered":"2023-11-30T23:27:41.571914+0000","last_clean":"2023-11-30T23:27:41.571914+0000","last_became_active":"2023-11-30T23:12:47.507617+0000","last_became_peered":"2023-11-30T23:12:47.507617+0000","last_unstale":"2023-11-30T23:27:41.571914+0000","last_undegraded":"2023-11-30T23:27:41.571914+0000","last_fullsized":"2023-11-30T23:27:41.571914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3961,"log_dups_size":0,"ondisk_log_size":3961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:08:47.117163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022313091,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1298,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.18","version":"42'3803","reported_seq":3848,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.379869+0000","last_change":"2023-11-30T23:12:47.132638+0000","last_active":"2023-11-30T23:27:40.379869+0000","last_peered":"2023-11-30T23:27:40.379869+0000","last_clean":"2023-11-30T23:27:40.379869+0000","last_became_active":"2023-11-30T23:12:47.132351+0000","last_became_peered":"2023-11-30T23:12:47.132351+0000","last_unstale":"2023-11-30T23:27:40.379869+0000","last_undegraded":"2023-11-30T23:27:40.379869+0000","last_fullsized":"2023-11-30T23:27:40.379869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3803,"log_dups_size":0,"ondisk_log_size":3803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":3859,"num_write_kb":38490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"48'3665","reported_seq":3062,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.554274+0000","last_change":"2023-11-30T23:27:40.479741+0000","last_active":"2023-11-30T23:27:41.554274+0000","last_peered":"2023-11-30T23:27:41.554274+0000","last_clean":"2023-11-30T23:27:41.554274+0000","last_became_active":"2023-11-30T23:12:47.506082+0000","last_became_peered":"2023-11-30T23:12:47.506082+0000","last_unstale":"2023-11-30T23:27:41.554274+0000","last_undegraded":"2023-11-30T23:27:41.554274+0000","last_fullsized":"2023-11-30T23:27:41.554274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052118631999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.17","version":"43'1096","reported_seq":1141,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.687772+0000","last_change":"2023-11-30T23:12:47.139722+0000","last_active":"2023-11-30T23:27:39.687772+0000","last_peered":"2023-11-30T23:27:39.687772+0000","last_clean":"2023-11-30T23:27:39.687772+0000","last_became_active":"2023-11-30T23:12:47.139400+0000","last_became_peered":"2023-11-30T23:12:47.139400+0000","last_unstale":"2023-11-30T23:27:39.687772+0000","last_undegraded":"2023-11-30T23:27:39.687772+0000","last_fullsized":"2023-11-30T23:27:39.687772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1096,"log_dups_size":0,"ondisk_log_size":1096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":1152,"num_write_kb":13161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"48'3679","reported_seq":3043,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.532898+0000","last_change":"2023-11-30T23:27:40.435297+0000","last_active":"2023-11-30T23:27:41.532898+0000","last_peered":"2023-11-30T23:27:41.532898+0000","last_clean":"2023-11-30T23:27:41.532898+0000","last_became_active":"2023-11-30T23:13:30.596915+0000","last_became_peered":"2023-11-30T23:13:30.596915+0000","last_unstale":"2023-11-30T23:27:41.532898+0000","last_undegraded":"2023-11-30T23:27:41.532898+0000","last_fullsized":"2023-11-30T23:27:41.532898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3679,"log_dups_size":0,"ondisk_log_size":3679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:51:12.828715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066900809999999996,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.16","version":"48'1872","reported_seq":1917,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.502065+0000","last_change":"2023-11-30T23:12:47.139328+0000","last_active":"2023-11-30T23:27:40.502065+0000","last_peered":"2023-11-30T23:27:40.502065+0000","last_clean":"2023-11-30T23:27:40.502065+0000","last_became_active":"2023-11-30T23:12:47.139047+0000","last_became_peered":"2023-11-30T23:12:47.139047+0000","last_unstale":"2023-11-30T23:27:40.502065+0000","last_undegraded":"2023-11-30T23:27:40.502065+0000","last_fullsized":"2023-11-30T23:27:40.502065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1872,"log_dups_size":0,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":1932,"num_write_kb":25642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"48'3570","reported_seq":2951,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.513410+0000","last_change":"2023-11-30T23:27:40.558523+0000","last_active":"2023-11-30T23:27:41.513410+0000","last_peered":"2023-11-30T23:27:41.513410+0000","last_clean":"2023-11-30T23:27:41.513410+0000","last_became_active":"2023-11-30T23:12:47.522711+0000","last_became_peered":"2023-11-30T23:12:47.522711+0000","last_unstale":"2023-11-30T23:27:41.513410+0000","last_undegraded":"2023-11-30T23:27:41.513410+0000","last_fullsized":"2023-11-30T23:27:41.513410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:19:43.387626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.028725985999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.15","version":"48'3057","reported_seq":3102,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.616806+0000","last_change":"2023-11-30T23:12:47.140794+0000","last_active":"2023-11-30T23:27:41.616806+0000","last_peered":"2023-11-30T23:27:41.616806+0000","last_clean":"2023-11-30T23:27:41.616806+0000","last_became_active":"2023-11-30T23:12:47.140531+0000","last_became_peered":"2023-11-30T23:12:47.140531+0000","last_unstale":"2023-11-30T23:27:41.616806+0000","last_undegraded":"2023-11-30T23:27:41.616806+0000","last_fullsized":"2023-11-30T23:27:41.616806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3057,"log_dups_size":0,"ondisk_log_size":3057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:53.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":3128,"num_write_kb":22065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"48'3770","reported_seq":3130,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.604302+0000","last_change":"2023-11-30T23:27:40.777802+0000","last_active":"2023-11-30T23:27:41.604302+0000","last_peered":"2023-11-30T23:27:41.604302+0000","last_clean":"2023-11-30T23:27:41.604302+0000","last_became_active":"2023-11-30T23:12:47.513983+0000","last_became_peered":"2023-11-30T23:12:47.513983+0000","last_unstale":"2023-11-30T23:27:41.604302+0000","last_undegraded":"2023-11-30T23:27:41.604302+0000","last_fullsized":"2023-11-30T23:27:41.604302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3770,"log_dups_size":0,"ondisk_log_size":3770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:39.696562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010376995,"stat_sum":{"num_bytes":9,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1166,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.14","version":"48'3844","reported_seq":3889,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.769905+0000","last_change":"2023-11-30T23:12:47.140168+0000","last_active":"2023-11-30T23:27:40.769905+0000","last_peered":"2023-11-30T23:27:40.769905+0000","last_clean":"2023-11-30T23:27:40.769905+0000","last_became_active":"2023-11-30T23:12:47.139799+0000","last_became_peered":"2023-11-30T23:12:47.139799+0000","last_unstale":"2023-11-30T23:27:40.769905+0000","last_undegraded":"2023-11-30T23:27:40.769905+0000","last_fullsized":"2023-11-30T23:27:40.769905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3844,"log_dups_size":0,"ondisk_log_size":3844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":3910,"num_write_kb":30388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"48'3523","reported_seq":2900,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.550105+0000","last_change":"2023-11-30T23:27:40.772832+0000","last_active":"2023-11-30T23:27:41.550105+0000","last_peered":"2023-11-30T23:27:41.550105+0000","last_clean":"2023-11-30T23:27:41.550105+0000","last_became_active":"2023-11-30T23:12:47.503333+0000","last_became_peered":"2023-11-30T23:12:47.503333+0000","last_unstale":"2023-11-30T23:27:41.550105+0000","last_undegraded":"2023-11-30T23:27:41.550105+0000","last_fullsized":"2023-11-30T23:27:41.550105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3523,"log_dups_size":0,"ondisk_log_size":3523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070303589999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.13","version":"41'1920","reported_seq":1965,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.521393+0000","last_change":"2023-11-30T23:12:47.136931+0000","last_active":"2023-11-30T23:27:39.521393+0000","last_peered":"2023-11-30T23:27:39.521393+0000","last_clean":"2023-11-30T23:27:39.521393+0000","last_became_active":"2023-11-30T23:12:47.136620+0000","last_became_peered":"2023-11-30T23:12:47.136620+0000","last_unstale":"2023-11-30T23:27:39.521393+0000","last_undegraded":"2023-11-30T23:27:39.521393+0000","last_fullsized":"2023-11-30T23:27:39.521393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1920,"log_dups_size":0,"ondisk_log_size":1920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:22:43.069951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":2012,"num_write_kb":17264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"48'3603","reported_seq":2975,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.494947+0000","last_change":"2023-11-30T23:27:40.557057+0000","last_active":"2023-11-30T23:27:41.494947+0000","last_peered":"2023-11-30T23:27:41.494947+0000","last_clean":"2023-11-30T23:27:41.494947+0000","last_became_active":"2023-11-30T23:12:47.503294+0000","last_became_peered":"2023-11-30T23:12:47.503294+0000","last_unstale":"2023-11-30T23:27:41.494947+0000","last_undegraded":"2023-11-30T23:27:41.494947+0000","last_fullsized":"2023-11-30T23:27:41.494947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3603,"log_dups_size":0,"ondisk_log_size":3603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.028538382000000001,"stat_sum":{"num_bytes":8235,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1203,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.12","version":"44'82","reported_seq":127,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.377591+0000","last_change":"2023-11-30T23:12:47.140575+0000","last_active":"2023-11-30T23:27:40.377591+0000","last_peered":"2023-11-30T23:27:40.377591+0000","last_clean":"2023-11-30T23:27:40.377591+0000","last_became_active":"2023-11-30T23:12:47.140125+0000","last_became_peered":"2023-11-30T23:12:47.140125+0000","last_unstale":"2023-11-30T23:27:40.377591+0000","last_undegraded":"2023-11-30T23:27:40.377591+0000","last_fullsized":"2023-11-30T23:27:40.377591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":140,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"48'3957","reported_seq":3285,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.497842+0000","last_change":"2023-11-30T23:27:40.777472+0000","last_active":"2023-11-30T23:27:41.497842+0000","last_peered":"2023-11-30T23:27:41.497842+0000","last_clean":"2023-11-30T23:27:41.497842+0000","last_became_active":"2023-11-30T23:12:47.515427+0000","last_became_peered":"2023-11-30T23:12:47.515427+0000","last_unstale":"2023-11-30T23:27:41.497842+0000","last_undegraded":"2023-11-30T23:27:41.497842+0000","last_fullsized":"2023-11-30T23:27:41.497842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3957,"log_dups_size":0,"ondisk_log_size":3957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:26:06.870586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066010289999999996,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.11","version":"41'1117","reported_seq":1162,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.686919+0000","last_change":"2023-11-30T23:12:47.129492+0000","last_active":"2023-11-30T23:27:39.686919+0000","last_peered":"2023-11-30T23:27:39.686919+0000","last_clean":"2023-11-30T23:27:39.686919+0000","last_became_active":"2023-11-30T23:12:47.129180+0000","last_became_peered":"2023-11-30T23:12:47.129180+0000","last_unstale":"2023-11-30T23:27:39.686919+0000","last_undegraded":"2023-11-30T23:27:39.686919+0000","last_fullsized":"2023-11-30T23:27:39.686919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1117,"log_dups_size":0,"ondisk_log_size":1117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":1162,"num_write_kb":9042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"48'3496","reported_seq":2885,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.525719+0000","last_change":"2023-11-30T23:27:40.782626+0000","last_active":"2023-11-30T23:27:41.525719+0000","last_peered":"2023-11-30T23:27:41.525719+0000","last_clean":"2023-11-30T23:27:41.525719+0000","last_became_active":"2023-11-30T23:12:47.516980+0000","last_became_peered":"2023-11-30T23:12:47.516980+0000","last_unstale":"2023-11-30T23:27:41.525719+0000","last_undegraded":"2023-11-30T23:27:41.525719+0000","last_fullsized":"2023-11-30T23:27:41.525719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3496,"log_dups_size":0,"ondisk_log_size":3496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014912678,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.10","version":"44'1300","reported_seq":1345,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.414975+0000","last_change":"2023-11-30T23:12:47.129703+0000","last_active":"2023-11-30T23:27:39.414975+0000","last_peered":"2023-11-30T23:27:39.414975+0000","last_clean":"2023-11-30T23:27:39.414975+0000","last_became_active":"2023-11-30T23:12:47.129349+0000","last_became_peered":"2023-11-30T23:12:47.129349+0000","last_unstale":"2023-11-30T23:27:39.414975+0000","last_undegraded":"2023-11-30T23:27:39.414975+0000","last_fullsized":"2023-11-30T23:27:39.414975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1300,"log_dups_size":0,"ondisk_log_size":1300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":1371,"num_write_kb":13381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"48'3743","reported_seq":3063,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.519400+0000","last_change":"2023-11-30T23:27:40.775036+0000","last_active":"2023-11-30T23:27:41.519400+0000","last_peered":"2023-11-30T23:27:41.519400+0000","last_clean":"2023-11-30T23:27:41.519400+0000","last_became_active":"2023-11-30T23:12:47.514140+0000","last_became_peered":"2023-11-30T23:12:47.514140+0000","last_unstale":"2023-11-30T23:27:41.519400+0000","last_undegraded":"2023-11-30T23:27:41.519400+0000","last_fullsized":"2023-11-30T23:27:41.519400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3743,"log_dups_size":0,"ondisk_log_size":3743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:54:46.925262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0087768900000000007,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1241,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.f","version":"48'1098","reported_seq":1143,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.768358+0000","last_change":"2023-11-30T23:12:47.136924+0000","last_active":"2023-11-30T23:27:40.768358+0000","last_peered":"2023-11-30T23:27:40.768358+0000","last_clean":"2023-11-30T23:27:40.768358+0000","last_became_active":"2023-11-30T23:12:47.136631+0000","last_became_peered":"2023-11-30T23:12:47.136631+0000","last_unstale":"2023-11-30T23:27:40.768358+0000","last_undegraded":"2023-11-30T23:27:40.768358+0000","last_fullsized":"2023-11-30T23:27:40.768358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1098,"log_dups_size":0,"ondisk_log_size":1098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:22:48.835054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":1176,"num_write_kb":13385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"48'3434","reported_seq":2834,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.454960+0000","last_change":"2023-11-30T23:27:40.773928+0000","last_active":"2023-11-30T23:27:41.454960+0000","last_peered":"2023-11-30T23:27:41.454960+0000","last_clean":"2023-11-30T23:27:41.454960+0000","last_became_active":"2023-11-30T23:12:47.514053+0000","last_became_peered":"2023-11-30T23:12:47.514053+0000","last_unstale":"2023-11-30T23:27:41.454960+0000","last_undegraded":"2023-11-30T23:27:41.454960+0000","last_fullsized":"2023-11-30T23:27:41.454960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0080231629999999998,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.e","version":"48'2035","reported_seq":2080,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.429021+0000","last_change":"2023-11-30T23:12:47.138008+0000","last_active":"2023-11-30T23:27:40.429021+0000","last_peered":"2023-11-30T23:27:40.429021+0000","last_clean":"2023-11-30T23:27:40.429021+0000","last_became_active":"2023-11-30T23:12:47.137695+0000","last_became_peered":"2023-11-30T23:12:47.137695+0000","last_unstale":"2023-11-30T23:27:40.429021+0000","last_undegraded":"2023-11-30T23:27:40.429021+0000","last_fullsized":"2023-11-30T23:27:40.429021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":2104,"num_write_kb":13092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"48'3567","reported_seq":2928,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.459047+0000","last_change":"2023-11-30T23:27:40.778859+0000","last_active":"2023-11-30T23:27:41.459047+0000","last_peered":"2023-11-30T23:27:41.459047+0000","last_clean":"2023-11-30T23:27:41.459047+0000","last_became_active":"2023-11-30T23:12:47.514822+0000","last_became_peered":"2023-11-30T23:12:47.514822+0000","last_unstale":"2023-11-30T23:27:41.459047+0000","last_undegraded":"2023-11-30T23:27:41.459047+0000","last_fullsized":"2023-11-30T23:27:41.459047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3567,"log_dups_size":0,"ondisk_log_size":3567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:02:36.020857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076646960000000004,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.d","version":"43'4595","reported_seq":4640,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.993417+0000","last_change":"2023-11-30T23:12:47.129184+0000","last_active":"2023-11-30T23:27:39.993417+0000","last_peered":"2023-11-30T23:27:39.993417+0000","last_clean":"2023-11-30T23:27:39.993417+0000","last_became_active":"2023-11-30T23:12:47.128682+0000","last_became_peered":"2023-11-30T23:12:47.128682+0000","last_unstale":"2023-11-30T23:27:39.993417+0000","last_undegraded":"2023-11-30T23:27:39.993417+0000","last_fullsized":"2023-11-30T23:27:39.993417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4595,"log_dups_size":0,"ondisk_log_size":4595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583127,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":4657,"num_write_kb":26783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"48'3659","reported_seq":2964,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.538071+0000","last_change":"2023-11-30T23:27:40.521110+0000","last_active":"2023-11-30T23:27:41.538071+0000","last_peered":"2023-11-30T23:27:41.538071+0000","last_clean":"2023-11-30T23:27:41.538071+0000","last_became_active":"2023-11-30T23:12:47.516317+0000","last_became_peered":"2023-11-30T23:12:47.516317+0000","last_unstale":"2023-11-30T23:27:41.538071+0000","last_undegraded":"2023-11-30T23:27:41.538071+0000","last_fullsized":"2023-11-30T23:27:41.538071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3659,"log_dups_size":0,"ondisk_log_size":3659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:20:31.102899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018738761999999999,"stat_sum":{"num_bytes":16384,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1262,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.c","version":"48'4363","reported_seq":4408,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.428422+0000","last_change":"2023-11-30T23:12:47.140679+0000","last_active":"2023-11-30T23:27:40.428422+0000","last_peered":"2023-11-30T23:27:40.428422+0000","last_clean":"2023-11-30T23:27:40.428422+0000","last_became_active":"2023-11-30T23:12:47.140400+0000","last_became_peered":"2023-11-30T23:12:47.140400+0000","last_unstale":"2023-11-30T23:27:40.428422+0000","last_undegraded":"2023-11-30T23:27:40.428422+0000","last_fullsized":"2023-11-30T23:27:40.428422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4363,"log_dups_size":0,"ondisk_log_size":4363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4418,"num_write_kb":27644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"48'3509","reported_seq":2933,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.557081+0000","last_change":"2023-11-30T23:27:40.776512+0000","last_active":"2023-11-30T23:27:41.557081+0000","last_peered":"2023-11-30T23:27:41.557081+0000","last_clean":"2023-11-30T23:27:41.557081+0000","last_became_active":"2023-11-30T23:12:47.521481+0000","last_became_peered":"2023-11-30T23:12:47.521481+0000","last_unstale":"2023-11-30T23:27:41.557081+0000","last_undegraded":"2023-11-30T23:27:41.557081+0000","last_fullsized":"2023-11-30T23:27:41.557081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3509,"log_dups_size":0,"ondisk_log_size":3509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:17:01.774183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010302225,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1071,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.408367+0000","last_change":"2023-11-30T23:12:36.558633+0000","last_active":"2023-11-30T23:27:39.408367+0000","last_peered":"2023-11-30T23:27:39.408367+0000","last_clean":"2023-11-30T23:27:39.408367+0000","last_became_active":"2023-11-30T23:12:36.556455+0000","last_became_peered":"2023-11-30T23:12:36.556455+0000","last_unstale":"2023-11-30T23:27:39.408367+0000","last_undegraded":"2023-11-30T23:27:39.408367+0000","last_fullsized":"2023-11-30T23:27:39.408367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:34.652815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:34.652815+0000","last_clean_scrub_stamp":"2023-11-30T23:12:34.652815+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:36:52.941511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"48'933","reported_seq":979,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.501554+0000","last_change":"2023-11-30T23:12:47.132985+0000","last_active":"2023-11-30T23:27:40.501554+0000","last_peered":"2023-11-30T23:27:40.501554+0000","last_clean":"2023-11-30T23:27:40.501554+0000","last_became_active":"2023-11-30T23:12:47.132365+0000","last_became_peered":"2023-11-30T23:12:47.132365+0000","last_unstale":"2023-11-30T23:27:40.501554+0000","last_undegraded":"2023-11-30T23:27:40.501554+0000","last_fullsized":"2023-11-30T23:27:40.501554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":1011,"num_write_kb":13216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"48'3463","reported_seq":2898,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.529496+0000","last_change":"2023-11-30T23:27:40.529546+0000","last_active":"2023-11-30T23:27:41.529496+0000","last_peered":"2023-11-30T23:27:41.529496+0000","last_clean":"2023-11-30T23:27:41.529496+0000","last_became_active":"2023-11-30T23:12:47.508677+0000","last_became_peered":"2023-11-30T23:12:47.508677+0000","last_unstale":"2023-11-30T23:27:41.529496+0000","last_undegraded":"2023-11-30T23:27:41.529496+0000","last_fullsized":"2023-11-30T23:27:41.529496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3463,"log_dups_size":0,"ondisk_log_size":3463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029660272000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1097,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.0","version":"43'3512","reported_seq":3558,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.408442+0000","last_change":"2023-11-30T23:12:47.148775+0000","last_active":"2023-11-30T23:27:39.408442+0000","last_peered":"2023-11-30T23:27:39.408442+0000","last_clean":"2023-11-30T23:27:39.408442+0000","last_became_active":"2023-11-30T23:12:47.148547+0000","last_became_peered":"2023-11-30T23:12:47.148547+0000","last_unstale":"2023-11-30T23:27:39.408442+0000","last_undegraded":"2023-11-30T23:27:39.408442+0000","last_fullsized":"2023-11-30T23:27:39.408442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3512,"log_dups_size":0,"ondisk_log_size":3512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:01.207700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":3602,"num_write_kb":26128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"48'3481","reported_seq":2873,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.532387+0000","last_change":"2023-11-30T23:27:40.549560+0000","last_active":"2023-11-30T23:27:41.532387+0000","last_peered":"2023-11-30T23:27:41.532387+0000","last_clean":"2023-11-30T23:27:41.532387+0000","last_became_active":"2023-11-30T23:12:47.515553+0000","last_became_peered":"2023-11-30T23:12:47.515553+0000","last_unstale":"2023-11-30T23:27:41.532387+0000","last_undegraded":"2023-11-30T23:27:41.532387+0000","last_fullsized":"2023-11-30T23:27:41.532387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:22.086661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021186228000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1162,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1","version":"48'2695","reported_seq":3256,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:42.508476+0000","last_change":"2023-11-30T23:12:47.136018+0000","last_active":"2023-11-30T23:27:42.508476+0000","last_peered":"2023-11-30T23:27:42.508476+0000","last_clean":"2023-11-30T23:27:42.508476+0000","last_became_active":"2023-11-30T23:12:47.135746+0000","last_became_peered":"2023-11-30T23:12:47.135746+0000","last_unstale":"2023-11-30T23:27:42.508476+0000","last_undegraded":"2023-11-30T23:27:42.508476+0000","last_fullsized":"2023-11-30T23:27:42.508476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2695,"log_dups_size":0,"ondisk_log_size":2695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3169767,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":530,"num_read_kb":3420,"num_write":2759,"num_write_kb":16501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"48'3593","reported_seq":2961,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.478806+0000","last_change":"2023-11-30T23:27:40.472409+0000","last_active":"2023-11-30T23:27:41.478806+0000","last_peered":"2023-11-30T23:27:41.478806+0000","last_clean":"2023-11-30T23:27:41.478806+0000","last_became_active":"2023-11-30T23:12:47.510024+0000","last_became_peered":"2023-11-30T23:12:47.510024+0000","last_unstale":"2023-11-30T23:27:41.478806+0000","last_undegraded":"2023-11-30T23:27:41.478806+0000","last_fullsized":"2023-11-30T23:27:41.478806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3593,"log_dups_size":0,"ondisk_log_size":3593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045211289000000002,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.2","version":"48'4582","reported_seq":4628,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.513804+0000","last_change":"2023-11-30T23:12:47.141605+0000","last_active":"2023-11-30T23:27:40.513804+0000","last_peered":"2023-11-30T23:27:40.513804+0000","last_clean":"2023-11-30T23:27:40.513804+0000","last_became_active":"2023-11-30T23:12:47.141115+0000","last_became_peered":"2023-11-30T23:12:47.141115+0000","last_unstale":"2023-11-30T23:27:40.513804+0000","last_undegraded":"2023-11-30T23:27:40.513804+0000","last_fullsized":"2023-11-30T23:27:40.513804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4582,"log_dups_size":0,"ondisk_log_size":4582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":4625,"num_write_kb":30671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"48'3767","reported_seq":3095,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.547202+0000","last_change":"2023-11-30T23:27:40.778459+0000","last_active":"2023-11-30T23:27:41.547202+0000","last_peered":"2023-11-30T23:27:41.547202+0000","last_clean":"2023-11-30T23:27:41.547202+0000","last_became_active":"2023-11-30T23:12:47.514572+0000","last_became_peered":"2023-11-30T23:12:47.514572+0000","last_unstale":"2023-11-30T23:27:41.547202+0000","last_undegraded":"2023-11-30T23:27:41.547202+0000","last_fullsized":"2023-11-30T23:27:41.547202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3767,"log_dups_size":0,"ondisk_log_size":3767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:29.167074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010674993000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.4","version":"41'153","reported_seq":199,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.992465+0000","last_change":"2023-11-30T23:12:47.141801+0000","last_active":"2023-11-30T23:27:39.992465+0000","last_peered":"2023-11-30T23:27:39.992465+0000","last_clean":"2023-11-30T23:27:39.992465+0000","last_became_active":"2023-11-30T23:12:47.141411+0000","last_became_peered":"2023-11-30T23:12:47.141411+0000","last_unstale":"2023-11-30T23:27:39.992465+0000","last_undegraded":"2023-11-30T23:27:39.992465+0000","last_fullsized":"2023-11-30T23:27:39.992465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":238,"num_write_kb":8770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"48'3575","reported_seq":2929,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.503471+0000","last_change":"2023-11-30T23:27:40.519690+0000","last_active":"2023-11-30T23:27:41.503471+0000","last_peered":"2023-11-30T23:27:41.503471+0000","last_clean":"2023-11-30T23:27:41.503471+0000","last_became_active":"2023-11-30T23:13:30.305367+0000","last_became_peered":"2023-11-30T23:13:30.305367+0000","last_unstale":"2023-11-30T23:27:41.503471+0000","last_undegraded":"2023-11-30T23:27:41.503471+0000","last_fullsized":"2023-11-30T23:27:41.503471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3575,"log_dups_size":0,"ondisk_log_size":3575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:54:08.569710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017828157000000001,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.5","version":"48'2056","reported_seq":2102,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.771097+0000","last_change":"2023-11-30T23:12:47.143317+0000","last_active":"2023-11-30T23:27:40.771097+0000","last_peered":"2023-11-30T23:27:40.771097+0000","last_clean":"2023-11-30T23:27:40.771097+0000","last_became_active":"2023-11-30T23:12:47.143061+0000","last_became_peered":"2023-11-30T23:12:47.143061+0000","last_unstale":"2023-11-30T23:27:40.771097+0000","last_undegraded":"2023-11-30T23:27:40.771097+0000","last_fullsized":"2023-11-30T23:27:40.771097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:38.684081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":2145,"num_write_kb":21845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"48'3505","reported_seq":2894,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.454978+0000","last_change":"2023-11-30T23:27:40.468495+0000","last_active":"2023-11-30T23:27:41.454978+0000","last_peered":"2023-11-30T23:27:41.454978+0000","last_clean":"2023-11-30T23:27:41.454978+0000","last_became_active":"2023-11-30T23:12:47.501516+0000","last_became_peered":"2023-11-30T23:12:47.501516+0000","last_unstale":"2023-11-30T23:27:41.454978+0000","last_undegraded":"2023-11-30T23:27:41.454978+0000","last_fullsized":"2023-11-30T23:27:41.454978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:34:32.232378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040930987000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.6","version":"48'2107","reported_seq":2152,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.428152+0000","last_change":"2023-11-30T23:12:47.135053+0000","last_active":"2023-11-30T23:27:40.428152+0000","last_peered":"2023-11-30T23:27:40.428152+0000","last_clean":"2023-11-30T23:27:40.428152+0000","last_became_active":"2023-11-30T23:12:47.134776+0000","last_became_peered":"2023-11-30T23:12:47.134776+0000","last_unstale":"2023-11-30T23:27:40.428152+0000","last_undegraded":"2023-11-30T23:27:40.428152+0000","last_fullsized":"2023-11-30T23:27:40.428152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2107,"log_dups_size":0,"ondisk_log_size":2107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":2450,"num_write_kb":16294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"48'3245","reported_seq":2657,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.522958+0000","last_change":"2023-11-30T23:27:40.533855+0000","last_active":"2023-11-30T23:27:41.522958+0000","last_peered":"2023-11-30T23:27:41.522958+0000","last_clean":"2023-11-30T23:27:41.522958+0000","last_became_active":"2023-11-30T23:12:47.498631+0000","last_became_peered":"2023-11-30T23:12:47.498631+0000","last_unstale":"2023-11-30T23:27:41.522958+0000","last_undegraded":"2023-11-30T23:27:41.522958+0000","last_fullsized":"2023-11-30T23:27:41.522958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3245,"log_dups_size":0,"ondisk_log_size":3245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033287613000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1095,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.7","version":"48'1686","reported_seq":1731,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.770201+0000","last_change":"2023-11-30T23:12:47.137707+0000","last_active":"2023-11-30T23:27:40.770201+0000","last_peered":"2023-11-30T23:27:40.770201+0000","last_clean":"2023-11-30T23:27:40.770201+0000","last_became_active":"2023-11-30T23:12:47.137406+0000","last_became_peered":"2023-11-30T23:12:47.137406+0000","last_unstale":"2023-11-30T23:27:40.770201+0000","last_undegraded":"2023-11-30T23:27:40.770201+0000","last_fullsized":"2023-11-30T23:27:40.770201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1686,"log_dups_size":0,"ondisk_log_size":1686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":1761,"num_write_kb":9276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"48'3472","reported_seq":2875,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.548715+0000","last_change":"2023-11-30T23:27:40.571283+0000","last_active":"2023-11-30T23:27:41.548715+0000","last_peered":"2023-11-30T23:27:41.548715+0000","last_clean":"2023-11-30T23:27:41.548715+0000","last_became_active":"2023-11-30T23:12:47.506447+0000","last_became_peered":"2023-11-30T23:12:47.506447+0000","last_unstale":"2023-11-30T23:27:41.548715+0000","last_undegraded":"2023-11-30T23:27:41.548715+0000","last_fullsized":"2023-11-30T23:27:41.548715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3472,"log_dups_size":0,"ondisk_log_size":3472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:35:21.183993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037907362999999999,"stat_sum":{"num_bytes":4105,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1170,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.8","version":"41'1548","reported_seq":1593,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.408276+0000","last_change":"2023-11-30T23:12:47.142532+0000","last_active":"2023-11-30T23:27:39.408276+0000","last_peered":"2023-11-30T23:27:39.408276+0000","last_clean":"2023-11-30T23:27:39.408276+0000","last_became_active":"2023-11-30T23:12:47.142135+0000","last_became_peered":"2023-11-30T23:12:47.142135+0000","last_unstale":"2023-11-30T23:27:39.408276+0000","last_undegraded":"2023-11-30T23:27:39.408276+0000","last_fullsized":"2023-11-30T23:27:39.408276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1548,"log_dups_size":0,"ondisk_log_size":1548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:53.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":1654,"num_write_kb":9390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"48'3431","reported_seq":2807,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.574838+0000","last_change":"2023-11-30T23:27:40.779072+0000","last_active":"2023-11-30T23:27:41.574838+0000","last_peered":"2023-11-30T23:27:41.574838+0000","last_clean":"2023-11-30T23:27:41.574838+0000","last_became_active":"2023-11-30T23:12:47.513966+0000","last_became_peered":"2023-11-30T23:12:47.513966+0000","last_unstale":"2023-11-30T23:27:41.574838+0000","last_undegraded":"2023-11-30T23:27:41.574838+0000","last_fullsized":"2023-11-30T23:27:41.574838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3431,"log_dups_size":0,"ondisk_log_size":3431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:02.220181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003646318,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.9","version":"41'2295","reported_seq":2340,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.992195+0000","last_change":"2023-11-30T23:12:47.140898+0000","last_active":"2023-11-30T23:27:39.992195+0000","last_peered":"2023-11-30T23:27:39.992195+0000","last_clean":"2023-11-30T23:27:39.992195+0000","last_became_active":"2023-11-30T23:12:47.140565+0000","last_became_peered":"2023-11-30T23:12:47.140565+0000","last_unstale":"2023-11-30T23:27:39.992195+0000","last_undegraded":"2023-11-30T23:27:39.992195+0000","last_fullsized":"2023-11-30T23:27:39.992195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":2336,"num_write_kb":17365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'3595","reported_seq":2941,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.559453+0000","last_change":"2023-11-30T23:27:40.526518+0000","last_active":"2023-11-30T23:27:41.559453+0000","last_peered":"2023-11-30T23:27:41.559453+0000","last_clean":"2023-11-30T23:27:41.559453+0000","last_became_active":"2023-11-30T23:12:47.501315+0000","last_became_peered":"2023-11-30T23:12:47.501315+0000","last_unstale":"2023-11-30T23:27:41.559453+0000","last_undegraded":"2023-11-30T23:27:41.559453+0000","last_fullsized":"2023-11-30T23:27:41.559453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026736012999999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.a","version":"44'2871","reported_seq":2916,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.993797+0000","last_change":"2023-11-30T23:12:47.140328+0000","last_active":"2023-11-30T23:27:39.993797+0000","last_peered":"2023-11-30T23:27:39.993797+0000","last_clean":"2023-11-30T23:27:39.993797+0000","last_became_active":"2023-11-30T23:12:47.140037+0000","last_became_peered":"2023-11-30T23:12:47.140037+0000","last_unstale":"2023-11-30T23:27:39.993797+0000","last_undegraded":"2023-11-30T23:27:39.993797+0000","last_fullsized":"2023-11-30T23:27:39.993797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:38.684081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":2935,"num_write_kb":26081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"48'3359","reported_seq":2771,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.559018+0000","last_change":"2023-11-30T23:27:40.530235+0000","last_active":"2023-11-30T23:27:41.559018+0000","last_peered":"2023-11-30T23:27:41.559018+0000","last_clean":"2023-11-30T23:27:41.559018+0000","last_became_active":"2023-11-30T23:12:47.507181+0000","last_became_peered":"2023-11-30T23:12:47.507181+0000","last_unstale":"2023-11-30T23:27:41.559018+0000","last_undegraded":"2023-11-30T23:27:41.559018+0000","last_fullsized":"2023-11-30T23:27:41.559018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030024714000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.b","version":"41'4584","reported_seq":4629,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.409866+0000","last_change":"2023-11-30T23:12:47.142027+0000","last_active":"2023-11-30T23:27:39.409866+0000","last_peered":"2023-11-30T23:27:39.409866+0000","last_clean":"2023-11-30T23:27:39.409866+0000","last_became_active":"2023-11-30T23:12:47.141664+0000","last_became_peered":"2023-11-30T23:12:47.141664+0000","last_unstale":"2023-11-30T23:27:39.409866+0000","last_undegraded":"2023-11-30T23:27:39.409866+0000","last_fullsized":"2023-11-30T23:27:39.409866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4584,"log_dups_size":0,"ondisk_log_size":4584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4647,"num_write_kb":30581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"48'3589","reported_seq":2929,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.511274+0000","last_change":"2023-11-30T23:27:40.782695+0000","last_active":"2023-11-30T23:27:41.511274+0000","last_peered":"2023-11-30T23:27:41.511274+0000","last_clean":"2023-11-30T23:27:41.511274+0000","last_became_active":"2023-11-30T23:12:47.516939+0000","last_became_peered":"2023-11-30T23:12:47.516939+0000","last_unstale":"2023-11-30T23:27:41.511274+0000","last_undegraded":"2023-11-30T23:27:41.511274+0000","last_fullsized":"2023-11-30T23:27:41.511274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3589,"log_dups_size":0,"ondisk_log_size":3589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014334588000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1d","version":"48'3872","reported_seq":3220,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.485190+0000","last_change":"2023-11-30T23:27:40.517369+0000","last_active":"2023-11-30T23:27:41.485190+0000","last_peered":"2023-11-30T23:27:41.485190+0000","last_clean":"2023-11-30T23:27:41.485190+0000","last_became_active":"2023-11-30T23:12:47.521310+0000","last_became_peered":"2023-11-30T23:12:47.521310+0000","last_unstale":"2023-11-30T23:27:41.485190+0000","last_undegraded":"2023-11-30T23:27:41.485190+0000","last_fullsized":"2023-11-30T23:27:41.485190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3872,"log_dups_size":0,"ondisk_log_size":3872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:08:47.117163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015666933000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1c","version":"43'622","reported_seq":666,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.409308+0000","last_change":"2023-11-30T23:12:47.143819+0000","last_active":"2023-11-30T23:27:39.409308+0000","last_peered":"2023-11-30T23:27:39.409308+0000","last_clean":"2023-11-30T23:27:39.409308+0000","last_became_active":"2023-11-30T23:12:47.143512+0000","last_became_peered":"2023-11-30T23:12:47.143512+0000","last_unstale":"2023-11-30T23:27:39.409308+0000","last_undegraded":"2023-11-30T23:27:39.409308+0000","last_fullsized":"2023-11-30T23:27:39.409308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:35:20.171512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":689,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"48'3820","reported_seq":3126,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.577995+0000","last_change":"2023-11-30T23:27:40.520201+0000","last_active":"2023-11-30T23:27:41.577995+0000","last_peered":"2023-11-30T23:27:41.577995+0000","last_clean":"2023-11-30T23:27:41.577995+0000","last_became_active":"2023-11-30T23:12:47.520322+0000","last_became_peered":"2023-11-30T23:12:47.520322+0000","last_unstale":"2023-11-30T23:27:41.577995+0000","last_undegraded":"2023-11-30T23:27:41.577995+0000","last_fullsized":"2023-11-30T23:27:41.577995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3820,"log_dups_size":0,"ondisk_log_size":3820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018218595000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1d","version":"41'4570","reported_seq":4614,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.409491+0000","last_change":"2023-11-30T23:12:47.142276+0000","last_active":"2023-11-30T23:27:39.409491+0000","last_peered":"2023-11-30T23:27:39.409491+0000","last_clean":"2023-11-30T23:27:39.409491+0000","last_became_active":"2023-11-30T23:12:47.141965+0000","last_became_peered":"2023-11-30T23:12:47.141965+0000","last_unstale":"2023-11-30T23:27:39.409491+0000","last_undegraded":"2023-11-30T23:27:39.409491+0000","last_fullsized":"2023-11-30T23:27:39.409491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4570,"log_dups_size":0,"ondisk_log_size":4570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:28.154593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4627,"num_write_kb":34948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"48'3352","reported_seq":2791,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.529314+0000","last_change":"2023-11-30T23:27:40.554745+0000","last_active":"2023-11-30T23:27:41.529314+0000","last_peered":"2023-11-30T23:27:41.529314+0000","last_clean":"2023-11-30T23:27:41.529314+0000","last_became_active":"2023-11-30T23:12:47.522002+0000","last_became_peered":"2023-11-30T23:12:47.522002+0000","last_unstale":"2023-11-30T23:27:41.529314+0000","last_undegraded":"2023-11-30T23:27:41.529314+0000","last_fullsized":"2023-11-30T23:27:41.529314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3352,"log_dups_size":0,"ondisk_log_size":3352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025109995999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1079,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1e","version":"43'4068","reported_seq":4114,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.717324+0000","last_change":"2023-11-30T23:12:47.139186+0000","last_active":"2023-11-30T23:27:39.717324+0000","last_peered":"2023-11-30T23:27:39.717324+0000","last_clean":"2023-11-30T23:27:39.717324+0000","last_became_active":"2023-11-30T23:12:47.138275+0000","last_became_peered":"2023-11-30T23:12:47.138275+0000","last_unstale":"2023-11-30T23:27:39.717324+0000","last_undegraded":"2023-11-30T23:27:39.717324+0000","last_fullsized":"2023-11-30T23:27:39.717324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4068,"log_dups_size":0,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:58:25.168678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":4121,"num_write_kb":30658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"48'3346","reported_seq":2746,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.529273+0000","last_change":"2023-11-30T23:27:40.538163+0000","last_active":"2023-11-30T23:27:41.529273+0000","last_peered":"2023-11-30T23:27:41.529273+0000","last_clean":"2023-11-30T23:27:41.529273+0000","last_became_active":"2023-11-30T23:12:47.508718+0000","last_became_peered":"2023-11-30T23:12:47.508718+0000","last_unstale":"2023-11-30T23:27:41.529273+0000","last_undegraded":"2023-11-30T23:27:41.529273+0000","last_fullsized":"2023-11-30T23:27:41.529273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3346,"log_dups_size":0,"ondisk_log_size":3346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037282159000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1f","version":"43'790","reported_seq":836,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.520769+0000","last_change":"2023-11-30T23:12:47.141150+0000","last_active":"2023-11-30T23:27:39.520769+0000","last_peered":"2023-11-30T23:27:39.520769+0000","last_clean":"2023-11-30T23:27:39.520769+0000","last_became_active":"2023-11-30T23:12:47.140891+0000","last_became_peered":"2023-11-30T23:12:47.140891+0000","last_unstale":"2023-11-30T23:27:39.520769+0000","last_undegraded":"2023-11-30T23:27:39.520769+0000","last_fullsized":"2023-11-30T23:27:39.520769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:22:48.835054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":847,"num_write_kb":12818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":74679,"num_write_kb":40592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228857,"ondisk_log_size":228857,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":275264647,"num_objects":614,"num_object_clones":0,"num_object_copies":1228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":614,"num_whiteouts":0,"num_read":1037,"num_read_kb":3420,"num_write":81069,"num_write_kb":625801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":540,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":550592512,"data_stored":550529294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78631,"ondisk_log_size":78631,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575033,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438952,"kb_used_data":70816,"kb_used_omap":0,"kb_used_meta":368128,"kb_avail":93932888,"statfs":{"total":96636764160,"available":96187277312,"internally_reserved":0,"allocated":72515584,"data_stored":72178287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":376963072},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69499999999999995,"15min":0.70399999999999996},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":1.1639999999999999,"5min":0.84699999999999998,"15min":0.78900000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":6.9429999999999996,"5min":6.9429999999999996,"15min":6.9429999999999996},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.81699999999999995,"15min":0.81399999999999995},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":7.0540000000000003,"5min":7.0540000000000003,"15min":7.0540000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.751},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.84699999999999998,"15min":0.83099999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":5.54,"5min":5.54,"15min":5.54},"last":0.373},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":5.5880000000000001,"5min":5.5880000000000001,"15min":5.5880000000000001},"last":0.437}]},{"osd":3,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":0.94999999999999996,"15min":0.90100000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":4.6440000000000001,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":1.022,"5min":0.95999999999999996,"15min":0.96299999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":4.6589999999999998,"5min":4.6589999999999998,"15min":4.6589999999999998},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.68799999999999994,"15min":0.77500000000000002},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.314},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3759999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.81100000000000005,"15min":0.88100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.313}]},{"osd":5,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.79200000000000004,"15min":0.875},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.6719999999999999,"5min":1.7110000000000001,"15min":1.7210000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.81599999999999995,"15min":0.88500000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6379999999999999,"5min":1.796,"15min":1.796},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.86599999999999999,"15min":0.94499999999999995},"min":{"1min":0.38300000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.694,"5min":1.694,"15min":2.9670000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.92300000000000004,"15min":0.97899999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":0.46700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575033,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345988,"kb_used_data":90172,"kb_used_omap":0,"kb_used_meta":255808,"kb_avail":94025852,"statfs":{"total":96636764160,"available":96282472448,"internally_reserved":0,"allocated":92336128,"data_stored":92014768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":261947392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70199999999999996,"15min":0.73199999999999998},"min":{"1min":0.27100000000000002,"5min":0.23999999999999999,"15min":0.221},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.5640000000000001},"last":1.306},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.77000000000000002,"15min":0.78400000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":3.4670000000000001,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.83199999999999996,"15min":0.86299999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":2.2210000000000001,"5min":5.851,"15min":12.172000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.33300000000000002},"max":{"1min":3.4420000000000002,"5min":3.4420000000000002,"15min":5.6980000000000004},"last":0.77900000000000003}]},{"osd":2,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.1800000000000002,"5min":2.327,"15min":2.327},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83999999999999997,"15min":0.86399999999999999},"min":{"1min":0.35999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.774},"last":1.3720000000000001}]},{"osd":3,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.873,"15min":0.873},"min":{"1min":0.434,"5min":0.434,"15min":0.38900000000000001},"max":{"1min":3.4889999999999999,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.871,"15min":0.86799999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":2.2029999999999998,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.83799999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.081,"5min":2.081,"15min":2.6429999999999998},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.878,"15min":0.88900000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35299999999999998},"max":{"1min":3.371,"5min":3.371,"15min":3.371},"last":1.0269999999999999}]},{"osd":5,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.83899999999999997,"15min":0.84899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.1549999999999998,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.91000000000000003,"15min":0.97599999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":2.194,"5min":2.2400000000000002,"15min":2.7040000000000002},"last":1.4330000000000001}]},{"osd":7,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.101,"15min":1.0509999999999999},"min":{"1min":0.45700000000000002,"5min":0.45600000000000002,"15min":0.42499999999999999},"max":{"1min":3.4169999999999998,"5min":11.220000000000001,"15min":11.220000000000001},"last":1.083},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.0940000000000001,"15min":1.1399999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.2370000000000001,"5min":12.874000000000001,"15min":30.405999999999999},"last":0.80000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575033,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":384292,"kb_used_data":86620,"kb_used_omap":0,"kb_used_meta":297664,"kb_avail":93987548,"statfs":{"total":96636764160,"available":96243249152,"internally_reserved":0,"allocated":88698880,"data_stored":88364629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304807936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.64200000000000002,"15min":0.70799999999999996},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.91200000000000003,"5min":1.1990000000000001,"15min":1.2330000000000001},"last":1.167},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.72599999999999998,"15min":0.76500000000000001},"min":{"1min":0.39700000000000002,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":3.5489999999999999,"5min":3.5489999999999999,"15min":4.508},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.77800000000000002,"15min":0.84499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96699999999999997,"5min":2.9740000000000002,"15min":6.9320000000000004},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.78000000000000003,"15min":0.88400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.94399999999999995,"5min":1.661,"15min":6.8780000000000001},"last":1.1970000000000001}]},{"osd":2,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.76300000000000001,"15min":0.80400000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.26700000000000002},"max":{"1min":1.04,"5min":1.7130000000000001,"15min":1.9690000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.77500000000000002,"15min":0.85099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0569999999999999,"5min":3.1379999999999999,"15min":4.6230000000000002},"last":1.0129999999999999}]},{"osd":3,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.81799999999999995,"15min":0.85299999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.345,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.82899999999999996,"15min":0.93200000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.997,"5min":3.0030000000000001,"15min":6.7400000000000002},"last":0.95899999999999996}]},{"osd":4,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.71399999999999997,"15min":0.80900000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.309},"max":{"1min":0.878,"5min":1.456,"15min":1.4930000000000001},"last":0.878},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.83099999999999996,"15min":0.86299999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.5820000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.98299999999999998}]},{"osd":6,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.84699999999999998,"15min":0.89000000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.3520000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.86499999999999999,"15min":0.93500000000000005},"min":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.8160000000000001,"5min":3.073,"15min":3.073},"last":1.2350000000000001}]},{"osd":7,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.89500000000000002,"15min":0.94599999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.012,"5min":2.895,"15min":2.895},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.92800000000000005,"15min":0.98199999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.6559999999999999,"5min":3.484,"15min":3.484},"last":1.2090000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575032,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":349332,"kb_used_data":65612,"kb_used_omap":0,"kb_used_meta":283712,"kb_avail":94022508,"statfs":{"total":96636764160,"available":96279048192,"internally_reserved":0,"allocated":67186688,"data_stored":66856744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":290521088},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":0.81100000000000005,"15min":0.751},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":12.91,"5min":12.91,"15min":12.91},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.345,"5min":0.83299999999999996,"15min":0.77300000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":12.962,"5min":12.962,"15min":12.962},"last":0.93600000000000005}]},{"osd":1,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.25600000000000001},"max":{"1min":4.8090000000000002,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.79900000000000004,"15min":0.78000000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":6.7839999999999998,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":1.1080000000000001}]},{"osd":2,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":0.83299999999999996,"15min":0.80900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":9.0229999999999997,"5min":9.0229999999999997,"15min":9.0229999999999997},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.143,"5min":0.92500000000000004,"15min":0.90500000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.33600000000000002},"max":{"1min":8.9990000000000006,"5min":8.9990000000000006,"15min":8.9990000000000006},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.86899999999999999,"15min":0.85399999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":5.0209999999999999,"5min":5.0209999999999999,"15min":5.0209999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80800000000000005,"15min":0.82799999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":2.9489999999999998,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":4.71,"5min":1.593,"15min":1.087},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":81.837000000000003,"5min":81.837000000000003,"15min":81.837000000000003},"last":0.76700000000000002},{"interface":"front","average":{"1min":4.8460000000000001,"5min":1.6930000000000001,"15min":1.179},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":81.751999999999995,"5min":81.751999999999995,"15min":81.751999999999995},"last":1.1479999999999999}]},{"osd":6,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":4.6379999999999999,"5min":1.5740000000000001,"15min":1.0920000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":79.655000000000001,"5min":79.655000000000001,"15min":79.655000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":4.7789999999999999,"5min":1.6830000000000001,"15min":1.2070000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":80.540000000000006,"5min":80.540000000000006,"15min":80.540000000000006},"last":1.032}]},{"osd":7,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":4.8399999999999999,"5min":1.7190000000000001,"15min":1.206},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":80.486000000000004,"5min":80.486000000000004,"15min":80.486000000000004},"last":0.90400000000000003},{"interface":"front","average":{"1min":5.0449999999999999,"5min":1.7150000000000001,"15min":1.2030000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":81.875,"5min":81.875,"15min":81.875},"last":0.86699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575033,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370920,"kb_used_data":61024,"kb_used_omap":0,"kb_used_meta":309888,"kb_avail":94000920,"statfs":{"total":96636764160,"available":96256942080,"internally_reserved":0,"allocated":62488576,"data_stored":62170691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":317325312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":2.6589999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.26900000000000002,"5min":0.24299999999999999,"15min":0.23999999999999999},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.4750000000000001},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.125,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.74299999999999999,"15min":0.77100000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0960000000000001,"5min":1.256,"15min":4.8150000000000004},"last":0.89800000000000002}]},{"osd":2,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.77200000000000002,"15min":0.76900000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.28000000000000003},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.82899999999999996,"15min":0.84399999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.1259999999999999,"5min":1.3580000000000001,"15min":4.8719999999999999},"last":1.0149999999999999}]},{"osd":4,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.88500000000000001,"15min":0.89300000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.31},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":2.536},"last":1.26},{"interface":"front","average":{"1min":1.099,"5min":0.96199999999999997,"15min":0.95999999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.378},"max":{"1min":4.6820000000000004,"5min":4.6820000000000004,"15min":4.6820000000000004},"last":1.3}]},{"osd":5,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.0580000000000001,"15min":1.0189999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.42099999999999999},"max":{"1min":8.8010000000000002,"5min":8.8010000000000002,"15min":8.8010000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.98799999999999999,"15min":1.04},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1499999999999999,"5min":1.8500000000000001,"15min":4.9909999999999997},"last":1.0820000000000001}]},{"osd":6,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.0429999999999999,"15min":1.022},"min":{"1min":0.52700000000000002,"5min":0.52100000000000002,"15min":0.378},"max":{"1min":3.6699999999999999,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":1.044},{"interface":"front","average":{"1min":0.88700000000000001,"5min":1.024,"15min":1.0660000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.45500000000000002},"max":{"1min":1.1870000000000001,"5min":2.3530000000000002,"15min":4.4379999999999997},"last":1.2130000000000001}]},{"osd":7,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.038,"15min":1.085},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2629999999999999,"5min":1.4910000000000001,"15min":5.0369999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.056,"15min":1.073},"min":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.214,"5min":2.214,"15min":2.5609999999999999},"last":1.1279999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575034,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224096,"kb_used_data":40536,"kb_used_omap":0,"kb_used_meta":183552,"kb_avail":94147744,"statfs":{"total":96636764160,"available":96407289856,"internally_reserved":0,"allocated":41508864,"data_stored":41194419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":187957248},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.72599999999999998,"5min":1.0629999999999999,"15min":1.413},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.65100000000000002,"15min":0.67400000000000004},"min":{"1min":0.222,"5min":0.222,"15min":0.17999999999999999},"max":{"1min":1.044,"5min":1.2110000000000001,"15min":1.4470000000000001},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.79100000000000004,"15min":0.73299999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":8.3480000000000008,"5min":8.3480000000000008,"15min":8.3480000000000008},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.74199999999999999,"15min":0.76100000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.224},"max":{"1min":1.0329999999999999,"5min":1.1850000000000001,"15min":11.457000000000001},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.79200000000000004,"15min":0.73299999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.4569999999999999,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.86199999999999999,"15min":0.84099999999999997},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.4319999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.093}]},{"osd":4,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.85699999999999998,"15min":0.88100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28299999999999997},"max":{"1min":1.151,"5min":1.5029999999999999,"15min":1.522},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.88,"15min":0.87},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.4540000000000002,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":1.0109999999999999,"15min":0.999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":1.0009999999999999,"15min":0.998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.754}]},{"osd":6,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0089999999999999,"15min":0.96599999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":4.9420000000000002,"5min":4.9420000000000002,"15min":4.9420000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.369,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":1.222}]},{"osd":7,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":1.0569999999999999,"15min":1.0549999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.498,"5min":1.498,"15min":1.762},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.179,"5min":1.0920000000000001,"15min":1.0469999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.4750000000000001,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.92400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575034,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396560,"kb_used_data":86600,"kb_used_omap":0,"kb_used_meta":309952,"kb_avail":93975280,"statfs":{"total":96636764160,"available":96230686720,"internally_reserved":0,"allocated":88678400,"data_stored":88352518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":317390848},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.183},"max":{"1min":2.7850000000000001,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.498,"5min":0.67000000000000004,"15min":0.65900000000000003},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.91700000000000004,"5min":1.222,"15min":1.222},"last":0.69099999999999995}]},{"osd":2,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66100000000000003,"15min":0.67300000000000004},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23000000000000001},"max":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.71399999999999997,"15min":0.72299999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.20699999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29099999999999998},"max":{"1min":0.96799999999999997,"5min":1.3720000000000001,"15min":1.431},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.78500000000000003,"15min":0.76100000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.498,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.624}]},{"osd":4,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.85499999999999998,"15min":0.88100000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.85699999999999998,"15min":0.88800000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.077,"5min":1.482,"15min":1.6919999999999999},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.84199999999999997,"15min":0.84999999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.5389999999999999,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.97299999999999998,"15min":0.99099999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.8879999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.93500000000000005,"15min":0.93300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.6000000000000001,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.012,"15min":1.026},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.9209999999999998,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.998,"15min":1.0069999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":1.1259999999999999,"5min":2.7549999999999999,"15min":2.7549999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.997,"15min":1.004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.5720000000000001,"5min":3.2280000000000002,"15min":3.2280000000000002},"last":0.94999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575033,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243812,"kb_used_data":42140,"kb_used_omap":0,"kb_used_meta":201664,"kb_avail":94128028,"statfs":{"total":96636764160,"available":96387100672,"internally_reserved":0,"allocated":43151360,"data_stored":42810014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":206503936},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,1,1,10,9,24,13],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.624,"15min":0.61099999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.20999999999999999},"max":{"1min":0.88,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65100000000000002,"15min":0.66200000000000003},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.486}]},{"osd":2,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.311,"5min":0.311,"15min":0.23699999999999999},"max":{"1min":1.046,"5min":1.8919999999999999,"15min":2.3479999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.76900000000000002,"15min":0.77300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":0.23499999999999999}]},{"osd":3,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.70599999999999996,"15min":0.71699999999999997},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.387,"5min":1.387,"15min":4.3170000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.85899999999999999,"15min":0.82699999999999996},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.99099999999999999,"5min":1.925,"15min":2.395},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.90800000000000003,"15min":0.89700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.86899999999999999,"15min":0.89700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":2.0640000000000001},"last":5.5720000000000001}]},{"osd":5,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.90200000000000002,"15min":0.91500000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.24,"5min":1.5629999999999999,"15min":1.871},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":1.054,"15min":1.0680000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.9350000000000001,"5min":3.165,"15min":6.0119999999999996},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":1.089,"15min":1.0720000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.0800000000000001,"5min":2.0840000000000001,"15min":2.5209999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.032,"15min":1.032},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.254,"5min":2.254,"15min":8.3490000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.0129999999999999,"15min":1.038},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":6.1529999999999996},"last":0.57999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41955328,"data_stored":41943678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":88088576,"data_stored":88080689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40919040,"data_stored":40918503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61898752,"data_stored":61890695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":66588672,"data_stored":66572640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":88084480,"data_stored":88080474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":91750400,"data_stored":91738865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":28760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":24621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":28708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":32788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":36947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":28695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":36961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T23:27:46.260 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-30T23:27:46.261 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T23:27:46.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.374+0000 7fc7f9578700 1 Processor -- start 2023-11-30T23:27:46.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.374+0000 7fc7f9578700 1 -- start start 2023-11-30T23:27:46.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.374+0000 7fc7f9578700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7f40b9ff0 0x7fc7f4140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.374+0000 7fc7f9578700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc7f40b80b0 0x7fc7f41409b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.374+0000 7fc7f9578700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f40b95e0 con 0x7fc7f406c340 2023-11-30T23:27:46.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.374+0000 7fc7f9578700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f40ba3d0 con 0x7fc7f40b80b0 2023-11-30T23:27:46.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.374+0000 7fc7f9578700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f40b8f90 con 0x7fc7f40b9ff0 2023-11-30T23:27:46.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.374+0000 7fc7f37fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc7f40b80b0 0x7fc7f41409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.374+0000 7fc7f37fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc7f40b80b0 0x7fc7f41409b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60774/0 (socket says 172.21.15.73:60774) 2023-11-30T23:27:46.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.374+0000 7fc7f37fe700 1 -- 172.21.15.73:0/3929136996 learned_addr learned my addr 172.21.15.73:0/3929136996 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:46.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.374+0000 7fc7f3fff700 1 --2- 172.21.15.73:0/3929136996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7f40b9ff0 0x7fc7f4140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.374+0000 7fc7f37fe700 1 -- 172.21.15.73:0/3929136996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7f40b9ff0 msgr2=0x7fc7f4140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:46.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.374+0000 7fc7f37fe700 1 --2- 172.21.15.73:0/3929136996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7f40b9ff0 0x7fc7f4140470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.374+0000 7fc7f37fe700 1 -- 172.21.15.73:0/3929136996 >> v1:172.21.15.156:6789/0 conn(0x7fc7f406c340 legacy=0x7fc7f406c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:46.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.374+0000 7fc7f37fe700 1 -- 172.21.15.73:0/3929136996 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f40b9270 con 0x7fc7f40b80b0 2023-11-30T23:27:46.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.374+0000 7fc7f37fe700 1 --2- 172.21.15.73:0/3929136996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7f40b80b0 0x7fc7f41409b0 secure :-1 s=READY pgs=4217 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009910 tx=0x7fc7dc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70aeb7a67a7d0575 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:46.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.378+0000 7fc7f2ffd700 1 -- 172.21.15.73:0/3929136996 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00ba60 con 0x7fc7f40b80b0 2023-11-30T23:27:46.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.378+0000 7fc7f2ffd700 1 -- 172.21.15.73:0/3929136996 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc00bbc0 con 0x7fc7f40b80b0 2023-11-30T23:27:46.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.378+0000 7fc7f2ffd700 1 -- 172.21.15.73:0/3929136996 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc009e60 con 0x7fc7f40b80b0 2023-11-30T23:27:46.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.378+0000 7fc7f9578700 1 -- 172.21.15.73:0/3929136996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7f40b80b0 msgr2=0x7fc7f41409b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:46.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.378+0000 7fc7f9578700 1 --2- 172.21.15.73:0/3929136996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7f40b80b0 0x7fc7f41409b0 secure :-1 s=READY pgs=4217 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009910 tx=0x7fc7dc009c20 comp rx=0 tx=0).stop 2023-11-30T23:27:46.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.378+0000 7fc7f9578700 1 -- 172.21.15.73:0/3929136996 shutdown_connections 2023-11-30T23:27:46.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.378+0000 7fc7f9578700 1 --2- 172.21.15.73:0/3929136996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7f40b80b0 0x7fc7f41409b0 unknown :-1 s=CLOSED pgs=4217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.378+0000 7fc7f9578700 1 --2- 172.21.15.73:0/3929136996 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7f40b9ff0 0x7fc7f4140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.378+0000 7fc7f9578700 1 -- 172.21.15.73:0/3929136996 >> 172.21.15.73:0/3929136996 conn(0x7fc7f406a180 msgr2=0x7fc7f406a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:46.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.378+0000 7fc7f9578700 1 -- 172.21.15.73:0/3929136996 shutdown_connections 2023-11-30T23:27:46.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.378+0000 7fc7f9578700 1 -- 172.21.15.73:0/3929136996 wait complete. 2023-11-30T23:27:46.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f9578700 1 Processor -- start 2023-11-30T23:27:46.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f9578700 1 -- start start 2023-11-30T23:27:46.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f9578700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7f406c340 0x7fc7f414a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f9578700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7f40b80b0 0x7fc7f4141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f9578700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7f40b9ff0 0x7fc7f41415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f9578700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f4147970 con 0x7fc7f40b80b0 2023-11-30T23:27:46.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f9578700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f4148730 con 0x7fc7f40b9ff0 2023-11-30T23:27:46.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f9578700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f4143370 con 0x7fc7f406c340 2023-11-30T23:27:46.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7f40b80b0 0x7fc7f4141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f37fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7f40b80b0 0x7fc7f4141060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60788/0 (socket says 172.21.15.73:60788) 2023-11-30T23:27:46.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f37fe700 1 -- 172.21.15.73:0/3840954232 learned_addr learned my addr 172.21.15.73:0/3840954232 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:46.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f3fff700 1 --2- 172.21.15.73:0/3840954232 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7f406c340 0x7fc7f414a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f8d77700 1 --2- 172.21.15.73:0/3840954232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7f40b9ff0 0x7fc7f41415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f37fe700 1 -- 172.21.15.73:0/3840954232 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7f406c340 msgr2=0x7fc7f414a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:46.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f37fe700 1 --2- 172.21.15.73:0/3840954232 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7f406c340 0x7fc7f414a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f37fe700 1 -- 172.21.15.73:0/3840954232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7f40b9ff0 msgr2=0x7fc7f41415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:46.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f37fe700 1 --2- 172.21.15.73:0/3840954232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7f40b9ff0 0x7fc7f41415a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f37fe700 1 -- 172.21.15.73:0/3840954232 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc009570 con 0x7fc7f40b80b0 2023-11-30T23:27:46.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f37fe700 1 --2- 172.21.15.73:0/3840954232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7f40b80b0 0x7fc7f4141060 secure :-1 s=READY pgs=4218 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40baae0 tx=0x7fc7dc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:46.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f0ff9700 1 -- 172.21.15.73:0/3840954232 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc01a840 con 0x7fc7f40b80b0 2023-11-30T23:27:46.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f0ff9700 1 -- 172.21.15.73:0/3840954232 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc01f070 con 0x7fc7f40b80b0 2023-11-30T23:27:46.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f0ff9700 1 -- 172.21.15.73:0/3840954232 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc01abe0 con 0x7fc7f40b80b0 2023-11-30T23:27:46.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f9578700 1 -- 172.21.15.73:0/3840954232 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f41496d0 con 0x7fc7f40b80b0 2023-11-30T23:27:46.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.382+0000 7fc7f9578700 1 -- 172.21.15.73:0/3840954232 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f414a680 con 0x7fc7f40b80b0 2023-11-30T23:27:46.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.386+0000 7fc7f9578700 1 -- 172.21.15.73:0/3840954232 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f41477d0 con 0x7fc7f40b80b0 2023-11-30T23:27:46.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.386+0000 7fc7f0ff9700 1 -- 172.21.15.73:0/3840954232 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc7dc01ad40 con 0x7fc7f40b80b0 2023-11-30T23:27:46.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.386+0000 7fc7f0ff9700 1 --2- 172.21.15.73:0/3840954232 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc7d4065ad0 0x7fc7d4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.386+0000 7fc7f0ff9700 1 -- 172.21.15.73:0/3840954232 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fc7dc021070 con 0x7fc7f40b80b0 2023-11-30T23:27:46.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.386+0000 7fc7f3fff700 1 --2- 172.21.15.73:0/3840954232 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc7d4065ad0 0x7fc7d4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.386+0000 7fc7f3fff700 1 --2- 172.21.15.73:0/3840954232 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc7d4065ad0 0x7fc7d4067f90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4007a60 tx=0x7fc7e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:46.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.394+0000 7fc7f0ff9700 1 -- 172.21.15.73:0/3840954232 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fc7f41477d0 con 0x7fc7f40b80b0 2023-11-30T23:27:46.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.554+0000 7fc7f9578700 1 -- 172.21.15.73:0/3840954232 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc7f40b85e0 con 0x7fc7d4065ad0 2023-11-30T23:27:46.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.570+0000 7fc7f0ff9700 1 -- 172.21.15.73:0/3840954232 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+293494 (secure 0 0 0) 0x7fc7e4010740 con 0x7fc7d4065ad0 2023-11-30T23:27:46.580 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:27:46.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.578+0000 7fc7f9578700 1 -- 172.21.15.73:0/3840954232 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc7d4065ad0 msgr2=0x7fc7d4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:46.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.578+0000 7fc7f9578700 1 --2- 172.21.15.73:0/3840954232 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc7d4065ad0 0x7fc7d4067f90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4007a60 tx=0x7fc7e4008040 comp rx=0 tx=0).stop 2023-11-30T23:27:46.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.578+0000 7fc7f9578700 1 -- 172.21.15.73:0/3840954232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7f40b80b0 msgr2=0x7fc7f4141060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:46.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.578+0000 7fc7f9578700 1 --2- 172.21.15.73:0/3840954232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7f40b80b0 0x7fc7f4141060 secure :-1 s=READY pgs=4218 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40baae0 tx=0x7fc7dc004770 comp rx=0 tx=0).stop 2023-11-30T23:27:46.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.578+0000 7fc7f9578700 1 -- 172.21.15.73:0/3840954232 shutdown_connections 2023-11-30T23:27:46.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.578+0000 7fc7f9578700 1 --2- 172.21.15.73:0/3840954232 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc7d4065ad0 0x7fc7d4067f90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.578+0000 7fc7f9578700 1 --2- 172.21.15.73:0/3840954232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7f40b9ff0 0x7fc7f41415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.578+0000 7fc7f9578700 1 --2- 172.21.15.73:0/3840954232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7f40b80b0 0x7fc7f4141060 unknown :-1 s=CLOSED pgs=4218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.578+0000 7fc7f9578700 1 --2- 172.21.15.73:0/3840954232 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc7f406c340 0x7fc7f414a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.578+0000 7fc7f9578700 1 -- 172.21.15.73:0/3840954232 >> 172.21.15.73:0/3840954232 conn(0x7fc7f406a180 msgr2=0x7fc7f40b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:46.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.578+0000 7fc7f9578700 1 -- 172.21.15.73:0/3840954232 shutdown_connections 2023-11-30T23:27:46.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.578+0000 7fc7f9578700 1 -- 172.21.15.73:0/3840954232 wait complete. 2023-11-30T23:27:46.585 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-11-30T23:27:46.598 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":497,"stamp":"2023-11-30T23:27:44.670372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":275982203,"num_objects":743,"num_object_clones":28,"num_object_copies":1486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":743,"num_whiteouts":15,"num_read":1184,"num_read_kb":3541,"num_write":155907,"num_write_kb":668809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":540,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307605,"ondisk_log_size":307605,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2753952,"kb_used_data":543520,"kb_used_omap":0,"kb_used_meta":2210368,"kb_avail":752220768,"statfs":{"total":773094113280,"available":770274066432,"internally_reserved":0,"allocated":556564480,"data_stored":553942070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2263416832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,1,1,10,9,24,13],"upper_bound":256},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2058097,"num_objects":6,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":3,"num_read":6,"num_read_kb":7,"num_write":131,"num_write_kb":2089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.274157"},"pg_stats":[{"pgid":"3.3f","version":"48'3481","reported_seq":2875,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.507965+0000","last_change":"2023-11-30T23:27:40.777020+0000","last_active":"2023-11-30T23:27:41.507965+0000","last_peered":"2023-11-30T23:27:41.507965+0000","last_clean":"2023-11-30T23:27:41.507965+0000","last_became_active":"2023-11-30T23:12:47.512980+0000","last_became_peered":"2023-11-30T23:12:47.512980+0000","last_unstale":"2023-11-30T23:27:41.507965+0000","last_undegraded":"2023-11-30T23:27:41.507965+0000","last_fullsized":"2023-11-30T23:27:41.507965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:18:44.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0061607720000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1134,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3e","version":"48'3347","reported_seq":2773,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.552577+0000","last_change":"2023-11-30T23:27:40.483369+0000","last_active":"2023-11-30T23:27:41.552577+0000","last_peered":"2023-11-30T23:27:41.552577+0000","last_clean":"2023-11-30T23:27:41.552577+0000","last_became_active":"2023-11-30T23:12:47.508771+0000","last_became_peered":"2023-11-30T23:12:47.508771+0000","last_unstale":"2023-11-30T23:27:41.552577+0000","last_undegraded":"2023-11-30T23:27:41.552577+0000","last_fullsized":"2023-11-30T23:27:41.552577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3347,"log_dups_size":0,"ondisk_log_size":3347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055178039999999998,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1093,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3d","version":"48'3513","reported_seq":2913,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.509222+0000","last_change":"2023-11-30T23:27:40.561105+0000","last_active":"2023-11-30T23:27:41.509222+0000","last_peered":"2023-11-30T23:27:41.509222+0000","last_clean":"2023-11-30T23:27:41.509222+0000","last_became_active":"2023-11-30T23:12:47.507829+0000","last_became_peered":"2023-11-30T23:12:47.507829+0000","last_unstale":"2023-11-30T23:27:41.509222+0000","last_undegraded":"2023-11-30T23:27:41.509222+0000","last_fullsized":"2023-11-30T23:27:41.509222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3513,"log_dups_size":0,"ondisk_log_size":3513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:39.696562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031269901000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3c","version":"48'3599","reported_seq":2961,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.540422+0000","last_change":"2023-11-30T23:27:40.523535+0000","last_active":"2023-11-30T23:27:41.540422+0000","last_peered":"2023-11-30T23:27:41.540422+0000","last_clean":"2023-11-30T23:27:41.540422+0000","last_became_active":"2023-11-30T23:12:47.522208+0000","last_became_peered":"2023-11-30T23:12:47.522208+0000","last_unstale":"2023-11-30T23:27:41.540422+0000","last_undegraded":"2023-11-30T23:27:41.540422+0000","last_fullsized":"2023-11-30T23:27:41.540422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3599,"log_dups_size":0,"ondisk_log_size":3599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020703408,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3b","version":"48'3346","reported_seq":2724,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.454983+0000","last_change":"2023-11-30T23:27:40.475732+0000","last_active":"2023-11-30T23:27:41.454983+0000","last_peered":"2023-11-30T23:27:41.454983+0000","last_clean":"2023-11-30T23:27:41.454983+0000","last_became_active":"2023-11-30T23:13:30.302763+0000","last_became_peered":"2023-11-30T23:13:30.302763+0000","last_unstale":"2023-11-30T23:27:41.454983+0000","last_undegraded":"2023-11-30T23:27:41.454983+0000","last_fullsized":"2023-11-30T23:27:41.454983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3346,"log_dups_size":0,"ondisk_log_size":3346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:50:13.635575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047963988999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3a","version":"48'3402","reported_seq":2815,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.564969+0000","last_change":"2023-11-30T23:27:40.521728+0000","last_active":"2023-11-30T23:27:41.564969+0000","last_peered":"2023-11-30T23:27:41.564969+0000","last_clean":"2023-11-30T23:27:41.564969+0000","last_became_active":"2023-11-30T23:12:47.513491+0000","last_became_peered":"2023-11-30T23:12:47.513491+0000","last_unstale":"2023-11-30T23:27:41.564969+0000","last_undegraded":"2023-11-30T23:27:41.564969+0000","last_fullsized":"2023-11-30T23:27:41.564969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:18:44.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019296939999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.39","version":"48'3534","reported_seq":2940,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.521776+0000","last_change":"2023-11-30T23:27:40.773622+0000","last_active":"2023-11-30T23:27:41.521776+0000","last_peered":"2023-11-30T23:27:41.521776+0000","last_clean":"2023-11-30T23:27:41.521776+0000","last_became_active":"2023-11-30T23:12:47.507747+0000","last_became_peered":"2023-11-30T23:12:47.507747+0000","last_unstale":"2023-11-30T23:27:41.521776+0000","last_undegraded":"2023-11-30T23:27:41.521776+0000","last_fullsized":"2023-11-30T23:27:41.521776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3534,"log_dups_size":0,"ondisk_log_size":3534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:27.789422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0077627249999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.38","version":"48'3400","reported_seq":2784,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.559582+0000","last_change":"2023-11-30T23:27:40.523065+0000","last_active":"2023-11-30T23:27:41.559582+0000","last_peered":"2023-11-30T23:27:41.559582+0000","last_clean":"2023-11-30T23:27:41.559582+0000","last_became_active":"2023-11-30T23:12:47.523430+0000","last_became_peered":"2023-11-30T23:12:47.523430+0000","last_unstale":"2023-11-30T23:27:41.559582+0000","last_undegraded":"2023-11-30T23:27:41.559582+0000","last_fullsized":"2023-11-30T23:27:41.559582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3400,"log_dups_size":0,"ondisk_log_size":3400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:26:33.640383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023650336000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.37","version":"48'3724","reported_seq":3059,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.524998+0000","last_change":"2023-11-30T23:27:40.778901+0000","last_active":"2023-11-30T23:27:41.524998+0000","last_peered":"2023-11-30T23:27:41.524998+0000","last_clean":"2023-11-30T23:27:41.524998+0000","last_became_active":"2023-11-30T23:12:47.521393+0000","last_became_peered":"2023-11-30T23:12:47.521393+0000","last_unstale":"2023-11-30T23:27:41.524998+0000","last_undegraded":"2023-11-30T23:27:41.524998+0000","last_fullsized":"2023-11-30T23:27:41.524998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3724,"log_dups_size":0,"ondisk_log_size":3724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:23:17.254251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078674580000000008,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1228,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.36","version":"48'3647","reported_seq":3113,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.566188+0000","last_change":"2023-11-30T23:27:40.786256+0000","last_active":"2023-11-30T23:27:41.566188+0000","last_peered":"2023-11-30T23:27:41.566188+0000","last_clean":"2023-11-30T23:27:41.566188+0000","last_became_active":"2023-11-30T23:12:47.522618+0000","last_became_peered":"2023-11-30T23:12:47.522618+0000","last_unstale":"2023-11-30T23:27:41.566188+0000","last_undegraded":"2023-11-30T23:27:41.566188+0000","last_fullsized":"2023-11-30T23:27:41.566188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3647,"log_dups_size":0,"ondisk_log_size":3647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016421781999999999,"stat_sum":{"num_bytes":4110,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":1106,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.35","version":"48'3243","reported_seq":2730,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.542802+0000","last_change":"2023-11-30T23:27:40.786282+0000","last_active":"2023-11-30T23:27:41.542802+0000","last_peered":"2023-11-30T23:27:41.542802+0000","last_clean":"2023-11-30T23:27:41.542802+0000","last_became_active":"2023-11-30T23:13:30.304972+0000","last_became_peered":"2023-11-30T23:13:30.304972+0000","last_unstale":"2023-11-30T23:27:41.542802+0000","last_undegraded":"2023-11-30T23:27:41.542802+0000","last_fullsized":"2023-11-30T23:27:41.542802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3243,"log_dups_size":0,"ondisk_log_size":3243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:28:50.030806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016353854000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.34","version":"48'3479","reported_seq":2853,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.605834+0000","last_change":"2023-11-30T23:27:40.778402+0000","last_active":"2023-11-30T23:27:41.605834+0000","last_peered":"2023-11-30T23:27:41.605834+0000","last_clean":"2023-11-30T23:27:41.605834+0000","last_became_active":"2023-11-30T23:12:47.513401+0000","last_became_peered":"2023-11-30T23:12:47.513401+0000","last_unstale":"2023-11-30T23:27:41.605834+0000","last_undegraded":"2023-11-30T23:27:41.605834+0000","last_fullsized":"2023-11-30T23:27:41.605834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3479,"log_dups_size":0,"ondisk_log_size":3479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:22.086661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011359997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.33","version":"48'3375","reported_seq":2824,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.507105+0000","last_change":"2023-11-30T23:27:40.524064+0000","last_active":"2023-11-30T23:27:41.507105+0000","last_peered":"2023-11-30T23:27:41.507105+0000","last_clean":"2023-11-30T23:27:41.507105+0000","last_became_active":"2023-11-30T23:12:47.513714+0000","last_became_peered":"2023-11-30T23:12:47.513714+0000","last_unstale":"2023-11-30T23:27:41.507105+0000","last_undegraded":"2023-11-30T23:27:41.507105+0000","last_fullsized":"2023-11-30T23:27:41.507105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3375,"log_dups_size":0,"ondisk_log_size":3375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:20:31.102899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024370613999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1066,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.32","version":"48'3643","reported_seq":3000,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.495022+0000","last_change":"2023-11-30T23:27:40.553372+0000","last_active":"2023-11-30T23:27:41.495022+0000","last_peered":"2023-11-30T23:27:41.495022+0000","last_clean":"2023-11-30T23:27:41.495022+0000","last_became_active":"2023-11-30T23:12:47.506967+0000","last_became_peered":"2023-11-30T23:12:47.506967+0000","last_unstale":"2023-11-30T23:27:41.495022+0000","last_undegraded":"2023-11-30T23:27:41.495022+0000","last_fullsized":"2023-11-30T23:27:41.495022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3643,"log_dups_size":0,"ondisk_log_size":3643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025050587999999999,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.31","version":"48'3636","reported_seq":2966,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.543572+0000","last_change":"2023-11-30T23:27:40.490577+0000","last_active":"2023-11-30T23:27:41.543572+0000","last_peered":"2023-11-30T23:27:41.543572+0000","last_clean":"2023-11-30T23:27:41.543572+0000","last_became_active":"2023-11-30T23:12:47.513018+0000","last_became_peered":"2023-11-30T23:12:47.513018+0000","last_unstale":"2023-11-30T23:27:41.543572+0000","last_undegraded":"2023-11-30T23:27:41.543572+0000","last_fullsized":"2023-11-30T23:27:41.543572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3636,"log_dups_size":0,"ondisk_log_size":3636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059143527000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1251,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.30","version":"48'3670","reported_seq":3017,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.490898+0000","last_change":"2023-11-30T23:27:40.518027+0000","last_active":"2023-11-30T23:27:41.490898+0000","last_peered":"2023-11-30T23:27:41.490898+0000","last_clean":"2023-11-30T23:27:41.490898+0000","last_became_active":"2023-11-30T23:12:47.520518+0000","last_became_peered":"2023-11-30T23:12:47.520518+0000","last_unstale":"2023-11-30T23:27:41.490898+0000","last_undegraded":"2023-11-30T23:27:41.490898+0000","last_fullsized":"2023-11-30T23:27:41.490898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3670,"log_dups_size":0,"ondisk_log_size":3670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:27.789422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016206259000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2f","version":"48'3892","reported_seq":3186,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.543071+0000","last_change":"2023-11-30T23:27:40.522656+0000","last_active":"2023-11-30T23:27:41.543071+0000","last_peered":"2023-11-30T23:27:41.543071+0000","last_clean":"2023-11-30T23:27:41.543071+0000","last_became_active":"2023-11-30T23:12:47.516382+0000","last_became_peered":"2023-11-30T23:12:47.516382+0000","last_unstale":"2023-11-30T23:27:41.543071+0000","last_undegraded":"2023-11-30T23:27:41.543071+0000","last_fullsized":"2023-11-30T23:27:41.543071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:54:46.925262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020102808999999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2e","version":"48'3336","reported_seq":2814,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.542236+0000","last_change":"2023-11-30T23:27:40.437357+0000","last_active":"2023-11-30T23:27:41.542236+0000","last_peered":"2023-11-30T23:27:41.542236+0000","last_clean":"2023-11-30T23:27:41.542236+0000","last_became_active":"2023-11-30T23:12:47.509340+0000","last_became_peered":"2023-11-30T23:12:47.509340+0000","last_unstale":"2023-11-30T23:27:41.542236+0000","last_undegraded":"2023-11-30T23:27:41.542236+0000","last_fullsized":"2023-11-30T23:27:41.542236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3336,"log_dups_size":0,"ondisk_log_size":3336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:29.167074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0085862969999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1061,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2d","version":"48'3630","reported_seq":2999,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.551783+0000","last_change":"2023-11-30T23:27:40.776746+0000","last_active":"2023-11-30T23:27:41.551783+0000","last_peered":"2023-11-30T23:27:41.551783+0000","last_clean":"2023-11-30T23:27:41.551783+0000","last_became_active":"2023-11-30T23:12:47.506733+0000","last_became_peered":"2023-11-30T23:12:47.506733+0000","last_unstale":"2023-11-30T23:27:41.551783+0000","last_undegraded":"2023-11-30T23:27:41.551783+0000","last_fullsized":"2023-11-30T23:27:41.551783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3630,"log_dups_size":0,"ondisk_log_size":3630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010198370999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2c","version":"48'3600","reported_seq":2958,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.532354+0000","last_change":"2023-11-30T23:27:40.784471+0000","last_active":"2023-11-30T23:27:41.532354+0000","last_peered":"2023-11-30T23:27:41.532354+0000","last_clean":"2023-11-30T23:27:41.532354+0000","last_became_active":"2023-11-30T23:12:47.518819+0000","last_became_peered":"2023-11-30T23:12:47.518819+0000","last_unstale":"2023-11-30T23:27:41.532354+0000","last_undegraded":"2023-11-30T23:27:41.532354+0000","last_fullsized":"2023-11-30T23:27:41.532354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014700833,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2b","version":"48'3683","reported_seq":3063,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.589510+0000","last_change":"2023-11-30T23:27:40.567066+0000","last_active":"2023-11-30T23:27:41.589510+0000","last_peered":"2023-11-30T23:27:41.589510+0000","last_clean":"2023-11-30T23:27:41.589510+0000","last_became_active":"2023-11-30T23:12:47.514223+0000","last_became_peered":"2023-11-30T23:12:47.514223+0000","last_unstale":"2023-11-30T23:27:41.589510+0000","last_undegraded":"2023-11-30T23:27:41.589510+0000","last_fullsized":"2023-11-30T23:27:41.589510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3683,"log_dups_size":0,"ondisk_log_size":3683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:34:32.232378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036942162000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2a","version":"48'4029","reported_seq":3322,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.555237+0000","last_change":"2023-11-30T23:27:40.526135+0000","last_active":"2023-11-30T23:27:41.555237+0000","last_peered":"2023-11-30T23:27:41.555237+0000","last_clean":"2023-11-30T23:27:41.555237+0000","last_became_active":"2023-11-30T23:12:47.520228+0000","last_became_peered":"2023-11-30T23:12:47.520228+0000","last_unstale":"2023-11-30T23:27:41.555237+0000","last_undegraded":"2023-11-30T23:27:41.555237+0000","last_fullsized":"2023-11-30T23:27:41.555237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":4029,"log_dups_size":0,"ondisk_log_size":4029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:26:06.870586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023056817,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1244,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.29","version":"48'3705","reported_seq":3079,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.556013+0000","last_change":"2023-11-30T23:27:40.526288+0000","last_active":"2023-11-30T23:27:41.556013+0000","last_peered":"2023-11-30T23:27:41.556013+0000","last_clean":"2023-11-30T23:27:41.556013+0000","last_became_active":"2023-11-30T23:12:47.515247+0000","last_became_peered":"2023-11-30T23:12:47.515247+0000","last_unstale":"2023-11-30T23:27:41.556013+0000","last_undegraded":"2023-11-30T23:27:41.556013+0000","last_fullsized":"2023-11-30T23:27:41.556013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3705,"log_dups_size":0,"ondisk_log_size":3705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026511877,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.28","version":"48'3602","reported_seq":2953,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.491995+0000","last_change":"2023-11-30T23:27:40.526691+0000","last_active":"2023-11-30T23:27:41.491995+0000","last_peered":"2023-11-30T23:27:41.491995+0000","last_clean":"2023-11-30T23:27:41.491995+0000","last_became_active":"2023-11-30T23:12:47.511097+0000","last_became_peered":"2023-11-30T23:12:47.511097+0000","last_unstale":"2023-11-30T23:27:41.491995+0000","last_undegraded":"2023-11-30T23:27:41.491995+0000","last_fullsized":"2023-11-30T23:27:41.491995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023833039,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.27","version":"48'3199","reported_seq":2626,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.508825+0000","last_change":"2023-11-30T23:27:40.532323+0000","last_active":"2023-11-30T23:27:41.508825+0000","last_peered":"2023-11-30T23:27:41.508825+0000","last_clean":"2023-11-30T23:27:41.508825+0000","last_became_active":"2023-11-30T23:12:47.510404+0000","last_became_peered":"2023-11-30T23:12:47.510404+0000","last_unstale":"2023-11-30T23:27:41.508825+0000","last_undegraded":"2023-11-30T23:27:41.508825+0000","last_fullsized":"2023-11-30T23:27:41.508825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3199,"log_dups_size":0,"ondisk_log_size":3199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031984205000000002,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.26","version":"48'3855","reported_seq":3185,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.553421+0000","last_change":"2023-11-30T23:27:40.788046+0000","last_active":"2023-11-30T23:27:41.553421+0000","last_peered":"2023-11-30T23:27:41.553421+0000","last_clean":"2023-11-30T23:27:41.553421+0000","last_became_active":"2023-11-30T23:12:47.516539+0000","last_became_peered":"2023-11-30T23:12:47.516539+0000","last_unstale":"2023-11-30T23:27:41.553421+0000","last_undegraded":"2023-11-30T23:27:41.553421+0000","last_fullsized":"2023-11-30T23:27:41.553421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3855,"log_dups_size":0,"ondisk_log_size":3855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018080019999999999,"stat_sum":{"num_bytes":4105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.25","version":"48'3361","reported_seq":2773,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.550930+0000","last_change":"2023-11-30T23:27:40.486640+0000","last_active":"2023-11-30T23:27:41.550930+0000","last_peered":"2023-11-30T23:27:41.550930+0000","last_clean":"2023-11-30T23:27:41.550930+0000","last_became_active":"2023-11-30T23:12:47.506284+0000","last_became_peered":"2023-11-30T23:12:47.506284+0000","last_unstale":"2023-11-30T23:27:41.550930+0000","last_undegraded":"2023-11-30T23:27:41.550930+0000","last_fullsized":"2023-11-30T23:27:41.550930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3361,"log_dups_size":0,"ondisk_log_size":3361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058342590999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.24","version":"48'3356","reported_seq":2745,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.586450+0000","last_change":"2023-11-30T23:27:40.535487+0000","last_active":"2023-11-30T23:27:41.586450+0000","last_peered":"2023-11-30T23:27:41.586450+0000","last_clean":"2023-11-30T23:27:41.586450+0000","last_became_active":"2023-11-30T23:12:47.511800+0000","last_became_peered":"2023-11-30T23:12:47.511800+0000","last_unstale":"2023-11-30T23:27:41.586450+0000","last_undegraded":"2023-11-30T23:27:41.586450+0000","last_fullsized":"2023-11-30T23:27:41.586450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3356,"log_dups_size":0,"ondisk_log_size":3356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034899355,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1130,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.23","version":"48'3593","reported_seq":3000,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.582018+0000","last_change":"2023-11-30T23:27:40.562740+0000","last_active":"2023-11-30T23:27:41.582018+0000","last_peered":"2023-11-30T23:27:41.582018+0000","last_clean":"2023-11-30T23:27:41.582018+0000","last_became_active":"2023-11-30T23:12:47.512978+0000","last_became_peered":"2023-11-30T23:12:47.512978+0000","last_unstale":"2023-11-30T23:27:41.582018+0000","last_undegraded":"2023-11-30T23:27:41.582018+0000","last_fullsized":"2023-11-30T23:27:41.582018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3593,"log_dups_size":0,"ondisk_log_size":3593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032442869999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1122,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.22","version":"48'3350","reported_seq":2778,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.539520+0000","last_change":"2023-11-30T23:27:40.524098+0000","last_active":"2023-11-30T23:27:41.539520+0000","last_peered":"2023-11-30T23:27:41.539520+0000","last_clean":"2023-11-30T23:27:41.539520+0000","last_became_active":"2023-11-30T23:12:47.511699+0000","last_became_peered":"2023-11-30T23:12:47.511699+0000","last_unstale":"2023-11-30T23:27:41.539520+0000","last_undegraded":"2023-11-30T23:27:41.539520+0000","last_fullsized":"2023-11-30T23:27:41.539520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3350,"log_dups_size":0,"ondisk_log_size":3350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021133078,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.21","version":"48'4043","reported_seq":3292,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.508821+0000","last_change":"2023-11-30T23:27:40.435514+0000","last_active":"2023-11-30T23:27:41.508821+0000","last_peered":"2023-11-30T23:27:41.508821+0000","last_clean":"2023-11-30T23:27:41.508821+0000","last_became_active":"2023-11-30T23:12:47.521604+0000","last_became_peered":"2023-11-30T23:12:47.521604+0000","last_unstale":"2023-11-30T23:27:41.508821+0000","last_undegraded":"2023-11-30T23:27:41.508821+0000","last_fullsized":"2023-11-30T23:27:41.508821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":4043,"log_dups_size":0,"ondisk_log_size":4043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:02.220181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081020610000000007,"stat_sum":{"num_bytes":4121,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1336,"num_write_kb":721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.20","version":"48'3908","reported_seq":3229,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.519616+0000","last_change":"2023-11-30T23:27:40.784516+0000","last_active":"2023-11-30T23:27:41.519616+0000","last_peered":"2023-11-30T23:27:41.519616+0000","last_clean":"2023-11-30T23:27:41.519616+0000","last_became_active":"2023-11-30T23:12:47.517283+0000","last_became_peered":"2023-11-30T23:12:47.517283+0000","last_unstale":"2023-11-30T23:27:41.519616+0000","last_undegraded":"2023-11-30T23:27:41.519616+0000","last_fullsized":"2023-11-30T23:27:41.519616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3908,"log_dups_size":0,"ondisk_log_size":3908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016665117,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1a","version":"48'3480","reported_seq":2876,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.528598+0000","last_change":"2023-11-30T23:27:40.776963+0000","last_active":"2023-11-30T23:27:41.528598+0000","last_peered":"2023-11-30T23:27:41.528598+0000","last_clean":"2023-11-30T23:27:41.528598+0000","last_became_active":"2023-11-30T23:12:47.508725+0000","last_became_peered":"2023-11-30T23:12:47.508725+0000","last_unstale":"2023-11-30T23:27:41.528598+0000","last_undegraded":"2023-11-30T23:27:41.528598+0000","last_fullsized":"2023-11-30T23:27:41.528598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3480,"log_dups_size":0,"ondisk_log_size":3480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:54.893320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010267352,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1134,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1b","version":"43'3981","reported_seq":4025,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.721302+0000","last_change":"2023-11-30T23:12:47.139071+0000","last_active":"2023-11-30T23:27:39.721302+0000","last_peered":"2023-11-30T23:27:39.721302+0000","last_clean":"2023-11-30T23:27:39.721302+0000","last_became_active":"2023-11-30T23:12:47.138768+0000","last_became_peered":"2023-11-30T23:12:47.138768+0000","last_unstale":"2023-11-30T23:27:39.721302+0000","last_undegraded":"2023-11-30T23:27:39.721302+0000","last_fullsized":"2023-11-30T23:27:39.721302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3981,"log_dups_size":0,"ondisk_log_size":3981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":4054,"num_write_kb":19067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"48'3595","reported_seq":2987,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.585088+0000","last_change":"2023-11-30T23:27:40.568024+0000","last_active":"2023-11-30T23:27:41.585088+0000","last_peered":"2023-11-30T23:27:41.585088+0000","last_clean":"2023-11-30T23:27:41.585088+0000","last_became_active":"2023-11-30T23:12:47.516214+0000","last_became_peered":"2023-11-30T23:12:47.516214+0000","last_unstale":"2023-11-30T23:27:41.585088+0000","last_undegraded":"2023-11-30T23:27:41.585088+0000","last_fullsized":"2023-11-30T23:27:41.585088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037604525,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1a","version":"48'4545","reported_seq":4589,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.794216+0000","last_change":"2023-11-30T23:12:47.130416+0000","last_active":"2023-11-30T23:27:41.794216+0000","last_peered":"2023-11-30T23:27:41.794216+0000","last_clean":"2023-11-30T23:27:41.794216+0000","last_became_active":"2023-11-30T23:12:47.129771+0000","last_became_peered":"2023-11-30T23:12:47.129771+0000","last_unstale":"2023-11-30T23:27:41.794216+0000","last_undegraded":"2023-11-30T23:27:41.794216+0000","last_fullsized":"2023-11-30T23:27:41.794216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4545,"log_dups_size":0,"ondisk_log_size":4545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7852113,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":4619,"num_write_kb":33825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"41'851","reported_seq":896,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.716599+0000","last_change":"2023-11-30T23:12:47.133733+0000","last_active":"2023-11-30T23:27:39.716599+0000","last_peered":"2023-11-30T23:27:39.716599+0000","last_clean":"2023-11-30T23:27:39.716599+0000","last_became_active":"2023-11-30T23:12:47.133440+0000","last_became_peered":"2023-11-30T23:12:47.133440+0000","last_unstale":"2023-11-30T23:27:39.716599+0000","last_undegraded":"2023-11-30T23:27:39.716599+0000","last_fullsized":"2023-11-30T23:27:39.716599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:48.913175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":928,"num_write_kb":12986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"48'3961","reported_seq":3213,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.571914+0000","last_change":"2023-11-30T23:27:40.521787+0000","last_active":"2023-11-30T23:27:41.571914+0000","last_peered":"2023-11-30T23:27:41.571914+0000","last_clean":"2023-11-30T23:27:41.571914+0000","last_became_active":"2023-11-30T23:12:47.507617+0000","last_became_peered":"2023-11-30T23:12:47.507617+0000","last_unstale":"2023-11-30T23:27:41.571914+0000","last_undegraded":"2023-11-30T23:27:41.571914+0000","last_fullsized":"2023-11-30T23:27:41.571914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3961,"log_dups_size":0,"ondisk_log_size":3961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:08:47.117163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022313091,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1298,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.18","version":"42'3803","reported_seq":3848,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.379869+0000","last_change":"2023-11-30T23:12:47.132638+0000","last_active":"2023-11-30T23:27:40.379869+0000","last_peered":"2023-11-30T23:27:40.379869+0000","last_clean":"2023-11-30T23:27:40.379869+0000","last_became_active":"2023-11-30T23:12:47.132351+0000","last_became_peered":"2023-11-30T23:12:47.132351+0000","last_unstale":"2023-11-30T23:27:40.379869+0000","last_undegraded":"2023-11-30T23:27:40.379869+0000","last_fullsized":"2023-11-30T23:27:40.379869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3803,"log_dups_size":0,"ondisk_log_size":3803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":3859,"num_write_kb":38490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"48'3665","reported_seq":3062,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.554274+0000","last_change":"2023-11-30T23:27:40.479741+0000","last_active":"2023-11-30T23:27:41.554274+0000","last_peered":"2023-11-30T23:27:41.554274+0000","last_clean":"2023-11-30T23:27:41.554274+0000","last_became_active":"2023-11-30T23:12:47.506082+0000","last_became_peered":"2023-11-30T23:12:47.506082+0000","last_unstale":"2023-11-30T23:27:41.554274+0000","last_undegraded":"2023-11-30T23:27:41.554274+0000","last_fullsized":"2023-11-30T23:27:41.554274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052118631999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.17","version":"43'1096","reported_seq":1141,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.687772+0000","last_change":"2023-11-30T23:12:47.139722+0000","last_active":"2023-11-30T23:27:39.687772+0000","last_peered":"2023-11-30T23:27:39.687772+0000","last_clean":"2023-11-30T23:27:39.687772+0000","last_became_active":"2023-11-30T23:12:47.139400+0000","last_became_peered":"2023-11-30T23:12:47.139400+0000","last_unstale":"2023-11-30T23:27:39.687772+0000","last_undegraded":"2023-11-30T23:27:39.687772+0000","last_fullsized":"2023-11-30T23:27:39.687772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1096,"log_dups_size":0,"ondisk_log_size":1096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":1152,"num_write_kb":13161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"48'3679","reported_seq":3043,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.532898+0000","last_change":"2023-11-30T23:27:40.435297+0000","last_active":"2023-11-30T23:27:41.532898+0000","last_peered":"2023-11-30T23:27:41.532898+0000","last_clean":"2023-11-30T23:27:41.532898+0000","last_became_active":"2023-11-30T23:13:30.596915+0000","last_became_peered":"2023-11-30T23:13:30.596915+0000","last_unstale":"2023-11-30T23:27:41.532898+0000","last_undegraded":"2023-11-30T23:27:41.532898+0000","last_fullsized":"2023-11-30T23:27:41.532898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3679,"log_dups_size":0,"ondisk_log_size":3679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:51:12.828715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066900809999999996,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.16","version":"48'1872","reported_seq":1917,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.502065+0000","last_change":"2023-11-30T23:12:47.139328+0000","last_active":"2023-11-30T23:27:40.502065+0000","last_peered":"2023-11-30T23:27:40.502065+0000","last_clean":"2023-11-30T23:27:40.502065+0000","last_became_active":"2023-11-30T23:12:47.139047+0000","last_became_peered":"2023-11-30T23:12:47.139047+0000","last_unstale":"2023-11-30T23:27:40.502065+0000","last_undegraded":"2023-11-30T23:27:40.502065+0000","last_fullsized":"2023-11-30T23:27:40.502065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1872,"log_dups_size":0,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":1932,"num_write_kb":25642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"48'3570","reported_seq":2951,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.513410+0000","last_change":"2023-11-30T23:27:40.558523+0000","last_active":"2023-11-30T23:27:41.513410+0000","last_peered":"2023-11-30T23:27:41.513410+0000","last_clean":"2023-11-30T23:27:41.513410+0000","last_became_active":"2023-11-30T23:12:47.522711+0000","last_became_peered":"2023-11-30T23:12:47.522711+0000","last_unstale":"2023-11-30T23:27:41.513410+0000","last_undegraded":"2023-11-30T23:27:41.513410+0000","last_fullsized":"2023-11-30T23:27:41.513410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:19:43.387626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.028725985999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.15","version":"48'3057","reported_seq":3102,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.616806+0000","last_change":"2023-11-30T23:12:47.140794+0000","last_active":"2023-11-30T23:27:41.616806+0000","last_peered":"2023-11-30T23:27:41.616806+0000","last_clean":"2023-11-30T23:27:41.616806+0000","last_became_active":"2023-11-30T23:12:47.140531+0000","last_became_peered":"2023-11-30T23:12:47.140531+0000","last_unstale":"2023-11-30T23:27:41.616806+0000","last_undegraded":"2023-11-30T23:27:41.616806+0000","last_fullsized":"2023-11-30T23:27:41.616806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3057,"log_dups_size":0,"ondisk_log_size":3057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:53.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":3128,"num_write_kb":22065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"48'3770","reported_seq":3130,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.604302+0000","last_change":"2023-11-30T23:27:40.777802+0000","last_active":"2023-11-30T23:27:41.604302+0000","last_peered":"2023-11-30T23:27:41.604302+0000","last_clean":"2023-11-30T23:27:41.604302+0000","last_became_active":"2023-11-30T23:12:47.513983+0000","last_became_peered":"2023-11-30T23:12:47.513983+0000","last_unstale":"2023-11-30T23:27:41.604302+0000","last_undegraded":"2023-11-30T23:27:41.604302+0000","last_fullsized":"2023-11-30T23:27:41.604302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3770,"log_dups_size":0,"ondisk_log_size":3770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:39.696562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010376995,"stat_sum":{"num_bytes":9,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1166,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.14","version":"48'3844","reported_seq":3889,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.769905+0000","last_change":"2023-11-30T23:12:47.140168+0000","last_active":"2023-11-30T23:27:40.769905+0000","last_peered":"2023-11-30T23:27:40.769905+0000","last_clean":"2023-11-30T23:27:40.769905+0000","last_became_active":"2023-11-30T23:12:47.139799+0000","last_became_peered":"2023-11-30T23:12:47.139799+0000","last_unstale":"2023-11-30T23:27:40.769905+0000","last_undegraded":"2023-11-30T23:27:40.769905+0000","last_fullsized":"2023-11-30T23:27:40.769905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3844,"log_dups_size":0,"ondisk_log_size":3844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":3910,"num_write_kb":30388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"48'3523","reported_seq":2900,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.550105+0000","last_change":"2023-11-30T23:27:40.772832+0000","last_active":"2023-11-30T23:27:41.550105+0000","last_peered":"2023-11-30T23:27:41.550105+0000","last_clean":"2023-11-30T23:27:41.550105+0000","last_became_active":"2023-11-30T23:12:47.503333+0000","last_became_peered":"2023-11-30T23:12:47.503333+0000","last_unstale":"2023-11-30T23:27:41.550105+0000","last_undegraded":"2023-11-30T23:27:41.550105+0000","last_fullsized":"2023-11-30T23:27:41.550105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3523,"log_dups_size":0,"ondisk_log_size":3523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070303589999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.13","version":"41'1920","reported_seq":1965,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.521393+0000","last_change":"2023-11-30T23:12:47.136931+0000","last_active":"2023-11-30T23:27:39.521393+0000","last_peered":"2023-11-30T23:27:39.521393+0000","last_clean":"2023-11-30T23:27:39.521393+0000","last_became_active":"2023-11-30T23:12:47.136620+0000","last_became_peered":"2023-11-30T23:12:47.136620+0000","last_unstale":"2023-11-30T23:27:39.521393+0000","last_undegraded":"2023-11-30T23:27:39.521393+0000","last_fullsized":"2023-11-30T23:27:39.521393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1920,"log_dups_size":0,"ondisk_log_size":1920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:22:43.069951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":2012,"num_write_kb":17264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"48'3603","reported_seq":2975,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.494947+0000","last_change":"2023-11-30T23:27:40.557057+0000","last_active":"2023-11-30T23:27:41.494947+0000","last_peered":"2023-11-30T23:27:41.494947+0000","last_clean":"2023-11-30T23:27:41.494947+0000","last_became_active":"2023-11-30T23:12:47.503294+0000","last_became_peered":"2023-11-30T23:12:47.503294+0000","last_unstale":"2023-11-30T23:27:41.494947+0000","last_undegraded":"2023-11-30T23:27:41.494947+0000","last_fullsized":"2023-11-30T23:27:41.494947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3603,"log_dups_size":0,"ondisk_log_size":3603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.028538382000000001,"stat_sum":{"num_bytes":8235,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1203,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.12","version":"44'82","reported_seq":127,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.377591+0000","last_change":"2023-11-30T23:12:47.140575+0000","last_active":"2023-11-30T23:27:40.377591+0000","last_peered":"2023-11-30T23:27:40.377591+0000","last_clean":"2023-11-30T23:27:40.377591+0000","last_became_active":"2023-11-30T23:12:47.140125+0000","last_became_peered":"2023-11-30T23:12:47.140125+0000","last_unstale":"2023-11-30T23:27:40.377591+0000","last_undegraded":"2023-11-30T23:27:40.377591+0000","last_fullsized":"2023-11-30T23:27:40.377591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":140,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"48'3957","reported_seq":3285,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.497842+0000","last_change":"2023-11-30T23:27:40.777472+0000","last_active":"2023-11-30T23:27:41.497842+0000","last_peered":"2023-11-30T23:27:41.497842+0000","last_clean":"2023-11-30T23:27:41.497842+0000","last_became_active":"2023-11-30T23:12:47.515427+0000","last_became_peered":"2023-11-30T23:12:47.515427+0000","last_unstale":"2023-11-30T23:27:41.497842+0000","last_undegraded":"2023-11-30T23:27:41.497842+0000","last_fullsized":"2023-11-30T23:27:41.497842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3957,"log_dups_size":0,"ondisk_log_size":3957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:26:06.870586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066010289999999996,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.11","version":"41'1117","reported_seq":1162,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.686919+0000","last_change":"2023-11-30T23:12:47.129492+0000","last_active":"2023-11-30T23:27:39.686919+0000","last_peered":"2023-11-30T23:27:39.686919+0000","last_clean":"2023-11-30T23:27:39.686919+0000","last_became_active":"2023-11-30T23:12:47.129180+0000","last_became_peered":"2023-11-30T23:12:47.129180+0000","last_unstale":"2023-11-30T23:27:39.686919+0000","last_undegraded":"2023-11-30T23:27:39.686919+0000","last_fullsized":"2023-11-30T23:27:39.686919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1117,"log_dups_size":0,"ondisk_log_size":1117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":1162,"num_write_kb":9042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"48'3496","reported_seq":2885,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.525719+0000","last_change":"2023-11-30T23:27:40.782626+0000","last_active":"2023-11-30T23:27:41.525719+0000","last_peered":"2023-11-30T23:27:41.525719+0000","last_clean":"2023-11-30T23:27:41.525719+0000","last_became_active":"2023-11-30T23:12:47.516980+0000","last_became_peered":"2023-11-30T23:12:47.516980+0000","last_unstale":"2023-11-30T23:27:41.525719+0000","last_undegraded":"2023-11-30T23:27:41.525719+0000","last_fullsized":"2023-11-30T23:27:41.525719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3496,"log_dups_size":0,"ondisk_log_size":3496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014912678,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.10","version":"44'1300","reported_seq":1345,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.414975+0000","last_change":"2023-11-30T23:12:47.129703+0000","last_active":"2023-11-30T23:27:39.414975+0000","last_peered":"2023-11-30T23:27:39.414975+0000","last_clean":"2023-11-30T23:27:39.414975+0000","last_became_active":"2023-11-30T23:12:47.129349+0000","last_became_peered":"2023-11-30T23:12:47.129349+0000","last_unstale":"2023-11-30T23:27:39.414975+0000","last_undegraded":"2023-11-30T23:27:39.414975+0000","last_fullsized":"2023-11-30T23:27:39.414975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1300,"log_dups_size":0,"ondisk_log_size":1300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":1371,"num_write_kb":13381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"48'3743","reported_seq":3063,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.519400+0000","last_change":"2023-11-30T23:27:40.775036+0000","last_active":"2023-11-30T23:27:41.519400+0000","last_peered":"2023-11-30T23:27:41.519400+0000","last_clean":"2023-11-30T23:27:41.519400+0000","last_became_active":"2023-11-30T23:12:47.514140+0000","last_became_peered":"2023-11-30T23:12:47.514140+0000","last_unstale":"2023-11-30T23:27:41.519400+0000","last_undegraded":"2023-11-30T23:27:41.519400+0000","last_fullsized":"2023-11-30T23:27:41.519400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3743,"log_dups_size":0,"ondisk_log_size":3743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:54:46.925262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0087768900000000007,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1241,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.f","version":"48'1098","reported_seq":1143,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.768358+0000","last_change":"2023-11-30T23:12:47.136924+0000","last_active":"2023-11-30T23:27:40.768358+0000","last_peered":"2023-11-30T23:27:40.768358+0000","last_clean":"2023-11-30T23:27:40.768358+0000","last_became_active":"2023-11-30T23:12:47.136631+0000","last_became_peered":"2023-11-30T23:12:47.136631+0000","last_unstale":"2023-11-30T23:27:40.768358+0000","last_undegraded":"2023-11-30T23:27:40.768358+0000","last_fullsized":"2023-11-30T23:27:40.768358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1098,"log_dups_size":0,"ondisk_log_size":1098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:22:48.835054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":1176,"num_write_kb":13385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"48'3434","reported_seq":2834,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.454960+0000","last_change":"2023-11-30T23:27:40.773928+0000","last_active":"2023-11-30T23:27:41.454960+0000","last_peered":"2023-11-30T23:27:41.454960+0000","last_clean":"2023-11-30T23:27:41.454960+0000","last_became_active":"2023-11-30T23:12:47.514053+0000","last_became_peered":"2023-11-30T23:12:47.514053+0000","last_unstale":"2023-11-30T23:27:41.454960+0000","last_undegraded":"2023-11-30T23:27:41.454960+0000","last_fullsized":"2023-11-30T23:27:41.454960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0080231629999999998,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.e","version":"48'2035","reported_seq":2080,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.429021+0000","last_change":"2023-11-30T23:12:47.138008+0000","last_active":"2023-11-30T23:27:40.429021+0000","last_peered":"2023-11-30T23:27:40.429021+0000","last_clean":"2023-11-30T23:27:40.429021+0000","last_became_active":"2023-11-30T23:12:47.137695+0000","last_became_peered":"2023-11-30T23:12:47.137695+0000","last_unstale":"2023-11-30T23:27:40.429021+0000","last_undegraded":"2023-11-30T23:27:40.429021+0000","last_fullsized":"2023-11-30T23:27:40.429021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":2104,"num_write_kb":13092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"48'3567","reported_seq":2928,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.459047+0000","last_change":"2023-11-30T23:27:40.778859+0000","last_active":"2023-11-30T23:27:41.459047+0000","last_peered":"2023-11-30T23:27:41.459047+0000","last_clean":"2023-11-30T23:27:41.459047+0000","last_became_active":"2023-11-30T23:12:47.514822+0000","last_became_peered":"2023-11-30T23:12:47.514822+0000","last_unstale":"2023-11-30T23:27:41.459047+0000","last_undegraded":"2023-11-30T23:27:41.459047+0000","last_fullsized":"2023-11-30T23:27:41.459047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3567,"log_dups_size":0,"ondisk_log_size":3567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:02:36.020857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076646960000000004,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.d","version":"43'4595","reported_seq":4640,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.993417+0000","last_change":"2023-11-30T23:12:47.129184+0000","last_active":"2023-11-30T23:27:39.993417+0000","last_peered":"2023-11-30T23:27:39.993417+0000","last_clean":"2023-11-30T23:27:39.993417+0000","last_became_active":"2023-11-30T23:12:47.128682+0000","last_became_peered":"2023-11-30T23:12:47.128682+0000","last_unstale":"2023-11-30T23:27:39.993417+0000","last_undegraded":"2023-11-30T23:27:39.993417+0000","last_fullsized":"2023-11-30T23:27:39.993417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4595,"log_dups_size":0,"ondisk_log_size":4595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583127,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":4657,"num_write_kb":26783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"48'3659","reported_seq":2964,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.538071+0000","last_change":"2023-11-30T23:27:40.521110+0000","last_active":"2023-11-30T23:27:41.538071+0000","last_peered":"2023-11-30T23:27:41.538071+0000","last_clean":"2023-11-30T23:27:41.538071+0000","last_became_active":"2023-11-30T23:12:47.516317+0000","last_became_peered":"2023-11-30T23:12:47.516317+0000","last_unstale":"2023-11-30T23:27:41.538071+0000","last_undegraded":"2023-11-30T23:27:41.538071+0000","last_fullsized":"2023-11-30T23:27:41.538071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3659,"log_dups_size":0,"ondisk_log_size":3659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:20:31.102899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018738761999999999,"stat_sum":{"num_bytes":16384,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1262,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.c","version":"48'4363","reported_seq":4408,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.428422+0000","last_change":"2023-11-30T23:12:47.140679+0000","last_active":"2023-11-30T23:27:40.428422+0000","last_peered":"2023-11-30T23:27:40.428422+0000","last_clean":"2023-11-30T23:27:40.428422+0000","last_became_active":"2023-11-30T23:12:47.140400+0000","last_became_peered":"2023-11-30T23:12:47.140400+0000","last_unstale":"2023-11-30T23:27:40.428422+0000","last_undegraded":"2023-11-30T23:27:40.428422+0000","last_fullsized":"2023-11-30T23:27:40.428422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4363,"log_dups_size":0,"ondisk_log_size":4363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4418,"num_write_kb":27644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"48'3509","reported_seq":2933,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.557081+0000","last_change":"2023-11-30T23:27:40.776512+0000","last_active":"2023-11-30T23:27:41.557081+0000","last_peered":"2023-11-30T23:27:41.557081+0000","last_clean":"2023-11-30T23:27:41.557081+0000","last_became_active":"2023-11-30T23:12:47.521481+0000","last_became_peered":"2023-11-30T23:12:47.521481+0000","last_unstale":"2023-11-30T23:27:41.557081+0000","last_undegraded":"2023-11-30T23:27:41.557081+0000","last_fullsized":"2023-11-30T23:27:41.557081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3509,"log_dups_size":0,"ondisk_log_size":3509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:17:01.774183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010302225,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1071,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.408367+0000","last_change":"2023-11-30T23:12:36.558633+0000","last_active":"2023-11-30T23:27:39.408367+0000","last_peered":"2023-11-30T23:27:39.408367+0000","last_clean":"2023-11-30T23:27:39.408367+0000","last_became_active":"2023-11-30T23:12:36.556455+0000","last_became_peered":"2023-11-30T23:12:36.556455+0000","last_unstale":"2023-11-30T23:27:39.408367+0000","last_undegraded":"2023-11-30T23:27:39.408367+0000","last_fullsized":"2023-11-30T23:27:39.408367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:34.652815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:34.652815+0000","last_clean_scrub_stamp":"2023-11-30T23:12:34.652815+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:36:52.941511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"48'933","reported_seq":979,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.501554+0000","last_change":"2023-11-30T23:12:47.132985+0000","last_active":"2023-11-30T23:27:40.501554+0000","last_peered":"2023-11-30T23:27:40.501554+0000","last_clean":"2023-11-30T23:27:40.501554+0000","last_became_active":"2023-11-30T23:12:47.132365+0000","last_became_peered":"2023-11-30T23:12:47.132365+0000","last_unstale":"2023-11-30T23:27:40.501554+0000","last_undegraded":"2023-11-30T23:27:40.501554+0000","last_fullsized":"2023-11-30T23:27:40.501554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":1011,"num_write_kb":13216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"48'3463","reported_seq":2898,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.529496+0000","last_change":"2023-11-30T23:27:40.529546+0000","last_active":"2023-11-30T23:27:41.529496+0000","last_peered":"2023-11-30T23:27:41.529496+0000","last_clean":"2023-11-30T23:27:41.529496+0000","last_became_active":"2023-11-30T23:12:47.508677+0000","last_became_peered":"2023-11-30T23:12:47.508677+0000","last_unstale":"2023-11-30T23:27:41.529496+0000","last_undegraded":"2023-11-30T23:27:41.529496+0000","last_fullsized":"2023-11-30T23:27:41.529496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3463,"log_dups_size":0,"ondisk_log_size":3463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029660272000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1097,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.0","version":"43'3512","reported_seq":3558,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.408442+0000","last_change":"2023-11-30T23:12:47.148775+0000","last_active":"2023-11-30T23:27:39.408442+0000","last_peered":"2023-11-30T23:27:39.408442+0000","last_clean":"2023-11-30T23:27:39.408442+0000","last_became_active":"2023-11-30T23:12:47.148547+0000","last_became_peered":"2023-11-30T23:12:47.148547+0000","last_unstale":"2023-11-30T23:27:39.408442+0000","last_undegraded":"2023-11-30T23:27:39.408442+0000","last_fullsized":"2023-11-30T23:27:39.408442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3512,"log_dups_size":0,"ondisk_log_size":3512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:01.207700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":3602,"num_write_kb":26128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"48'3481","reported_seq":2873,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.532387+0000","last_change":"2023-11-30T23:27:40.549560+0000","last_active":"2023-11-30T23:27:41.532387+0000","last_peered":"2023-11-30T23:27:41.532387+0000","last_clean":"2023-11-30T23:27:41.532387+0000","last_became_active":"2023-11-30T23:12:47.515553+0000","last_became_peered":"2023-11-30T23:12:47.515553+0000","last_unstale":"2023-11-30T23:27:41.532387+0000","last_undegraded":"2023-11-30T23:27:41.532387+0000","last_fullsized":"2023-11-30T23:27:41.532387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:22.086661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021186228000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1162,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1","version":"48'2695","reported_seq":3256,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:42.508476+0000","last_change":"2023-11-30T23:12:47.136018+0000","last_active":"2023-11-30T23:27:42.508476+0000","last_peered":"2023-11-30T23:27:42.508476+0000","last_clean":"2023-11-30T23:27:42.508476+0000","last_became_active":"2023-11-30T23:12:47.135746+0000","last_became_peered":"2023-11-30T23:12:47.135746+0000","last_unstale":"2023-11-30T23:27:42.508476+0000","last_undegraded":"2023-11-30T23:27:42.508476+0000","last_fullsized":"2023-11-30T23:27:42.508476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2695,"log_dups_size":0,"ondisk_log_size":2695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3169767,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":530,"num_read_kb":3420,"num_write":2759,"num_write_kb":16501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"48'3593","reported_seq":2961,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.478806+0000","last_change":"2023-11-30T23:27:40.472409+0000","last_active":"2023-11-30T23:27:41.478806+0000","last_peered":"2023-11-30T23:27:41.478806+0000","last_clean":"2023-11-30T23:27:41.478806+0000","last_became_active":"2023-11-30T23:12:47.510024+0000","last_became_peered":"2023-11-30T23:12:47.510024+0000","last_unstale":"2023-11-30T23:27:41.478806+0000","last_undegraded":"2023-11-30T23:27:41.478806+0000","last_fullsized":"2023-11-30T23:27:41.478806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3593,"log_dups_size":0,"ondisk_log_size":3593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045211289000000002,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.2","version":"48'4582","reported_seq":4628,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.513804+0000","last_change":"2023-11-30T23:12:47.141605+0000","last_active":"2023-11-30T23:27:40.513804+0000","last_peered":"2023-11-30T23:27:40.513804+0000","last_clean":"2023-11-30T23:27:40.513804+0000","last_became_active":"2023-11-30T23:12:47.141115+0000","last_became_peered":"2023-11-30T23:12:47.141115+0000","last_unstale":"2023-11-30T23:27:40.513804+0000","last_undegraded":"2023-11-30T23:27:40.513804+0000","last_fullsized":"2023-11-30T23:27:40.513804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4582,"log_dups_size":0,"ondisk_log_size":4582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":4625,"num_write_kb":30671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"48'3767","reported_seq":3095,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.547202+0000","last_change":"2023-11-30T23:27:40.778459+0000","last_active":"2023-11-30T23:27:41.547202+0000","last_peered":"2023-11-30T23:27:41.547202+0000","last_clean":"2023-11-30T23:27:41.547202+0000","last_became_active":"2023-11-30T23:12:47.514572+0000","last_became_peered":"2023-11-30T23:12:47.514572+0000","last_unstale":"2023-11-30T23:27:41.547202+0000","last_undegraded":"2023-11-30T23:27:41.547202+0000","last_fullsized":"2023-11-30T23:27:41.547202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3767,"log_dups_size":0,"ondisk_log_size":3767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:29.167074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010674993000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.4","version":"41'153","reported_seq":199,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.992465+0000","last_change":"2023-11-30T23:12:47.141801+0000","last_active":"2023-11-30T23:27:39.992465+0000","last_peered":"2023-11-30T23:27:39.992465+0000","last_clean":"2023-11-30T23:27:39.992465+0000","last_became_active":"2023-11-30T23:12:47.141411+0000","last_became_peered":"2023-11-30T23:12:47.141411+0000","last_unstale":"2023-11-30T23:27:39.992465+0000","last_undegraded":"2023-11-30T23:27:39.992465+0000","last_fullsized":"2023-11-30T23:27:39.992465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":238,"num_write_kb":8770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"48'3575","reported_seq":2929,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.503471+0000","last_change":"2023-11-30T23:27:40.519690+0000","last_active":"2023-11-30T23:27:41.503471+0000","last_peered":"2023-11-30T23:27:41.503471+0000","last_clean":"2023-11-30T23:27:41.503471+0000","last_became_active":"2023-11-30T23:13:30.305367+0000","last_became_peered":"2023-11-30T23:13:30.305367+0000","last_unstale":"2023-11-30T23:27:41.503471+0000","last_undegraded":"2023-11-30T23:27:41.503471+0000","last_fullsized":"2023-11-30T23:27:41.503471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3575,"log_dups_size":0,"ondisk_log_size":3575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:54:08.569710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017828157000000001,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.5","version":"48'2056","reported_seq":2102,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.771097+0000","last_change":"2023-11-30T23:12:47.143317+0000","last_active":"2023-11-30T23:27:40.771097+0000","last_peered":"2023-11-30T23:27:40.771097+0000","last_clean":"2023-11-30T23:27:40.771097+0000","last_became_active":"2023-11-30T23:12:47.143061+0000","last_became_peered":"2023-11-30T23:12:47.143061+0000","last_unstale":"2023-11-30T23:27:40.771097+0000","last_undegraded":"2023-11-30T23:27:40.771097+0000","last_fullsized":"2023-11-30T23:27:40.771097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:38.684081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":2145,"num_write_kb":21845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"48'3505","reported_seq":2894,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.454978+0000","last_change":"2023-11-30T23:27:40.468495+0000","last_active":"2023-11-30T23:27:41.454978+0000","last_peered":"2023-11-30T23:27:41.454978+0000","last_clean":"2023-11-30T23:27:41.454978+0000","last_became_active":"2023-11-30T23:12:47.501516+0000","last_became_peered":"2023-11-30T23:12:47.501516+0000","last_unstale":"2023-11-30T23:27:41.454978+0000","last_undegraded":"2023-11-30T23:27:41.454978+0000","last_fullsized":"2023-11-30T23:27:41.454978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:34:32.232378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040930987000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.6","version":"48'2107","reported_seq":2152,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.428152+0000","last_change":"2023-11-30T23:12:47.135053+0000","last_active":"2023-11-30T23:27:40.428152+0000","last_peered":"2023-11-30T23:27:40.428152+0000","last_clean":"2023-11-30T23:27:40.428152+0000","last_became_active":"2023-11-30T23:12:47.134776+0000","last_became_peered":"2023-11-30T23:12:47.134776+0000","last_unstale":"2023-11-30T23:27:40.428152+0000","last_undegraded":"2023-11-30T23:27:40.428152+0000","last_fullsized":"2023-11-30T23:27:40.428152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2107,"log_dups_size":0,"ondisk_log_size":2107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":2450,"num_write_kb":16294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"48'3245","reported_seq":2657,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.522958+0000","last_change":"2023-11-30T23:27:40.533855+0000","last_active":"2023-11-30T23:27:41.522958+0000","last_peered":"2023-11-30T23:27:41.522958+0000","last_clean":"2023-11-30T23:27:41.522958+0000","last_became_active":"2023-11-30T23:12:47.498631+0000","last_became_peered":"2023-11-30T23:12:47.498631+0000","last_unstale":"2023-11-30T23:27:41.522958+0000","last_undegraded":"2023-11-30T23:27:41.522958+0000","last_fullsized":"2023-11-30T23:27:41.522958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3245,"log_dups_size":0,"ondisk_log_size":3245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033287613000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1095,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.7","version":"48'1686","reported_seq":1731,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.770201+0000","last_change":"2023-11-30T23:12:47.137707+0000","last_active":"2023-11-30T23:27:40.770201+0000","last_peered":"2023-11-30T23:27:40.770201+0000","last_clean":"2023-11-30T23:27:40.770201+0000","last_became_active":"2023-11-30T23:12:47.137406+0000","last_became_peered":"2023-11-30T23:12:47.137406+0000","last_unstale":"2023-11-30T23:27:40.770201+0000","last_undegraded":"2023-11-30T23:27:40.770201+0000","last_fullsized":"2023-11-30T23:27:40.770201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1686,"log_dups_size":0,"ondisk_log_size":1686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":1761,"num_write_kb":9276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"48'3472","reported_seq":2875,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.548715+0000","last_change":"2023-11-30T23:27:40.571283+0000","last_active":"2023-11-30T23:27:41.548715+0000","last_peered":"2023-11-30T23:27:41.548715+0000","last_clean":"2023-11-30T23:27:41.548715+0000","last_became_active":"2023-11-30T23:12:47.506447+0000","last_became_peered":"2023-11-30T23:12:47.506447+0000","last_unstale":"2023-11-30T23:27:41.548715+0000","last_undegraded":"2023-11-30T23:27:41.548715+0000","last_fullsized":"2023-11-30T23:27:41.548715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3472,"log_dups_size":0,"ondisk_log_size":3472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:35:21.183993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037907362999999999,"stat_sum":{"num_bytes":4105,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1170,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.8","version":"41'1548","reported_seq":1593,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.408276+0000","last_change":"2023-11-30T23:12:47.142532+0000","last_active":"2023-11-30T23:27:39.408276+0000","last_peered":"2023-11-30T23:27:39.408276+0000","last_clean":"2023-11-30T23:27:39.408276+0000","last_became_active":"2023-11-30T23:12:47.142135+0000","last_became_peered":"2023-11-30T23:12:47.142135+0000","last_unstale":"2023-11-30T23:27:39.408276+0000","last_undegraded":"2023-11-30T23:27:39.408276+0000","last_fullsized":"2023-11-30T23:27:39.408276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1548,"log_dups_size":0,"ondisk_log_size":1548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:53.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":1654,"num_write_kb":9390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"48'3431","reported_seq":2807,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.574838+0000","last_change":"2023-11-30T23:27:40.779072+0000","last_active":"2023-11-30T23:27:41.574838+0000","last_peered":"2023-11-30T23:27:41.574838+0000","last_clean":"2023-11-30T23:27:41.574838+0000","last_became_active":"2023-11-30T23:12:47.513966+0000","last_became_peered":"2023-11-30T23:12:47.513966+0000","last_unstale":"2023-11-30T23:27:41.574838+0000","last_undegraded":"2023-11-30T23:27:41.574838+0000","last_fullsized":"2023-11-30T23:27:41.574838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3431,"log_dups_size":0,"ondisk_log_size":3431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:02.220181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003646318,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.9","version":"41'2295","reported_seq":2340,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.992195+0000","last_change":"2023-11-30T23:12:47.140898+0000","last_active":"2023-11-30T23:27:39.992195+0000","last_peered":"2023-11-30T23:27:39.992195+0000","last_clean":"2023-11-30T23:27:39.992195+0000","last_became_active":"2023-11-30T23:12:47.140565+0000","last_became_peered":"2023-11-30T23:12:47.140565+0000","last_unstale":"2023-11-30T23:27:39.992195+0000","last_undegraded":"2023-11-30T23:27:39.992195+0000","last_fullsized":"2023-11-30T23:27:39.992195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":2336,"num_write_kb":17365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'3595","reported_seq":2941,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.559453+0000","last_change":"2023-11-30T23:27:40.526518+0000","last_active":"2023-11-30T23:27:41.559453+0000","last_peered":"2023-11-30T23:27:41.559453+0000","last_clean":"2023-11-30T23:27:41.559453+0000","last_became_active":"2023-11-30T23:12:47.501315+0000","last_became_peered":"2023-11-30T23:12:47.501315+0000","last_unstale":"2023-11-30T23:27:41.559453+0000","last_undegraded":"2023-11-30T23:27:41.559453+0000","last_fullsized":"2023-11-30T23:27:41.559453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026736012999999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.a","version":"44'2871","reported_seq":2916,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.993797+0000","last_change":"2023-11-30T23:12:47.140328+0000","last_active":"2023-11-30T23:27:39.993797+0000","last_peered":"2023-11-30T23:27:39.993797+0000","last_clean":"2023-11-30T23:27:39.993797+0000","last_became_active":"2023-11-30T23:12:47.140037+0000","last_became_peered":"2023-11-30T23:12:47.140037+0000","last_unstale":"2023-11-30T23:27:39.993797+0000","last_undegraded":"2023-11-30T23:27:39.993797+0000","last_fullsized":"2023-11-30T23:27:39.993797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:38.684081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":2935,"num_write_kb":26081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"48'3359","reported_seq":2771,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.559018+0000","last_change":"2023-11-30T23:27:40.530235+0000","last_active":"2023-11-30T23:27:41.559018+0000","last_peered":"2023-11-30T23:27:41.559018+0000","last_clean":"2023-11-30T23:27:41.559018+0000","last_became_active":"2023-11-30T23:12:47.507181+0000","last_became_peered":"2023-11-30T23:12:47.507181+0000","last_unstale":"2023-11-30T23:27:41.559018+0000","last_undegraded":"2023-11-30T23:27:41.559018+0000","last_fullsized":"2023-11-30T23:27:41.559018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030024714000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.b","version":"41'4584","reported_seq":4629,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.409866+0000","last_change":"2023-11-30T23:12:47.142027+0000","last_active":"2023-11-30T23:27:39.409866+0000","last_peered":"2023-11-30T23:27:39.409866+0000","last_clean":"2023-11-30T23:27:39.409866+0000","last_became_active":"2023-11-30T23:12:47.141664+0000","last_became_peered":"2023-11-30T23:12:47.141664+0000","last_unstale":"2023-11-30T23:27:39.409866+0000","last_undegraded":"2023-11-30T23:27:39.409866+0000","last_fullsized":"2023-11-30T23:27:39.409866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4584,"log_dups_size":0,"ondisk_log_size":4584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4647,"num_write_kb":30581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"48'3589","reported_seq":2929,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.511274+0000","last_change":"2023-11-30T23:27:40.782695+0000","last_active":"2023-11-30T23:27:41.511274+0000","last_peered":"2023-11-30T23:27:41.511274+0000","last_clean":"2023-11-30T23:27:41.511274+0000","last_became_active":"2023-11-30T23:12:47.516939+0000","last_became_peered":"2023-11-30T23:12:47.516939+0000","last_unstale":"2023-11-30T23:27:41.511274+0000","last_undegraded":"2023-11-30T23:27:41.511274+0000","last_fullsized":"2023-11-30T23:27:41.511274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3589,"log_dups_size":0,"ondisk_log_size":3589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014334588000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1d","version":"48'3872","reported_seq":3220,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.485190+0000","last_change":"2023-11-30T23:27:40.517369+0000","last_active":"2023-11-30T23:27:41.485190+0000","last_peered":"2023-11-30T23:27:41.485190+0000","last_clean":"2023-11-30T23:27:41.485190+0000","last_became_active":"2023-11-30T23:12:47.521310+0000","last_became_peered":"2023-11-30T23:12:47.521310+0000","last_unstale":"2023-11-30T23:27:41.485190+0000","last_undegraded":"2023-11-30T23:27:41.485190+0000","last_fullsized":"2023-11-30T23:27:41.485190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3872,"log_dups_size":0,"ondisk_log_size":3872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:08:47.117163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015666933000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1c","version":"43'622","reported_seq":666,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.409308+0000","last_change":"2023-11-30T23:12:47.143819+0000","last_active":"2023-11-30T23:27:39.409308+0000","last_peered":"2023-11-30T23:27:39.409308+0000","last_clean":"2023-11-30T23:27:39.409308+0000","last_became_active":"2023-11-30T23:12:47.143512+0000","last_became_peered":"2023-11-30T23:12:47.143512+0000","last_unstale":"2023-11-30T23:27:39.409308+0000","last_undegraded":"2023-11-30T23:27:39.409308+0000","last_fullsized":"2023-11-30T23:27:39.409308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:35:20.171512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":689,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"48'3820","reported_seq":3126,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.577995+0000","last_change":"2023-11-30T23:27:40.520201+0000","last_active":"2023-11-30T23:27:41.577995+0000","last_peered":"2023-11-30T23:27:41.577995+0000","last_clean":"2023-11-30T23:27:41.577995+0000","last_became_active":"2023-11-30T23:12:47.520322+0000","last_became_peered":"2023-11-30T23:12:47.520322+0000","last_unstale":"2023-11-30T23:27:41.577995+0000","last_undegraded":"2023-11-30T23:27:41.577995+0000","last_fullsized":"2023-11-30T23:27:41.577995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3820,"log_dups_size":0,"ondisk_log_size":3820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018218595000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1d","version":"41'4570","reported_seq":4614,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.409491+0000","last_change":"2023-11-30T23:12:47.142276+0000","last_active":"2023-11-30T23:27:39.409491+0000","last_peered":"2023-11-30T23:27:39.409491+0000","last_clean":"2023-11-30T23:27:39.409491+0000","last_became_active":"2023-11-30T23:12:47.141965+0000","last_became_peered":"2023-11-30T23:12:47.141965+0000","last_unstale":"2023-11-30T23:27:39.409491+0000","last_undegraded":"2023-11-30T23:27:39.409491+0000","last_fullsized":"2023-11-30T23:27:39.409491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4570,"log_dups_size":0,"ondisk_log_size":4570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:28.154593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4627,"num_write_kb":34948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"48'3352","reported_seq":2791,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.529314+0000","last_change":"2023-11-30T23:27:40.554745+0000","last_active":"2023-11-30T23:27:41.529314+0000","last_peered":"2023-11-30T23:27:41.529314+0000","last_clean":"2023-11-30T23:27:41.529314+0000","last_became_active":"2023-11-30T23:12:47.522002+0000","last_became_peered":"2023-11-30T23:12:47.522002+0000","last_unstale":"2023-11-30T23:27:41.529314+0000","last_undegraded":"2023-11-30T23:27:41.529314+0000","last_fullsized":"2023-11-30T23:27:41.529314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3352,"log_dups_size":0,"ondisk_log_size":3352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025109995999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1079,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1e","version":"43'4068","reported_seq":4114,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.717324+0000","last_change":"2023-11-30T23:12:47.139186+0000","last_active":"2023-11-30T23:27:39.717324+0000","last_peered":"2023-11-30T23:27:39.717324+0000","last_clean":"2023-11-30T23:27:39.717324+0000","last_became_active":"2023-11-30T23:12:47.138275+0000","last_became_peered":"2023-11-30T23:12:47.138275+0000","last_unstale":"2023-11-30T23:27:39.717324+0000","last_undegraded":"2023-11-30T23:27:39.717324+0000","last_fullsized":"2023-11-30T23:27:39.717324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4068,"log_dups_size":0,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:58:25.168678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":4121,"num_write_kb":30658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"48'3346","reported_seq":2746,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.529273+0000","last_change":"2023-11-30T23:27:40.538163+0000","last_active":"2023-11-30T23:27:41.529273+0000","last_peered":"2023-11-30T23:27:41.529273+0000","last_clean":"2023-11-30T23:27:41.529273+0000","last_became_active":"2023-11-30T23:12:47.508718+0000","last_became_peered":"2023-11-30T23:12:47.508718+0000","last_unstale":"2023-11-30T23:27:41.529273+0000","last_undegraded":"2023-11-30T23:27:41.529273+0000","last_fullsized":"2023-11-30T23:27:41.529273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3346,"log_dups_size":0,"ondisk_log_size":3346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037282159000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1f","version":"43'790","reported_seq":836,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-30T23:27:39.520769+0000","last_change":"2023-11-30T23:12:47.141150+0000","last_active":"2023-11-30T23:27:39.520769+0000","last_peered":"2023-11-30T23:27:39.520769+0000","last_clean":"2023-11-30T23:27:39.520769+0000","last_became_active":"2023-11-30T23:12:47.140891+0000","last_became_peered":"2023-11-30T23:12:47.140891+0000","last_unstale":"2023-11-30T23:27:39.520769+0000","last_undegraded":"2023-11-30T23:27:39.520769+0000","last_fullsized":"2023-11-30T23:27:39.520769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:22:48.835054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":847,"num_write_kb":12818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":74679,"num_write_kb":40592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228857,"ondisk_log_size":228857,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":275264647,"num_objects":614,"num_object_clones":0,"num_object_copies":1228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":614,"num_whiteouts":0,"num_read":1037,"num_read_kb":3420,"num_write":81069,"num_write_kb":625801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":540,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":550592512,"data_stored":550529294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78631,"ondisk_log_size":78631,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575033,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438952,"kb_used_data":70816,"kb_used_omap":0,"kb_used_meta":368128,"kb_avail":93932888,"statfs":{"total":96636764160,"available":96187277312,"internally_reserved":0,"allocated":72515584,"data_stored":72178287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":376963072},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69499999999999995,"15min":0.70399999999999996},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":1.1639999999999999,"5min":0.84699999999999998,"15min":0.78900000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":6.9429999999999996,"5min":6.9429999999999996,"15min":6.9429999999999996},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.81699999999999995,"15min":0.81399999999999995},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":7.0540000000000003,"5min":7.0540000000000003,"15min":7.0540000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.751},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.84699999999999998,"15min":0.83099999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":5.54,"5min":5.54,"15min":5.54},"last":0.373},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":5.5880000000000001,"5min":5.5880000000000001,"15min":5.5880000000000001},"last":0.437}]},{"osd":3,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":0.94999999999999996,"15min":0.90100000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":4.6440000000000001,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":1.022,"5min":0.95999999999999996,"15min":0.96299999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":4.6589999999999998,"5min":4.6589999999999998,"15min":4.6589999999999998},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.68799999999999994,"15min":0.77500000000000002},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.314},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3759999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.81100000000000005,"15min":0.88100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.313}]},{"osd":5,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.79200000000000004,"15min":0.875},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.6719999999999999,"5min":1.7110000000000001,"15min":1.7210000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.81599999999999995,"15min":0.88500000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6379999999999999,"5min":1.796,"15min":1.796},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.86599999999999999,"15min":0.94499999999999995},"min":{"1min":0.38300000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.694,"5min":1.694,"15min":2.9670000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.92300000000000004,"15min":0.97899999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":0.46700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575033,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345988,"kb_used_data":90172,"kb_used_omap":0,"kb_used_meta":255808,"kb_avail":94025852,"statfs":{"total":96636764160,"available":96282472448,"internally_reserved":0,"allocated":92336128,"data_stored":92014768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":261947392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70199999999999996,"15min":0.73199999999999998},"min":{"1min":0.27100000000000002,"5min":0.23999999999999999,"15min":0.221},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.5640000000000001},"last":1.306},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.77000000000000002,"15min":0.78400000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":3.4670000000000001,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.83199999999999996,"15min":0.86299999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":2.2210000000000001,"5min":5.851,"15min":12.172000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.33300000000000002},"max":{"1min":3.4420000000000002,"5min":3.4420000000000002,"15min":5.6980000000000004},"last":0.77900000000000003}]},{"osd":2,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.1800000000000002,"5min":2.327,"15min":2.327},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83999999999999997,"15min":0.86399999999999999},"min":{"1min":0.35999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.774},"last":1.3720000000000001}]},{"osd":3,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.873,"15min":0.873},"min":{"1min":0.434,"5min":0.434,"15min":0.38900000000000001},"max":{"1min":3.4889999999999999,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.871,"15min":0.86799999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":2.2029999999999998,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.83799999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.081,"5min":2.081,"15min":2.6429999999999998},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.878,"15min":0.88900000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35299999999999998},"max":{"1min":3.371,"5min":3.371,"15min":3.371},"last":1.0269999999999999}]},{"osd":5,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.83899999999999997,"15min":0.84899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.1549999999999998,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.91000000000000003,"15min":0.97599999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":2.194,"5min":2.2400000000000002,"15min":2.7040000000000002},"last":1.4330000000000001}]},{"osd":7,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.101,"15min":1.0509999999999999},"min":{"1min":0.45700000000000002,"5min":0.45600000000000002,"15min":0.42499999999999999},"max":{"1min":3.4169999999999998,"5min":11.220000000000001,"15min":11.220000000000001},"last":1.083},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.0940000000000001,"15min":1.1399999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.2370000000000001,"5min":12.874000000000001,"15min":30.405999999999999},"last":0.80000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575033,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":384292,"kb_used_data":86620,"kb_used_omap":0,"kb_used_meta":297664,"kb_avail":93987548,"statfs":{"total":96636764160,"available":96243249152,"internally_reserved":0,"allocated":88698880,"data_stored":88364629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304807936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.64200000000000002,"15min":0.70799999999999996},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.91200000000000003,"5min":1.1990000000000001,"15min":1.2330000000000001},"last":1.167},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.72599999999999998,"15min":0.76500000000000001},"min":{"1min":0.39700000000000002,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":3.5489999999999999,"5min":3.5489999999999999,"15min":4.508},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.77800000000000002,"15min":0.84499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96699999999999997,"5min":2.9740000000000002,"15min":6.9320000000000004},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.78000000000000003,"15min":0.88400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.94399999999999995,"5min":1.661,"15min":6.8780000000000001},"last":1.1970000000000001}]},{"osd":2,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.76300000000000001,"15min":0.80400000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.26700000000000002},"max":{"1min":1.04,"5min":1.7130000000000001,"15min":1.9690000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.77500000000000002,"15min":0.85099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0569999999999999,"5min":3.1379999999999999,"15min":4.6230000000000002},"last":1.0129999999999999}]},{"osd":3,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.81799999999999995,"15min":0.85299999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.345,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.82899999999999996,"15min":0.93200000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.997,"5min":3.0030000000000001,"15min":6.7400000000000002},"last":0.95899999999999996}]},{"osd":4,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.71399999999999997,"15min":0.80900000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.309},"max":{"1min":0.878,"5min":1.456,"15min":1.4930000000000001},"last":0.878},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.83099999999999996,"15min":0.86299999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.5820000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.98299999999999998}]},{"osd":6,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.84699999999999998,"15min":0.89000000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.3520000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.86499999999999999,"15min":0.93500000000000005},"min":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.8160000000000001,"5min":3.073,"15min":3.073},"last":1.2350000000000001}]},{"osd":7,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.89500000000000002,"15min":0.94599999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.012,"5min":2.895,"15min":2.895},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.92800000000000005,"15min":0.98199999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.6559999999999999,"5min":3.484,"15min":3.484},"last":1.2090000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575032,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":349332,"kb_used_data":65612,"kb_used_omap":0,"kb_used_meta":283712,"kb_avail":94022508,"statfs":{"total":96636764160,"available":96279048192,"internally_reserved":0,"allocated":67186688,"data_stored":66856744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":290521088},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":0.81100000000000005,"15min":0.751},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":12.91,"5min":12.91,"15min":12.91},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.345,"5min":0.83299999999999996,"15min":0.77300000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":12.962,"5min":12.962,"15min":12.962},"last":0.93600000000000005}]},{"osd":1,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.25600000000000001},"max":{"1min":4.8090000000000002,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.79900000000000004,"15min":0.78000000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":6.7839999999999998,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":1.1080000000000001}]},{"osd":2,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":0.83299999999999996,"15min":0.80900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":9.0229999999999997,"5min":9.0229999999999997,"15min":9.0229999999999997},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.143,"5min":0.92500000000000004,"15min":0.90500000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.33600000000000002},"max":{"1min":8.9990000000000006,"5min":8.9990000000000006,"15min":8.9990000000000006},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.86899999999999999,"15min":0.85399999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":5.0209999999999999,"5min":5.0209999999999999,"15min":5.0209999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80800000000000005,"15min":0.82799999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":2.9489999999999998,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":4.71,"5min":1.593,"15min":1.087},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":81.837000000000003,"5min":81.837000000000003,"15min":81.837000000000003},"last":0.76700000000000002},{"interface":"front","average":{"1min":4.8460000000000001,"5min":1.6930000000000001,"15min":1.179},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":81.751999999999995,"5min":81.751999999999995,"15min":81.751999999999995},"last":1.1479999999999999}]},{"osd":6,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":4.6379999999999999,"5min":1.5740000000000001,"15min":1.0920000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":79.655000000000001,"5min":79.655000000000001,"15min":79.655000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":4.7789999999999999,"5min":1.6830000000000001,"15min":1.2070000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":80.540000000000006,"5min":80.540000000000006,"15min":80.540000000000006},"last":1.032}]},{"osd":7,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":4.8399999999999999,"5min":1.7190000000000001,"15min":1.206},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":80.486000000000004,"5min":80.486000000000004,"15min":80.486000000000004},"last":0.90400000000000003},{"interface":"front","average":{"1min":5.0449999999999999,"5min":1.7150000000000001,"15min":1.2030000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":81.875,"5min":81.875,"15min":81.875},"last":0.86699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575033,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370920,"kb_used_data":61024,"kb_used_omap":0,"kb_used_meta":309888,"kb_avail":94000920,"statfs":{"total":96636764160,"available":96256942080,"internally_reserved":0,"allocated":62488576,"data_stored":62170691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":317325312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":2.6589999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.26900000000000002,"5min":0.24299999999999999,"15min":0.23999999999999999},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.4750000000000001},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.125,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.74299999999999999,"15min":0.77100000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0960000000000001,"5min":1.256,"15min":4.8150000000000004},"last":0.89800000000000002}]},{"osd":2,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.77200000000000002,"15min":0.76900000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.28000000000000003},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.82899999999999996,"15min":0.84399999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.1259999999999999,"5min":1.3580000000000001,"15min":4.8719999999999999},"last":1.0149999999999999}]},{"osd":4,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.88500000000000001,"15min":0.89300000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.31},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":2.536},"last":1.26},{"interface":"front","average":{"1min":1.099,"5min":0.96199999999999997,"15min":0.95999999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.378},"max":{"1min":4.6820000000000004,"5min":4.6820000000000004,"15min":4.6820000000000004},"last":1.3}]},{"osd":5,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.0580000000000001,"15min":1.0189999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.42099999999999999},"max":{"1min":8.8010000000000002,"5min":8.8010000000000002,"15min":8.8010000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.98799999999999999,"15min":1.04},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1499999999999999,"5min":1.8500000000000001,"15min":4.9909999999999997},"last":1.0820000000000001}]},{"osd":6,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.0429999999999999,"15min":1.022},"min":{"1min":0.52700000000000002,"5min":0.52100000000000002,"15min":0.378},"max":{"1min":3.6699999999999999,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":1.044},{"interface":"front","average":{"1min":0.88700000000000001,"5min":1.024,"15min":1.0660000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.45500000000000002},"max":{"1min":1.1870000000000001,"5min":2.3530000000000002,"15min":4.4379999999999997},"last":1.2130000000000001}]},{"osd":7,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.038,"15min":1.085},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2629999999999999,"5min":1.4910000000000001,"15min":5.0369999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.056,"15min":1.073},"min":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.214,"5min":2.214,"15min":2.5609999999999999},"last":1.1279999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575034,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224096,"kb_used_data":40536,"kb_used_omap":0,"kb_used_meta":183552,"kb_avail":94147744,"statfs":{"total":96636764160,"available":96407289856,"internally_reserved":0,"allocated":41508864,"data_stored":41194419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":187957248},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.72599999999999998,"5min":1.0629999999999999,"15min":1.413},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.65100000000000002,"15min":0.67400000000000004},"min":{"1min":0.222,"5min":0.222,"15min":0.17999999999999999},"max":{"1min":1.044,"5min":1.2110000000000001,"15min":1.4470000000000001},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.79100000000000004,"15min":0.73299999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":8.3480000000000008,"5min":8.3480000000000008,"15min":8.3480000000000008},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.74199999999999999,"15min":0.76100000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.224},"max":{"1min":1.0329999999999999,"5min":1.1850000000000001,"15min":11.457000000000001},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.79200000000000004,"15min":0.73299999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.4569999999999999,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.86199999999999999,"15min":0.84099999999999997},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.4319999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.093}]},{"osd":4,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.85699999999999998,"15min":0.88100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28299999999999997},"max":{"1min":1.151,"5min":1.5029999999999999,"15min":1.522},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.88,"15min":0.87},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.4540000000000002,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":1.0109999999999999,"15min":0.999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":1.0009999999999999,"15min":0.998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.754}]},{"osd":6,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0089999999999999,"15min":0.96599999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":4.9420000000000002,"5min":4.9420000000000002,"15min":4.9420000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.369,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":1.222}]},{"osd":7,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":1.0569999999999999,"15min":1.0549999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.498,"5min":1.498,"15min":1.762},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.179,"5min":1.0920000000000001,"15min":1.0469999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.4750000000000001,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.92400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575034,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396560,"kb_used_data":86600,"kb_used_omap":0,"kb_used_meta":309952,"kb_avail":93975280,"statfs":{"total":96636764160,"available":96230686720,"internally_reserved":0,"allocated":88678400,"data_stored":88352518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":317390848},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.183},"max":{"1min":2.7850000000000001,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.498,"5min":0.67000000000000004,"15min":0.65900000000000003},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.91700000000000004,"5min":1.222,"15min":1.222},"last":0.69099999999999995}]},{"osd":2,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66100000000000003,"15min":0.67300000000000004},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23000000000000001},"max":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.71399999999999997,"15min":0.72299999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.20699999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29099999999999998},"max":{"1min":0.96799999999999997,"5min":1.3720000000000001,"15min":1.431},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.78500000000000003,"15min":0.76100000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.498,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.624}]},{"osd":4,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.85499999999999998,"15min":0.88100000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.85699999999999998,"15min":0.88800000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.077,"5min":1.482,"15min":1.6919999999999999},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.84199999999999997,"15min":0.84999999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.5389999999999999,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.97299999999999998,"15min":0.99099999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.8879999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.93500000000000005,"15min":0.93300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.6000000000000001,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.012,"15min":1.026},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.9209999999999998,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.998,"15min":1.0069999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":1.1259999999999999,"5min":2.7549999999999999,"15min":2.7549999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.997,"15min":1.004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.5720000000000001,"5min":3.2280000000000002,"15min":3.2280000000000002},"last":0.94999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575033,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243812,"kb_used_data":42140,"kb_used_omap":0,"kb_used_meta":201664,"kb_avail":94128028,"statfs":{"total":96636764160,"available":96387100672,"internally_reserved":0,"allocated":43151360,"data_stored":42810014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":206503936},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,0,1,1,10,9,24,13],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.624,"15min":0.61099999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.20999999999999999},"max":{"1min":0.88,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65100000000000002,"15min":0.66200000000000003},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.486}]},{"osd":2,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.311,"5min":0.311,"15min":0.23699999999999999},"max":{"1min":1.046,"5min":1.8919999999999999,"15min":2.3479999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.76900000000000002,"15min":0.77300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":0.23499999999999999}]},{"osd":3,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.70599999999999996,"15min":0.71699999999999997},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.387,"5min":1.387,"15min":4.3170000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.85899999999999999,"15min":0.82699999999999996},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.99099999999999999,"5min":1.925,"15min":2.395},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.90800000000000003,"15min":0.89700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.86899999999999999,"15min":0.89700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":2.0640000000000001},"last":5.5720000000000001}]},{"osd":5,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.90200000000000002,"15min":0.91500000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.24,"5min":1.5629999999999999,"15min":1.871},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":1.054,"15min":1.0680000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.9350000000000001,"5min":3.165,"15min":6.0119999999999996},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":1.089,"15min":1.0720000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.0800000000000001,"5min":2.0840000000000001,"15min":2.5209999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.032,"15min":1.032},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.254,"5min":2.254,"15min":8.3490000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.0129999999999999,"15min":1.038},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":6.1529999999999996},"last":0.57999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41955328,"data_stored":41943678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":88088576,"data_stored":88080689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40919040,"data_stored":40918503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61898752,"data_stored":61890695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":66588672,"data_stored":66572640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":88084480,"data_stored":88080474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":91750400,"data_stored":91738865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":28760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":24621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":28708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":32788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":36947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":28695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":36961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T23:27:46.603 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T23:27:46.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24ffff700 1 Processor -- start 2023-11-30T23:27:46.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24ffff700 1 -- start start 2023-11-30T23:27:46.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24ffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa2500b3f10 0x7fa250147090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2500b4ee0 0x7fa250149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24ffff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa2500b6910 0x7fa25014a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24ffff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2501475d0 con 0x7fa2500b3f10 2023-11-30T23:27:46.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24ffff700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2500b5e70 con 0x7fa2500b6910 2023-11-30T23:27:46.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24ffff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500b5c00 con 0x7fa2500b4ee0 2023-11-30T23:27:46.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24effd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa2500b3f10 0x7fa250147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24effd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa2500b3f10 0x7fa250147090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60802/0 (socket says 172.21.15.73:60802) 2023-11-30T23:27:46.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24effd700 1 -- 172.21.15.73:0/2979670854 learned_addr learned my addr 172.21.15.73:0/2979670854 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:46.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24f7fe700 1 --2- 172.21.15.73:0/2979670854 >> v2:172.21.15.156:3300/0 conn(0x7fa2500b6910 0x7fa25014a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24e7fc700 1 --2- 172.21.15.73:0/2979670854 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2500b4ee0 0x7fa250149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24effd700 1 -- 172.21.15.73:0/2979670854 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2500b4ee0 msgr2=0x7fa250149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:46.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24effd700 1 --2- 172.21.15.73:0/2979670854 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2500b4ee0 0x7fa250149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24effd700 1 -- 172.21.15.73:0/2979670854 >> v2:172.21.15.156:3300/0 conn(0x7fa2500b6910 msgr2=0x7fa25014a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:46.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24effd700 1 --2- 172.21.15.73:0/2979670854 >> v2:172.21.15.156:3300/0 conn(0x7fa2500b6910 0x7fa25014a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24effd700 1 -- 172.21.15.73:0/2979670854 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2500b42f0 con 0x7fa2500b3f10 2023-11-30T23:27:46.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24e7fc700 1 --2- 172.21.15.73:0/2979670854 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2500b4ee0 0x7fa250149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:27:46.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24f7fe700 1 --2- 172.21.15.73:0/2979670854 >> v2:172.21.15.156:3300/0 conn(0x7fa2500b6910 0x7fa25014a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:27:46.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.710+0000 7fa24effd700 1 --2- 172.21.15.73:0/2979670854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2500b3f10 0x7fa250147090 secure :-1 s=READY pgs=4219 cs=0 l=1 rev1=1 crypto rx=0x7fa2500b5810 tx=0x7fa244009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecb951ff42bdfdc server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:46.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24dffb700 1 -- 172.21.15.73:0/2979670854 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400b8a0 con 0x7fa2500b3f10 2023-11-30T23:27:46.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24dffb700 1 -- 172.21.15.73:0/2979670854 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24400ba00 con 0x7fa2500b3f10 2023-11-30T23:27:46.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24dffb700 1 -- 172.21.15.73:0/2979670854 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400bd90 con 0x7fa2500b3f10 2023-11-30T23:27:46.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24ffff700 1 -- 172.21.15.73:0/2979670854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2500b3f10 msgr2=0x7fa250147090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:46.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24ffff700 1 --2- 172.21.15.73:0/2979670854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2500b3f10 0x7fa250147090 secure :-1 s=READY pgs=4219 cs=0 l=1 rev1=1 crypto rx=0x7fa2500b5810 tx=0x7fa244009bf0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24ffff700 1 -- 172.21.15.73:0/2979670854 shutdown_connections 2023-11-30T23:27:46.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24ffff700 1 --2- 172.21.15.73:0/2979670854 >> v2:172.21.15.156:3300/0 conn(0x7fa2500b6910 0x7fa25014a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24ffff700 1 --2- 172.21.15.73:0/2979670854 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2500b4ee0 0x7fa250149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24ffff700 1 --2- 172.21.15.73:0/2979670854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2500b3f10 0x7fa250147090 unknown :-1 s=CLOSED pgs=4219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24ffff700 1 -- 172.21.15.73:0/2979670854 >> 172.21.15.73:0/2979670854 conn(0x7fa2500b8a10 msgr2=0x7fa2500b8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:46.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24ffff700 1 -- 172.21.15.73:0/2979670854 shutdown_connections 2023-11-30T23:27:46.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24ffff700 1 -- 172.21.15.73:0/2979670854 wait complete. 2023-11-30T23:27:46.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24ffff700 1 Processor -- start 2023-11-30T23:27:46.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24ffff700 1 -- start start 2023-11-30T23:27:46.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2500b3f10 0x7fa250143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24ffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2500b4ee0 0x7fa2501deae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2500b6910 0x7fa2501df020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24ffff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500abf60 con 0x7fa2500b6910 2023-11-30T23:27:46.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24ffff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500ab8a0 con 0x7fa2500b3f10 2023-11-30T23:27:46.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24ffff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500abb80 con 0x7fa2500b4ee0 2023-11-30T23:27:46.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2500b6910 0x7fa2501df020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2500b6910 0x7fa2501df020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60810/0 (socket says 172.21.15.73:60810) 2023-11-30T23:27:46.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24f7fe700 1 -- 172.21.15.73:0/3493907013 learned_addr learned my addr 172.21.15.73:0/3493907013 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:46.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24effd700 1 --2- 172.21.15.73:0/3493907013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2500b3f10 0x7fa250143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.714+0000 7fa24e7fc700 1 --2- 172.21.15.73:0/3493907013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2500b4ee0 0x7fa2501deae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.718+0000 7fa24f7fe700 1 -- 172.21.15.73:0/3493907013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2500b4ee0 msgr2=0x7fa2501deae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:46.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.718+0000 7fa24f7fe700 1 --2- 172.21.15.73:0/3493907013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2500b4ee0 0x7fa2501deae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.718+0000 7fa24f7fe700 1 -- 172.21.15.73:0/3493907013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2500b3f10 msgr2=0x7fa250143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:46.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.718+0000 7fa24f7fe700 1 --2- 172.21.15.73:0/3493907013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2500b3f10 0x7fa250143290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.718+0000 7fa24f7fe700 1 -- 172.21.15.73:0/3493907013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa244009570 con 0x7fa2500b6910 2023-11-30T23:27:46.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.718+0000 7fa24e7fc700 1 --2- 172.21.15.73:0/3493907013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2500b4ee0 0x7fa2501deae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:27:46.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.718+0000 7fa24f7fe700 1 --2- 172.21.15.73:0/3493907013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2500b6910 0x7fa2501df020 secure :-1 s=READY pgs=4220 cs=0 l=1 rev1=1 crypto rx=0x7fa248007ef0 tx=0x7fa24800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:46.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.718+0000 7fa2377fe700 1 -- 172.21.15.73:0/3493907013 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24800de90 con 0x7fa2500b6910 2023-11-30T23:27:46.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.718+0000 7fa2377fe700 1 -- 172.21.15.73:0/3493907013 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24800f040 con 0x7fa2500b6910 2023-11-30T23:27:46.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.718+0000 7fa24ffff700 1 -- 172.21.15.73:0/3493907013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2500a9700 con 0x7fa2500b6910 2023-11-30T23:27:46.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.718+0000 7fa2377fe700 1 -- 172.21.15.73:0/3493907013 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa248015640 con 0x7fa2500b6910 2023-11-30T23:27:46.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.718+0000 7fa24ffff700 1 -- 172.21.15.73:0/3493907013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25013c7f0 con 0x7fa2500b6910 2023-11-30T23:27:46.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.718+0000 7fa24ffff700 1 -- 172.21.15.73:0/3493907013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2500ab700 con 0x7fa2500b6910 2023-11-30T23:27:46.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.718+0000 7fa2377fe700 1 -- 172.21.15.73:0/3493907013 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa24801e3b0 con 0x7fa2500b6910 2023-11-30T23:27:46.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.722+0000 7fa2377fe700 1 --2- 172.21.15.73:0/3493907013 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa23c065ad0 0x7fa23c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:46.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.722+0000 7fa2377fe700 1 -- 172.21.15.73:0/3493907013 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fa248083310 con 0x7fa2500b6910 2023-11-30T23:27:46.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.722+0000 7fa24effd700 1 --2- 172.21.15.73:0/3493907013 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa23c065ad0 0x7fa23c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:46.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.722+0000 7fa24effd700 1 --2- 172.21.15.73:0/3493907013 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa23c065ad0 0x7fa23c067f90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa244000c00 tx=0x7fa244008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:46.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.730+0000 7fa2377fe700 1 -- 172.21.15.73:0/3493907013 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fa2500ab700 con 0x7fa2500b6910 2023-11-30T23:27:46.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.894+0000 7fa24ffff700 1 -- 172.21.15.73:0/3493907013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2500ac0a0 con 0x7fa2500b6910 2023-11-30T23:27:46.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.898+0000 7fa2377fe700 1 -- 172.21.15.73:0/3493907013 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16397 (secure 0 0 0) 0x7fa2500ac0a0 con 0x7fa2500b6910 2023-11-30T23:27:46.902 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:27:46.902 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":48,"fsid":"a677cb6a-4a54-4567-a30d-f0fa4bc22b17","created":"2023-11-30T23:12:23.260968+0000","modified":"2023-11-30T23:27:40.419956+0000","last_up_change":"2023-11-30T23:12:33.649318+0000","last_in_change":"2023-11-30T23:12:25.326689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-30T23:12:34.413317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-30T23:12:45.403156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-30T23:12:46.475384+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":65,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbf1c93f-0775-4780-8524-cf25792d9aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36686},{"type":"v1","addr":"172.21.15.73:6817","nonce":36686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36686},{"type":"v1","addr":"172.21.15.73:6819","nonce":36686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36686},{"type":"v1","addr":"172.21.15.73:6823","nonce":36686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36686},{"type":"v1","addr":"172.21.15.73:6821","nonce":36686}]},"public_addr":"172.21.15.73:6817/36686","cluster_addr":"172.21.15.73:6819/36686","heartbeat_back_addr":"172.21.15.73:6823/36686","heartbeat_front_addr":"172.21.15.73:6821/36686","state":["exists","up"]},{"osd":1,"uuid":"9d9dd122-9a42-4588-a0d2-50d13b13eba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36687},{"type":"v1","addr":"172.21.15.73:6809","nonce":36687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":36687},{"type":"v1","addr":"172.21.15.73:6811","nonce":36687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36687},{"type":"v1","addr":"172.21.15.73:6815","nonce":36687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36687},{"type":"v1","addr":"172.21.15.73:6813","nonce":36687}]},"public_addr":"172.21.15.73:6809/36687","cluster_addr":"172.21.15.73:6811/36687","heartbeat_back_addr":"172.21.15.73:6815/36687","heartbeat_front_addr":"172.21.15.73:6813/36687","state":["exists","up"]},{"osd":2,"uuid":"68ff4f1e-ec45-42e0-bb83-fe03598e4940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36688},{"type":"v1","addr":"172.21.15.73:6825","nonce":36688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36688},{"type":"v1","addr":"172.21.15.73:6827","nonce":36688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36688},{"type":"v1","addr":"172.21.15.73:6831","nonce":36688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36688},{"type":"v1","addr":"172.21.15.73:6829","nonce":36688}]},"public_addr":"172.21.15.73:6825/36688","cluster_addr":"172.21.15.73:6827/36688","heartbeat_back_addr":"172.21.15.73:6831/36688","heartbeat_front_addr":"172.21.15.73:6829/36688","state":["exists","up"]},{"osd":3,"uuid":"e4b08c98-6a4d-4ec8-a245-59a35f70a16f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36685},{"type":"v1","addr":"172.21.15.73:6801","nonce":36685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36685},{"type":"v1","addr":"172.21.15.73:6803","nonce":36685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":36685},{"type":"v1","addr":"172.21.15.73:6807","nonce":36685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36685},{"type":"v1","addr":"172.21.15.73:6805","nonce":36685}]},"public_addr":"172.21.15.73:6801/36685","cluster_addr":"172.21.15.73:6803/36685","heartbeat_back_addr":"172.21.15.73:6807/36685","heartbeat_front_addr":"172.21.15.73:6805/36685","state":["exists","up"]},{"osd":4,"uuid":"d0922b0e-5170-474d-b270-ddb5adc858cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":36908},{"type":"v1","addr":"172.21.15.156:6801","nonce":36908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":36908},{"type":"v1","addr":"172.21.15.156:6803","nonce":36908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":36908},{"type":"v1","addr":"172.21.15.156:6807","nonce":36908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":36908},{"type":"v1","addr":"172.21.15.156:6805","nonce":36908}]},"public_addr":"172.21.15.156:6801/36908","cluster_addr":"172.21.15.156:6803/36908","heartbeat_back_addr":"172.21.15.156:6807/36908","heartbeat_front_addr":"172.21.15.156:6805/36908","state":["exists","up"]},{"osd":5,"uuid":"f2791a77-db25-479c-95d5-ea7f77458685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":36909},{"type":"v1","addr":"172.21.15.156:6809","nonce":36909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":36909},{"type":"v1","addr":"172.21.15.156:6811","nonce":36909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":36909},{"type":"v1","addr":"172.21.15.156:6815","nonce":36909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":36909},{"type":"v1","addr":"172.21.15.156:6813","nonce":36909}]},"public_addr":"172.21.15.156:6809/36909","cluster_addr":"172.21.15.156:6811/36909","heartbeat_back_addr":"172.21.15.156:6815/36909","heartbeat_front_addr":"172.21.15.156:6813/36909","state":["exists","up"]},{"osd":6,"uuid":"f86c2fe9-ec8b-406e-af26-5dc65c926382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":36910},{"type":"v1","addr":"172.21.15.156:6817","nonce":36910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":36910},{"type":"v1","addr":"172.21.15.156:6819","nonce":36910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":36910},{"type":"v1","addr":"172.21.15.156:6823","nonce":36910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":36910},{"type":"v1","addr":"172.21.15.156:6821","nonce":36910}]},"public_addr":"172.21.15.156:6817/36910","cluster_addr":"172.21.15.156:6819/36910","heartbeat_back_addr":"172.21.15.156:6823/36910","heartbeat_front_addr":"172.21.15.156:6821/36910","state":["exists","up"]},{"osd":7,"uuid":"56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":36911},{"type":"v1","addr":"172.21.15.156:6825","nonce":36911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":36911},{"type":"v1","addr":"172.21.15.156:6827","nonce":36911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":36911},{"type":"v1","addr":"172.21.15.156:6831","nonce":36911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":36911},{"type":"v1","addr":"172.21.15.156:6829","nonce":36911}]},"public_addr":"172.21.15.156:6825/36911","cluster_addr":"172.21.15.156:6827/36911","heartbeat_back_addr":"172.21.15.156:6831/36911","heartbeat_front_addr":"172.21.15.156:6829/36911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.597534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.505493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.811871+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.586741+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.366817+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.101605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.627496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.829046+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":60,"length":6}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":64,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T23:27:46.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.898+0000 7fa24ffff700 1 -- 172.21.15.73:0/3493907013 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa23c065ad0 msgr2=0x7fa23c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:46.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.898+0000 7fa24ffff700 1 --2- 172.21.15.73:0/3493907013 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa23c065ad0 0x7fa23c067f90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa244000c00 tx=0x7fa244008030 comp rx=0 tx=0).stop 2023-11-30T23:27:46.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.898+0000 7fa24ffff700 1 -- 172.21.15.73:0/3493907013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2500b6910 msgr2=0x7fa2501df020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:46.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.898+0000 7fa24ffff700 1 --2- 172.21.15.73:0/3493907013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2500b6910 0x7fa2501df020 secure :-1 s=READY pgs=4220 cs=0 l=1 rev1=1 crypto rx=0x7fa248007ef0 tx=0x7fa24800d3b0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.898+0000 7fa24ffff700 1 -- 172.21.15.73:0/3493907013 shutdown_connections 2023-11-30T23:27:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.898+0000 7fa24ffff700 1 --2- 172.21.15.73:0/3493907013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2500b6910 0x7fa2501df020 unknown :-1 s=CLOSED pgs=4220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.898+0000 7fa24ffff700 1 --2- 172.21.15.73:0/3493907013 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fa2500b4ee0 0x7fa2501deae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.898+0000 7fa24ffff700 1 --2- 172.21.15.73:0/3493907013 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fa23c065ad0 0x7fa23c067f90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.898+0000 7fa24ffff700 1 --2- 172.21.15.73:0/3493907013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2500b3f10 0x7fa250143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.898+0000 7fa24ffff700 1 -- 172.21.15.73:0/3493907013 >> 172.21.15.73:0/3493907013 conn(0x7fa2500b8a10 msgr2=0x7fa250145b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.898+0000 7fa24ffff700 1 -- 172.21.15.73:0/3493907013 shutdown_connections 2023-11-30T23:27:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:46.898+0000 7fa24ffff700 1 -- 172.21.15.73:0/3493907013 wait complete. 2023-11-30T23:27:47.918 INFO:tasks.ceph:Scrubbing osd.0 2023-11-30T23:27:47.918 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-30T23:27:48.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.042+0000 7fd21bfff700 1 Processor -- start 2023-11-30T23:27:48.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.042+0000 7fd21bfff700 1 -- start start 2023-11-30T23:27:48.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd21bfff700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd21c140a50 0x7fd21c149d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd21bfff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21c0b4e70 con 0x7fd21c14a2c0 2023-11-30T23:27:48.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd21bfff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21c0bcc90 con 0x7fd21c0bc8b0 2023-11-30T23:27:48.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd21bfff700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd21c0b5da0 con 0x7fd21c140a50 2023-11-30T23:27:48.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd21b7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd21c14a2c0 0x7fd21c150ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48492/0 (socket says 172.21.15.73:48492) 2023-11-30T23:27:48.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd21b7fe700 1 -- 172.21.15.73:0/948792963 learned_addr learned my addr 172.21.15.73:0/948792963 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:27:48.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd21a7fc700 1 --2- 172.21.15.73:0/948792963 >> v2:172.21.15.156:3300/0 conn(0x7fd21c140a50 0x7fd21c149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd219ffb700 1 -- 172.21.15.73:0/948792963 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223060054 0 0) 0x7fd21c0b4e70 con 0x7fd21c14a2c0 2023-11-30T23:27:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd219ffb700 1 -- 172.21.15.73:0/948792963 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2040035d0 con 0x7fd21c14a2c0 2023-11-30T23:27:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd219ffb700 1 -- 172.21.15.73:0/948792963 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2406205268 0 0) 0x7fd2040035d0 con 0x7fd21c14a2c0 2023-11-30T23:27:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd219ffb700 1 -- 172.21.15.73:0/948792963 >> v2:172.21.15.156:3300/0 conn(0x7fd21c140a50 msgr2=0x7fd21c149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd219ffb700 1 --2- 172.21.15.73:0/948792963 >> v2:172.21.15.156:3300/0 conn(0x7fd21c140a50 0x7fd21c149d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd219ffb700 1 -- 172.21.15.73:0/948792963 >> v1:172.21.15.156:6789/0 conn(0x7fd21c0bc8b0 legacy=0x7fd21c140340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd219ffb700 1 -- 172.21.15.73:0/948792963 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c0b4040 con 0x7fd21c14a2c0 2023-11-30T23:27:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd219ffb700 1 -- 172.21.15.73:0/948792963 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3856460137 0 0) 0x7fd2140019f0 con 0x7fd21c14a2c0 2023-11-30T23:27:48.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd219ffb700 1 -- 172.21.15.73:0/948792963 >> v1:172.21.15.73:6789/0 conn(0x7fd21c14a2c0 legacy=0x7fd21c150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd219ffb700 1 --2- 172.21.15.73:0/948792963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd204003a20 0x7fd204003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd219ffb700 1 --2- 172.21.15.73:0/948792963 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd204004870 0x7fd204004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd219ffb700 1 --2- 172.21.15.73:0/948792963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd204005230 0x7fd20400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd219ffb700 1 -- 172.21.15.73:0/948792963 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20400c1a0 con 0x7fd204005230 2023-11-30T23:27:48.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd219ffb700 1 -- 172.21.15.73:0/948792963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20400c310 con 0x7fd204003a20 2023-11-30T23:27:48.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd219ffb700 1 -- 172.21.15.73:0/948792963 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20400c4d0 con 0x7fd204004870 2023-11-30T23:27:48.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd21b7fe700 1 --2- 172.21.15.73:0/948792963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd204005230 0x7fd20400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd21affd700 1 --2- 172.21.15.73:0/948792963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd204003a20 0x7fd204003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd21a7fc700 1 --2- 172.21.15.73:0/948792963 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd204004870 0x7fd204004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd21b7fe700 1 -- 172.21.15.73:0/948792963 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd204004870 msgr2=0x7fd204004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:48.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd21b7fe700 1 --2- 172.21.15.73:0/948792963 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd204004870 0x7fd204004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd21b7fe700 1 -- 172.21.15.73:0/948792963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd204003a20 msgr2=0x7fd204003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:48.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd21b7fe700 1 --2- 172.21.15.73:0/948792963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd204003a20 0x7fd204003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd21b7fe700 1 -- 172.21.15.73:0/948792963 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2040035d0 con 0x7fd204005230 2023-11-30T23:27:48.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd21a7fc700 1 --2- 172.21.15.73:0/948792963 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd204004870 0x7fd204004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:27:48.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd21b7fe700 1 -- 172.21.15.73:0/948792963 reap_dead start 2023-11-30T23:27:48.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd21b7fe700 1 --2- 172.21.15.73:0/948792963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd204005230 0x7fd20400ba30 secure :-1 s=READY pgs=4222 cs=0 l=1 rev1=1 crypto rx=0x7fd21400a820 tx=0x7fd2040058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d31c01de5b248dd server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:48.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd219ffb700 1 -- 172.21.15.73:0/948792963 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21400a2f0 con 0x7fd204005230 2023-11-30T23:27:48.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd219ffb700 1 -- 172.21.15.73:0/948792963 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2140072f0 con 0x7fd204005230 2023-11-30T23:27:48.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.046+0000 7fd219ffb700 1 -- 172.21.15.73:0/948792963 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2140076a0 con 0x7fd204005230 2023-11-30T23:27:48.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21bfff700 1 -- 172.21.15.73:0/948792963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd204005230 msgr2=0x7fd20400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21bfff700 1 --2- 172.21.15.73:0/948792963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd204005230 0x7fd20400ba30 secure :-1 s=READY pgs=4222 cs=0 l=1 rev1=1 crypto rx=0x7fd21400a820 tx=0x7fd2040058a0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21bfff700 1 -- 172.21.15.73:0/948792963 shutdown_connections 2023-11-30T23:27:48.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21bfff700 1 --2- 172.21.15.73:0/948792963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd204005230 0x7fd20400ba30 unknown :-1 s=CLOSED pgs=4222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21bfff700 1 -- 172.21.15.73:0/948792963 >> 172.21.15.73:0/948792963 conn(0x7fd21c071ee0 msgr2=0x7fd21c0bbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:48.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21bfff700 1 -- 172.21.15.73:0/948792963 shutdown_connections 2023-11-30T23:27:48.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21bfff700 1 -- 172.21.15.73:0/948792963 wait complete. 2023-11-30T23:27:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21bfff700 1 Processor -- start 2023-11-30T23:27:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21bfff700 1 -- start start 2023-11-30T23:27:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21bfff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd204005230 0x7fd21c1df200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd21c135d90 0x7fd21c1df980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd21c1392a0 0x7fd21c134c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21bfff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c1df740 con 0x7fd21c135d90 2023-11-30T23:27:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21bfff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c149640 con 0x7fd21c1392a0 2023-11-30T23:27:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21bfff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c136d80 con 0x7fd204005230 2023-11-30T23:27:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21a7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd21c135d90 0x7fd21c1df980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21a7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd21c135d90 0x7fd21c1df980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60826/0 (socket says 172.21.15.73:60826) 2023-11-30T23:27:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21a7fc700 1 -- 172.21.15.73:0/1987540637 learned_addr learned my addr 172.21.15.73:0/1987540637 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21affd700 1 --2- 172.21.15.73:0/1987540637 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd204005230 0x7fd21c1df200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.050+0000 7fd21b7fe700 1 --2- 172.21.15.73:0/1987540637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd21c1392a0 0x7fd21c134c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.054+0000 7fd21a7fc700 1 -- 172.21.15.73:0/1987540637 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd204005230 msgr2=0x7fd21c1df200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.054+0000 7fd21a7fc700 1 --2- 172.21.15.73:0/1987540637 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd204005230 0x7fd21c1df200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.054+0000 7fd21a7fc700 1 -- 172.21.15.73:0/1987540637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd21c1392a0 msgr2=0x7fd21c134c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.054+0000 7fd21a7fc700 1 --2- 172.21.15.73:0/1987540637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd21c1392a0 0x7fd21c134c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.054+0000 7fd21a7fc700 1 -- 172.21.15.73:0/1987540637 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c13ad30 con 0x7fd21c135d90 2023-11-30T23:27:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.054+0000 7fd21a7fc700 1 --2- 172.21.15.73:0/1987540637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd21c135d90 0x7fd21c1df980 secure :-1 s=READY pgs=4223 cs=0 l=1 rev1=1 crypto rx=0x7fd20c010920 tx=0x7fd20c010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.054+0000 7fd2037fe700 1 -- 172.21.15.73:0/1987540637 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c004020 con 0x7fd21c135d90 2023-11-30T23:27:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.054+0000 7fd2037fe700 1 -- 172.21.15.73:0/1987540637 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c004180 con 0x7fd21c135d90 2023-11-30T23:27:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.054+0000 7fd21bfff700 1 -- 172.21.15.73:0/1987540637 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21c1491a0 con 0x7fd21c135d90 2023-11-30T23:27:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.054+0000 7fd2037fe700 1 -- 172.21.15.73:0/1987540637 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c004530 con 0x7fd21c135d90 2023-11-30T23:27:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.054+0000 7fd21bfff700 1 -- 172.21.15.73:0/1987540637 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21c1dfec0 con 0x7fd21c135d90 2023-11-30T23:27:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.054+0000 7fd21bfff700 1 -- 172.21.15.73:0/1987540637 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd21c0b4820 con 0x7fd21c135d90 2023-11-30T23:27:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.054+0000 7fd2037fe700 1 -- 172.21.15.73:0/1987540637 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd20c0036c0 con 0x7fd21c135d90 2023-11-30T23:27:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.054+0000 7fd2037fe700 1 --2- 172.21.15.73:0/1987540637 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd208065ad0 0x7fd208067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.058+0000 7fd2037fe700 1 -- 172.21.15.73:0/1987540637 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fd20c083020 con 0x7fd21c135d90 2023-11-30T23:27:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.058+0000 7fd21affd700 1 --2- 172.21.15.73:0/1987540637 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd208065ad0 0x7fd208067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.058+0000 7fd2037fe700 1 --2- 172.21.15.73:0/1987540637 >> [v2:172.21.15.73:6816/36686,v1:172.21.15.73:6817/36686] conn(0x7fd20806ded0 0x7fd208070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.058+0000 7fd2037fe700 1 -- 172.21.15.73:0/1987540637 --> [v2:172.21.15.73:6816/36686,v1:172.21.15.73:6817/36686] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd208070a40 con 0x7fd20806ded0 2023-11-30T23:27:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.058+0000 7fd2037fe700 1 -- 172.21.15.73:0/1987540637 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd20c0856e0 con 0x7fd21c135d90 2023-11-30T23:27:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.058+0000 7fd21b7fe700 1 --2- 172.21.15.73:0/1987540637 >> [v2:172.21.15.73:6816/36686,v1:172.21.15.73:6817/36686] conn(0x7fd20806ded0 0x7fd208070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.058+0000 7fd21affd700 1 --2- 172.21.15.73:0/1987540637 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd208065ad0 0x7fd208067f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd210000c00 tx=0x7fd210009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.058+0000 7fd21b7fe700 1 --2- 172.21.15.73:0/1987540637 >> [v2:172.21.15.73:6816/36686,v1:172.21.15.73:6817/36686] conn(0x7fd20806ded0 0x7fd208070370 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:48.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.058+0000 7fd2037fe700 1 -- 172.21.15.73:0/1987540637 <== osd.0 v2:172.21.15.73:6816/36686 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd208070a40 con 0x7fd20806ded0 2023-11-30T23:27:48.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.074+0000 7fd21bfff700 1 -- 172.21.15.73:0/1987540637 --> [v2:172.21.15.73:6816/36686,v1:172.21.15.73:6817/36686] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd21c13aec0 con 0x7fd20806ded0 2023-11-30T23:27:48.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.074+0000 7fd2037fe700 1 -- 172.21.15.73:0/1987540637 <== osd.0 v2:172.21.15.73:6816/36686 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd21c13aec0 con 0x7fd20806ded0 2023-11-30T23:27:48.081 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-30T23:27:48.082 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-30T23:27:48.082 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-30T23:27:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.074+0000 7fd21bfff700 1 -- 172.21.15.73:0/1987540637 >> [v2:172.21.15.73:6816/36686,v1:172.21.15.73:6817/36686] conn(0x7fd20806ded0 msgr2=0x7fd208070370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.074+0000 7fd21bfff700 1 --2- 172.21.15.73:0/1987540637 >> [v2:172.21.15.73:6816/36686,v1:172.21.15.73:6817/36686] conn(0x7fd20806ded0 0x7fd208070370 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.074+0000 7fd21bfff700 1 -- 172.21.15.73:0/1987540637 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd208065ad0 msgr2=0x7fd208067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.074+0000 7fd21bfff700 1 --2- 172.21.15.73:0/1987540637 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd208065ad0 0x7fd208067f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd210000c00 tx=0x7fd210009040 comp rx=0 tx=0).stop 2023-11-30T23:27:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.074+0000 7fd21bfff700 1 -- 172.21.15.73:0/1987540637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd21c135d90 msgr2=0x7fd21c1df980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.074+0000 7fd21bfff700 1 --2- 172.21.15.73:0/1987540637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd21c135d90 0x7fd21c1df980 secure :-1 s=READY pgs=4223 cs=0 l=1 rev1=1 crypto rx=0x7fd20c010920 tx=0x7fd20c010c30 comp rx=0 tx=0).stop 2023-11-30T23:27:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.074+0000 7fd21b7fe700 1 -- 172.21.15.73:0/1987540637 reap_dead start 2023-11-30T23:27:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.074+0000 7fd21bfff700 1 -- 172.21.15.73:0/1987540637 shutdown_connections 2023-11-30T23:27:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.074+0000 7fd21bfff700 1 -- 172.21.15.73:0/1987540637 >> 172.21.15.73:0/1987540637 conn(0x7fd21c071ee0 msgr2=0x7fd21c0b8860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:48.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.078+0000 7fd21bfff700 1 -- 172.21.15.73:0/1987540637 shutdown_connections 2023-11-30T23:27:48.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.078+0000 7fd21bfff700 1 -- 172.21.15.73:0/1987540637 wait complete. 2023-11-30T23:27:48.094 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-30T23:27:48.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34759e700 1 Processor -- start 2023-11-30T23:27:48.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34759e700 1 -- start start 2023-11-30T23:27:48.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34759e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34814e1f0 0x7fb34814e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34759e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb3480afcc0 0x7fb348144700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34759e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb3480b24a0 0x7fb348144c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34759e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3480af5e0 con 0x7fb3480afcc0 2023-11-30T23:27:48.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34759e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34814ee90 con 0x7fb3480b24a0 2023-11-30T23:27:48.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34759e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3480b0fb0 con 0x7fb34814e1f0 2023-11-30T23:27:48.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb345d9b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb3480afcc0 0x7fb348144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb345d9b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb3480afcc0 0x7fb348144700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60828/0 (socket says 172.21.15.73:60828) 2023-11-30T23:27:48.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb345d9b700 1 -- 172.21.15.73:0/3224834876 learned_addr learned my addr 172.21.15.73:0/3224834876 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:48.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34659c700 1 --2- 172.21.15.73:0/3224834876 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34814e1f0 0x7fb34814e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb346d9d700 1 --2- 172.21.15.73:0/3224834876 >> v2:172.21.15.156:3300/0 conn(0x7fb3480b24a0 0x7fb348144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb345d9b700 1 -- 172.21.15.73:0/3224834876 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34814e1f0 msgr2=0x7fb34814e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:48.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb345d9b700 1 --2- 172.21.15.73:0/3224834876 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34814e1f0 0x7fb34814e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb345d9b700 1 -- 172.21.15.73:0/3224834876 >> v2:172.21.15.156:3300/0 conn(0x7fb3480b24a0 msgr2=0x7fb348144c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:48.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb345d9b700 1 --2- 172.21.15.73:0/3224834876 >> v2:172.21.15.156:3300/0 conn(0x7fb3480b24a0 0x7fb348144c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb345d9b700 1 -- 172.21.15.73:0/3224834876 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3480b1c80 con 0x7fb3480afcc0 2023-11-30T23:27:48.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb346d9d700 1 --2- 172.21.15.73:0/3224834876 >> v2:172.21.15.156:3300/0 conn(0x7fb3480b24a0 0x7fb348144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:27:48.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb345d9b700 1 --2- 172.21.15.73:0/3224834876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3480afcc0 0x7fb348144700 secure :-1 s=READY pgs=4224 cs=0 l=1 rev1=1 crypto rx=0x7fb34806dfe0 tx=0x7fb34000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc043a3c8318c0f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:48.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34559a700 1 -- 172.21.15.73:0/3224834876 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34000e070 con 0x7fb3480afcc0 2023-11-30T23:27:48.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34559a700 1 -- 172.21.15.73:0/3224834876 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34000b980 con 0x7fb3480afcc0 2023-11-30T23:27:48.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34559a700 1 -- 172.21.15.73:0/3224834876 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34000bd30 con 0x7fb3480afcc0 2023-11-30T23:27:48.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34759e700 1 -- 172.21.15.73:0/3224834876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3480afcc0 msgr2=0x7fb348144700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34759e700 1 --2- 172.21.15.73:0/3224834876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3480afcc0 0x7fb348144700 secure :-1 s=READY pgs=4224 cs=0 l=1 rev1=1 crypto rx=0x7fb34806dfe0 tx=0x7fb34000b330 comp rx=0 tx=0).stop 2023-11-30T23:27:48.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34759e700 1 -- 172.21.15.73:0/3224834876 shutdown_connections 2023-11-30T23:27:48.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34759e700 1 --2- 172.21.15.73:0/3224834876 >> v2:172.21.15.156:3300/0 conn(0x7fb3480b24a0 0x7fb348144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34759e700 1 --2- 172.21.15.73:0/3224834876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3480afcc0 0x7fb348144700 unknown :-1 s=CLOSED pgs=4224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34759e700 1 --2- 172.21.15.73:0/3224834876 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34814e1f0 0x7fb34814e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34759e700 1 -- 172.21.15.73:0/3224834876 >> 172.21.15.73:0/3224834876 conn(0x7fb3480b45a0 msgr2=0x7fb3480b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:48.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34759e700 1 -- 172.21.15.73:0/3224834876 shutdown_connections 2023-11-30T23:27:48.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.206+0000 7fb34759e700 1 -- 172.21.15.73:0/3224834876 wait complete. 2023-11-30T23:27:48.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.210+0000 7fb34759e700 1 Processor -- start 2023-11-30T23:27:48.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.210+0000 7fb34759e700 1 -- start start 2023-11-30T23:27:48.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.210+0000 7fb34759e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3480afcc0 0x7fb34814ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.210+0000 7fb34759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3480b24a0 0x7fb34813e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.210+0000 7fb34759e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34814e1f0 0x7fb34813c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.210+0000 7fb34759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3480b5c60 con 0x7fb3480b24a0 2023-11-30T23:27:48.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.210+0000 7fb34759e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34814b490 con 0x7fb3480afcc0 2023-11-30T23:27:48.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.210+0000 7fb34759e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34814b190 con 0x7fb34814e1f0 2023-11-30T23:27:48.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.210+0000 7fb345d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3480b24a0 0x7fb34813e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.210+0000 7fb345d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3480b24a0 0x7fb34813e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60830/0 (socket says 172.21.15.73:60830) 2023-11-30T23:27:48.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.210+0000 7fb345d9b700 1 -- 172.21.15.73:0/416829762 learned_addr learned my addr 172.21.15.73:0/416829762 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:48.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.210+0000 7fb34659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3480afcc0 0x7fb34814ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.210+0000 7fb346d9d700 1 --2- 172.21.15.73:0/416829762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34814e1f0 0x7fb34813c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.210+0000 7fb345d9b700 1 -- 172.21.15.73:0/416829762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34814e1f0 msgr2=0x7fb34813c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.210+0000 7fb345d9b700 1 --2- 172.21.15.73:0/416829762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34814e1f0 0x7fb34813c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.210+0000 7fb345d9b700 1 -- 172.21.15.73:0/416829762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3480afcc0 msgr2=0x7fb34814ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.210+0000 7fb345d9b700 1 --2- 172.21.15.73:0/416829762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3480afcc0 0x7fb34814ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.210+0000 7fb345d9b700 1 -- 172.21.15.73:0/416829762 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb340009b30 con 0x7fb3480b24a0 2023-11-30T23:27:48.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.214+0000 7fb345d9b700 1 --2- 172.21.15.73:0/416829762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3480b24a0 0x7fb34813e790 secure :-1 s=READY pgs=4225 cs=0 l=1 rev1=1 crypto rx=0x7fb34000b370 tx=0x7fb340004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:48.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.214+0000 7fb33effd700 1 -- 172.21.15.73:0/416829762 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3400092e0 con 0x7fb3480b24a0 2023-11-30T23:27:48.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.214+0000 7fb33effd700 1 -- 172.21.15.73:0/416829762 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb340004250 con 0x7fb3480b24a0 2023-11-30T23:27:48.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.214+0000 7fb34759e700 1 -- 172.21.15.73:0/416829762 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb348148c70 con 0x7fb3480b24a0 2023-11-30T23:27:48.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.214+0000 7fb33effd700 1 -- 172.21.15.73:0/416829762 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340004620 con 0x7fb3480b24a0 2023-11-30T23:27:48.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.214+0000 7fb34759e700 1 -- 172.21.15.73:0/416829762 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3480b8670 con 0x7fb3480b24a0 2023-11-30T23:27:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.214+0000 7fb34759e700 1 -- 172.21.15.73:0/416829762 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34804ed80 con 0x7fb3480b24a0 2023-11-30T23:27:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.214+0000 7fb33effd700 1 -- 172.21.15.73:0/416829762 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb340004780 con 0x7fb3480b24a0 2023-11-30T23:27:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.218+0000 7fb33effd700 1 --2- 172.21.15.73:0/416829762 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb328065ad0 0x7fb328067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.218+0000 7fb34659c700 1 --2- 172.21.15.73:0/416829762 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb328065ad0 0x7fb328067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.218+0000 7fb33effd700 1 -- 172.21.15.73:0/416829762 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fb340084610 con 0x7fb3480b24a0 2023-11-30T23:27:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.218+0000 7fb34659c700 1 --2- 172.21.15.73:0/416829762 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb328065ad0 0x7fb328067f90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb34814def0 tx=0x7fb330008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:48.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.222+0000 7fb33effd700 1 -- 172.21.15.73:0/416829762 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fb340051fb0 con 0x7fb3480b24a0 2023-11-30T23:27:48.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.382+0000 7fb34759e700 1 -- 172.21.15.73:0/416829762 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb34813eeb0 con 0x7fb328065ad0 2023-11-30T23:27:48.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.382+0000 7fb33effd700 1 -- 172.21.15.73:0/416829762 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb3300076d0 con 0x7fb328065ad0 2023-11-30T23:27:48.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.386+0000 7fb34759e700 1 -- 172.21.15.73:0/416829762 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb328065ad0 msgr2=0x7fb328067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.386+0000 7fb34759e700 1 --2- 172.21.15.73:0/416829762 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb328065ad0 0x7fb328067f90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb34814def0 tx=0x7fb330008040 comp rx=0 tx=0).stop 2023-11-30T23:27:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.386+0000 7fb34759e700 1 -- 172.21.15.73:0/416829762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3480b24a0 msgr2=0x7fb34813e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.386+0000 7fb34759e700 1 --2- 172.21.15.73:0/416829762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3480b24a0 0x7fb34813e790 secure :-1 s=READY pgs=4225 cs=0 l=1 rev1=1 crypto rx=0x7fb34000b370 tx=0x7fb340004af0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.386+0000 7fb34759e700 1 -- 172.21.15.73:0/416829762 shutdown_connections 2023-11-30T23:27:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.386+0000 7fb34759e700 1 --2- 172.21.15.73:0/416829762 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fb34814e1f0 0x7fb34813c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.386+0000 7fb34759e700 1 --2- 172.21.15.73:0/416829762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3480b24a0 0x7fb34813e790 unknown :-1 s=CLOSED pgs=4225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.386+0000 7fb34759e700 1 --2- 172.21.15.73:0/416829762 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fb328065ad0 0x7fb328067f90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.386+0000 7fb34759e700 1 --2- 172.21.15.73:0/416829762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3480afcc0 0x7fb34814ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.386+0000 7fb34759e700 1 -- 172.21.15.73:0/416829762 >> 172.21.15.73:0/416829762 conn(0x7fb3480b45a0 msgr2=0x7fb348142c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:48.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.386+0000 7fb34759e700 1 -- 172.21.15.73:0/416829762 shutdown_connections 2023-11-30T23:27:48.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.386+0000 7fb34759e700 1 -- 172.21.15.73:0/416829762 wait complete. 2023-11-30T23:27:48.393 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 0 to deep-scrub 2023-11-30T23:27:48.406 INFO:tasks.ceph:Scrubbing osd.1 2023-11-30T23:27:48.407 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-30T23:27:48.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.514+0000 7f684532b700 1 Processor -- start 2023-11-30T23:27:48.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.514+0000 7f684532b700 1 -- start start 2023-11-30T23:27:48.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.514+0000 7f684532b700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f68400b2780 0x7f68401432d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f684532b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68400b2b60 con 0x7f68400b3eb0 2023-11-30T23:27:48.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f684532b700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6840146da0 con 0x7f68401468c0 2023-11-30T23:27:48.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f684532b700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6840147080 con 0x7f68400b2780 2023-11-30T23:27:48.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f683f7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f68400b3eb0 0x7f684013cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48498/0 (socket says 172.21.15.73:48498) 2023-11-30T23:27:48.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f683f7fe700 1 -- 172.21.15.73:0/2905242920 learned_addr learned my addr 172.21.15.73:0/2905242920 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:27:48.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f683ffff700 1 --2- 172.21.15.73:0/2905242920 >> v2:172.21.15.156:3300/0 conn(0x7f68400b2780 0x7f68401432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f683effd700 1 -- 172.21.15.73:0/2905242920 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333794743 0 0) 0x7f68400b2b60 con 0x7f68400b3eb0 2023-11-30T23:27:48.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f683effd700 1 -- 172.21.15.73:0/2905242920 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68280035d0 con 0x7f68400b3eb0 2023-11-30T23:27:48.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f683ffff700 1 -- 172.21.15.73:0/2905242920 >> v1:172.21.15.156:6789/0 conn(0x7f68401468c0 legacy=0x7f684014dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f683ffff700 1 -- 172.21.15.73:0/2905242920 >> v1:172.21.15.73:6789/0 conn(0x7f68400b3eb0 legacy=0x7f684013cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f683ffff700 1 -- 172.21.15.73:0/2905242920 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6840147360 con 0x7f68400b2780 2023-11-30T23:27:48.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f683ffff700 1 --2- 172.21.15.73:0/2905242920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68400b2780 0x7f68401432d0 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7f6830009840 tx=0x7f6830009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea85362b753dadc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:48.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f683effd700 1 -- 172.21.15.73:0/2905242920 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6830005e50 con 0x7f68400b2780 2023-11-30T23:27:48.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f683effd700 1 -- 172.21.15.73:0/2905242920 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6830006030 con 0x7f68400b2780 2023-11-30T23:27:48.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f683effd700 1 -- 172.21.15.73:0/2905242920 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68300063c0 con 0x7f68400b2780 2023-11-30T23:27:48.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f684532b700 1 -- 172.21.15.73:0/2905242920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68400b2780 msgr2=0x7f68401432d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f684532b700 1 --2- 172.21.15.73:0/2905242920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68400b2780 0x7f68401432d0 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7f6830009840 tx=0x7f6830009b50 comp rx=0 tx=0).stop 2023-11-30T23:27:48.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f684532b700 1 -- 172.21.15.73:0/2905242920 shutdown_connections 2023-11-30T23:27:48.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f684532b700 1 --2- 172.21.15.73:0/2905242920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68400b2780 0x7f68401432d0 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f684532b700 1 -- 172.21.15.73:0/2905242920 >> 172.21.15.73:0/2905242920 conn(0x7f68400b7b70 msgr2=0x7f68400b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:48.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f684532b700 1 -- 172.21.15.73:0/2905242920 shutdown_connections 2023-11-30T23:27:48.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.518+0000 7f684532b700 1 -- 172.21.15.73:0/2905242920 wait complete. 2023-11-30T23:27:48.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f684532b700 1 Processor -- start 2023-11-30T23:27:48.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f684532b700 1 -- start start 2023-11-30T23:27:48.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f684532b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68400b2780 0x7f684013b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f684532b700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68401468c0 0x7f684013ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f684532b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68401d9b10 0x7f68401d9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f684532b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68400ae5a0 con 0x7f68400b2780 2023-11-30T23:27:48.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f684532b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68401d9630 con 0x7f68401d9b10 2023-11-30T23:27:48.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f684532b700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684013f4d0 con 0x7f68401468c0 2023-11-30T23:27:48.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f683ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68400b2780 0x7f684013b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f683ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68400b2780 0x7f684013b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60838/0 (socket says 172.21.15.73:60838) 2023-11-30T23:27:48.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f683ffff700 1 -- 172.21.15.73:0/140415204 learned_addr learned my addr 172.21.15.73:0/140415204 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:48.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f683f7fe700 1 --2- 172.21.15.73:0/140415204 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68401468c0 0x7f684013ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f6844b2a700 1 --2- 172.21.15.73:0/140415204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68401d9b10 0x7f68401d9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f683ffff700 1 -- 172.21.15.73:0/140415204 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68401468c0 msgr2=0x7f684013ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f683ffff700 1 --2- 172.21.15.73:0/140415204 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f68401468c0 0x7f684013ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f683ffff700 1 -- 172.21.15.73:0/140415204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68401d9b10 msgr2=0x7f68401d9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f683ffff700 1 --2- 172.21.15.73:0/140415204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68401d9b10 0x7f68401d9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f683ffff700 1 -- 172.21.15.73:0/140415204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6830009450 con 0x7f68400b2780 2023-11-30T23:27:48.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f683ffff700 1 --2- 172.21.15.73:0/140415204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68400b2780 0x7f684013b720 secure :-1 s=READY pgs=4227 cs=0 l=1 rev1=1 crypto rx=0x7f6830013040 tx=0x7f6830004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:48.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f683cff9700 1 -- 172.21.15.73:0/140415204 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6830004240 con 0x7f68400b2780 2023-11-30T23:27:48.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f683cff9700 1 -- 172.21.15.73:0/140415204 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68300043a0 con 0x7f68400b2780 2023-11-30T23:27:48.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f684532b700 1 -- 172.21.15.73:0/140415204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684013ce40 con 0x7f68400b2780 2023-11-30T23:27:48.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f683cff9700 1 -- 172.21.15.73:0/140415204 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68300036c0 con 0x7f68400b2780 2023-11-30T23:27:48.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.522+0000 7f684532b700 1 -- 172.21.15.73:0/140415204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6840071c50 con 0x7f68400b2780 2023-11-30T23:27:48.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.526+0000 7f684532b700 1 -- 172.21.15.73:0/140415204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f684013d4e0 con 0x7f68400b2780 2023-11-30T23:27:48.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.526+0000 7f683cff9700 1 -- 172.21.15.73:0/140415204 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6830022070 con 0x7f68400b2780 2023-11-30T23:27:48.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.526+0000 7f683cff9700 1 --2- 172.21.15.73:0/140415204 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f682c065ad0 0x7f682c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.526+0000 7f683cff9700 1 -- 172.21.15.73:0/140415204 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f6830084c40 con 0x7f68400b2780 2023-11-30T23:27:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.526+0000 7f683f7fe700 1 --2- 172.21.15.73:0/140415204 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f682c065ad0 0x7f682c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.526+0000 7f683cff9700 1 --2- 172.21.15.73:0/140415204 >> [v2:172.21.15.73:6808/36687,v1:172.21.15.73:6809/36687] conn(0x7f682c06de50 0x7f682c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.526+0000 7f683cff9700 1 -- 172.21.15.73:0/140415204 --> [v2:172.21.15.73:6808/36687,v1:172.21.15.73:6809/36687] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f682c0709c0 con 0x7f682c06de50 2023-11-30T23:27:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.526+0000 7f683cff9700 1 -- 172.21.15.73:0/140415204 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6830085090 con 0x7f68400b2780 2023-11-30T23:27:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.526+0000 7f6844b2a700 1 --2- 172.21.15.73:0/140415204 >> [v2:172.21.15.73:6808/36687,v1:172.21.15.73:6809/36687] conn(0x7f682c06de50 0x7f682c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.530+0000 7f683f7fe700 1 --2- 172.21.15.73:0/140415204 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f682c065ad0 0x7f682c067f90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6840072880 tx=0x7f6834009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:48.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.530+0000 7f6844b2a700 1 --2- 172.21.15.73:0/140415204 >> [v2:172.21.15.73:6808/36687,v1:172.21.15.73:6809/36687] conn(0x7f682c06de50 0x7f682c0702f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:48.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.530+0000 7f683cff9700 1 -- 172.21.15.73:0/140415204 <== osd.1 v2:172.21.15.73:6808/36687 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f682c0709c0 con 0x7f682c06de50 2023-11-30T23:27:48.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.550+0000 7f684532b700 1 -- 172.21.15.73:0/140415204 --> [v2:172.21.15.73:6808/36687,v1:172.21.15.73:6809/36687] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f684013f340 con 0x7f682c06de50 2023-11-30T23:27:48.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.550+0000 7f683cff9700 1 -- 172.21.15.73:0/140415204 <== osd.1 v2:172.21.15.73:6808/36687 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f684013f340 con 0x7f682c06de50 2023-11-30T23:27:48.555 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-30T23:27:48.556 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-30T23:27:48.556 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-30T23:27:48.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.550+0000 7f684532b700 1 -- 172.21.15.73:0/140415204 >> [v2:172.21.15.73:6808/36687,v1:172.21.15.73:6809/36687] conn(0x7f682c06de50 msgr2=0x7f682c0702f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.550+0000 7f684532b700 1 --2- 172.21.15.73:0/140415204 >> [v2:172.21.15.73:6808/36687,v1:172.21.15.73:6809/36687] conn(0x7f682c06de50 0x7f682c0702f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.550+0000 7f684532b700 1 -- 172.21.15.73:0/140415204 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f682c065ad0 msgr2=0x7f682c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.550+0000 7f684532b700 1 --2- 172.21.15.73:0/140415204 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f682c065ad0 0x7f682c067f90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6840072880 tx=0x7f6834009040 comp rx=0 tx=0).stop 2023-11-30T23:27:48.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.550+0000 7f684532b700 1 -- 172.21.15.73:0/140415204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68400b2780 msgr2=0x7f684013b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.550+0000 7f684532b700 1 --2- 172.21.15.73:0/140415204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68400b2780 0x7f684013b720 secure :-1 s=READY pgs=4227 cs=0 l=1 rev1=1 crypto rx=0x7f6830013040 tx=0x7f6830004770 comp rx=0 tx=0).stop 2023-11-30T23:27:48.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.550+0000 7f6844b2a700 1 -- 172.21.15.73:0/140415204 reap_dead start 2023-11-30T23:27:48.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.550+0000 7f684532b700 1 -- 172.21.15.73:0/140415204 shutdown_connections 2023-11-30T23:27:48.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.550+0000 7f684532b700 1 -- 172.21.15.73:0/140415204 >> 172.21.15.73:0/140415204 conn(0x7f68400b7b70 msgr2=0x7f68400af660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:48.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.550+0000 7f684532b700 1 -- 172.21.15.73:0/140415204 shutdown_connections 2023-11-30T23:27:48.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.550+0000 7f684532b700 1 -- 172.21.15.73:0/140415204 wait complete. 2023-11-30T23:27:48.568 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-30T23:27:48.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.678+0000 7f10f9657700 1 Processor -- start 2023-11-30T23:27:48.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.678+0000 7f10f9657700 1 -- start start 2023-11-30T23:27:48.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f9657700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f10f4073380 0x7f10f413e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f9657700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f10f4148120 0x7f10f413e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f9657700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f4073760 con 0x7f10f4070fc0 2023-11-30T23:27:48.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f9657700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f4071b30 con 0x7f10f4073380 2023-11-30T23:27:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f9657700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f4071e10 con 0x7f10f4148120 2023-11-30T23:27:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f37fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f10f4070fc0 0x7f10f4147a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48502/0 (socket says 172.21.15.73:48502) 2023-11-30T23:27:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f37fe700 1 -- 172.21.15.73:0/2929362571 learned_addr learned my addr 172.21.15.73:0/2929362571 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:27:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f8e56700 1 --2- 172.21.15.73:0/2929362571 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f10f4148120 0x7f10f413e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f3fff700 1 --2- 172.21.15.73:0/2929362571 >> v2:172.21.15.156:3300/0 conn(0x7f10f4073380 0x7f10f413e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f2ffd700 1 -- 172.21.15.73:0/2929362571 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743954006 0 0) 0x7f10f4073760 con 0x7f10f4070fc0 2023-11-30T23:27:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f2ffd700 1 -- 172.21.15.73:0/2929362571 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10e00035d0 con 0x7f10f4070fc0 2023-11-30T23:27:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f8e56700 1 -- 172.21.15.73:0/2929362571 >> v2:172.21.15.156:3300/0 conn(0x7f10f4073380 msgr2=0x7f10f413e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f8e56700 1 --2- 172.21.15.73:0/2929362571 >> v2:172.21.15.156:3300/0 conn(0x7f10f4073380 0x7f10f413e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f8e56700 1 -- 172.21.15.73:0/2929362571 >> v1:172.21.15.73:6789/0 conn(0x7f10f4070fc0 legacy=0x7f10f4147a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f8e56700 1 -- 172.21.15.73:0/2929362571 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f40720f0 con 0x7f10f4148120 2023-11-30T23:27:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f8e56700 1 --2- 172.21.15.73:0/2929362571 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f10f4148120 0x7f10f413e790 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f10ec009d90 tx=0x7f10ec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f69a8cdf5ec6e632 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f2ffd700 1 -- 172.21.15.73:0/2929362571 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec00e070 con 0x7f10f4148120 2023-11-30T23:27:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f2ffd700 1 -- 172.21.15.73:0/2929362571 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec00bb20 con 0x7f10f4148120 2023-11-30T23:27:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f2ffd700 1 -- 172.21.15.73:0/2929362571 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec00be90 con 0x7f10f4148120 2023-11-30T23:27:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f9657700 1 -- 172.21.15.73:0/2929362571 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f10f4148120 msgr2=0x7f10f413e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f9657700 1 --2- 172.21.15.73:0/2929362571 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f10f4148120 0x7f10f413e790 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f10ec009d90 tx=0x7f10ec00b330 comp rx=0 tx=0).stop 2023-11-30T23:27:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f9657700 1 -- 172.21.15.73:0/2929362571 shutdown_connections 2023-11-30T23:27:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f9657700 1 --2- 172.21.15.73:0/2929362571 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f10f4148120 0x7f10f413e790 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f9657700 1 --2- 172.21.15.73:0/2929362571 >> v2:172.21.15.156:3300/0 conn(0x7f10f4073380 0x7f10f413e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f9657700 1 -- 172.21.15.73:0/2929362571 >> 172.21.15.73:0/2929362571 conn(0x7f10f406a180 msgr2=0x7f10f406a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f9657700 1 -- 172.21.15.73:0/2929362571 shutdown_connections 2023-11-30T23:27:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.682+0000 7f10f9657700 1 -- 172.21.15.73:0/2929362571 wait complete. 2023-11-30T23:27:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f9657700 1 Processor -- start 2023-11-30T23:27:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f9657700 1 -- start start 2023-11-30T23:27:48.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f9657700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10f4070fc0 0x7f10f4146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f9657700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f10f4073380 0x7f10f4143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f9657700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10f4148120 0x7f10f4143c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f9657700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f4144b00 con 0x7f10f4148120 2023-11-30T23:27:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f9657700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f4146e80 con 0x7f10f4070fc0 2023-11-30T23:27:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f9657700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f4145050 con 0x7f10f4073380 2023-11-30T23:27:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f8e56700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10f4148120 0x7f10f4143c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f8e56700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10f4148120 0x7f10f4143c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60840/0 (socket says 172.21.15.73:60840) 2023-11-30T23:27:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f8e56700 1 -- 172.21.15.73:0/1568678140 learned_addr learned my addr 172.21.15.73:0/1568678140 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f37fe700 1 --2- 172.21.15.73:0/1568678140 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f10f4073380 0x7f10f4143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f3fff700 1 --2- 172.21.15.73:0/1568678140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10f4070fc0 0x7f10f4146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f8e56700 1 -- 172.21.15.73:0/1568678140 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f10f4073380 msgr2=0x7f10f4143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f8e56700 1 --2- 172.21.15.73:0/1568678140 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f10f4073380 0x7f10f4143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f8e56700 1 -- 172.21.15.73:0/1568678140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10f4070fc0 msgr2=0x7f10f4146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f8e56700 1 --2- 172.21.15.73:0/1568678140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10f4070fc0 0x7f10f4146940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f8e56700 1 -- 172.21.15.73:0/1568678140 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec009a70 con 0x7f10f4148120 2023-11-30T23:27:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f8e56700 1 --2- 172.21.15.73:0/1568678140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10f4148120 0x7f10f4143c50 secure :-1 s=READY pgs=4229 cs=0 l=1 rev1=1 crypto rx=0x7f10ec013000 tx=0x7f10ec004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f0ff9700 1 -- 172.21.15.73:0/1568678140 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec007000 con 0x7f10f4148120 2023-11-30T23:27:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f9657700 1 -- 172.21.15.73:0/1568678140 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f4147060 con 0x7f10f4148120 2023-11-30T23:27:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f0ff9700 1 -- 172.21.15.73:0/1568678140 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec004980 con 0x7f10f4148120 2023-11-30T23:27:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f0ff9700 1 -- 172.21.15.73:0/1568678140 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec012890 con 0x7f10f4148120 2023-11-30T23:27:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.686+0000 7f10f9657700 1 -- 172.21.15.73:0/1568678140 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f4144ce0 con 0x7f10f4148120 2023-11-30T23:27:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.690+0000 7f10f9657700 1 -- 172.21.15.73:0/1568678140 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f4145200 con 0x7f10f4148120 2023-11-30T23:27:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.690+0000 7f10f0ff9700 1 -- 172.21.15.73:0/1568678140 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f10ec0129f0 con 0x7f10f4148120 2023-11-30T23:27:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.690+0000 7f10f0ff9700 1 --2- 172.21.15.73:0/1568678140 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f10d4065ad0 0x7f10d4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.690+0000 7f10f0ff9700 1 -- 172.21.15.73:0/1568678140 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f10ec084e30 con 0x7f10f4148120 2023-11-30T23:27:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.690+0000 7f10f3fff700 1 --2- 172.21.15.73:0/1568678140 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f10d4065ad0 0x7f10d4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.690+0000 7f10f3fff700 1 --2- 172.21.15.73:0/1568678140 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f10d4065ad0 0x7f10d4067f90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009bf0 tx=0x7f10e4009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:48.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.698+0000 7f10f0ff9700 1 -- 172.21.15.73:0/1568678140 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f10f4145200 con 0x7f10f4148120 2023-11-30T23:27:48.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.858+0000 7f10f9657700 1 -- 172.21.15.73:0/1568678140 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f10f406b620 con 0x7f10d4065ad0 2023-11-30T23:27:48.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.858+0000 7f10f0ff9700 1 -- 172.21.15.73:0/1568678140 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f10e4004020 con 0x7f10d4065ad0 2023-11-30T23:27:48.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.862+0000 7f10f9657700 1 -- 172.21.15.73:0/1568678140 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f10d4065ad0 msgr2=0x7f10d4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.862+0000 7f10f9657700 1 --2- 172.21.15.73:0/1568678140 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f10d4065ad0 0x7f10d4067f90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009bf0 tx=0x7f10e4009240 comp rx=0 tx=0).stop 2023-11-30T23:27:48.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.862+0000 7f10f9657700 1 -- 172.21.15.73:0/1568678140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10f4148120 msgr2=0x7f10f4143c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:48.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.862+0000 7f10f9657700 1 --2- 172.21.15.73:0/1568678140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10f4148120 0x7f10f4143c50 secure :-1 s=READY pgs=4229 cs=0 l=1 rev1=1 crypto rx=0x7f10ec013000 tx=0x7f10ec004af0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.862+0000 7f10f9657700 1 -- 172.21.15.73:0/1568678140 shutdown_connections 2023-11-30T23:27:48.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.862+0000 7f10f9657700 1 --2- 172.21.15.73:0/1568678140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10f4148120 0x7f10f4143c50 unknown :-1 s=CLOSED pgs=4229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.862+0000 7f10f9657700 1 --2- 172.21.15.73:0/1568678140 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f10f4073380 0x7f10f4143710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.862+0000 7f10f9657700 1 --2- 172.21.15.73:0/1568678140 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f10d4065ad0 0x7f10d4067f90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.862+0000 7f10f9657700 1 --2- 172.21.15.73:0/1568678140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10f4070fc0 0x7f10f4146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.862+0000 7f10f9657700 1 -- 172.21.15.73:0/1568678140 >> 172.21.15.73:0/1568678140 conn(0x7f10f406a180 msgr2=0x7f10f41390f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.862+0000 7f10f9657700 1 -- 172.21.15.73:0/1568678140 shutdown_connections 2023-11-30T23:27:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.862+0000 7f10f9657700 1 -- 172.21.15.73:0/1568678140 wait complete. 2023-11-30T23:27:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 1 to deep-scrub 2023-11-30T23:27:48.882 INFO:tasks.ceph:Scrubbing osd.2 2023-11-30T23:27:48.883 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-30T23:27:48.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.990+0000 7fc3a33ad700 1 Processor -- start 2023-11-30T23:27:48.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.990+0000 7fc3a33ad700 1 -- start start 2023-11-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a33ad700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc39c146910 0x7fc39c06b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a33ad700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc39c140d60 0x7fc39c14dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a33ad700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39c0b1210 con 0x7fc39c073380 2023-11-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a33ad700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc39c0b1660 con 0x7fc39c140d60 2023-11-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a33ad700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c06b8f0 con 0x7fc39c146910 2023-11-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a23ab700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc39c073380 0x7fc39c140650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48516/0 (socket says 172.21.15.73:48516) 2023-11-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a23ab700 1 -- 172.21.15.73:0/2741844659 learned_addr learned my addr 172.21.15.73:0/2741844659 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:27:48.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a2bac700 1 --2- 172.21.15.73:0/2741844659 >> v2:172.21.15.156:3300/0 conn(0x7fc39c140d60 0x7fc39c14dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a1baa700 1 --2- 172.21.15.73:0/2741844659 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc39c146910 0x7fc39c06b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a13a9700 1 -- 172.21.15.73:0/2741844659 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105455263 0 0) 0x7fc39c0b1210 con 0x7fc39c073380 2023-11-30T23:27:49.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a13a9700 1 -- 172.21.15.73:0/2741844659 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3880057e0 con 0x7fc39c073380 2023-11-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a2bac700 1 -- 172.21.15.73:0/2741844659 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc39c146910 msgr2=0x7fc39c06b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a2bac700 1 --2- 172.21.15.73:0/2741844659 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc39c146910 0x7fc39c06b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a2bac700 1 -- 172.21.15.73:0/2741844659 >> v1:172.21.15.73:6789/0 conn(0x7fc39c073380 legacy=0x7fc39c140650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a2bac700 1 -- 172.21.15.73:0/2741844659 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c073760 con 0x7fc39c140d60 2023-11-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a2bac700 1 --2- 172.21.15.73:0/2741844659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc39c140d60 0x7fc39c14dc40 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7fc394009d90 tx=0x7fc39400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad894dab6c71f545 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a13a9700 1 -- 172.21.15.73:0/2741844659 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39400e070 con 0x7fc39c140d60 2023-11-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a13a9700 1 -- 172.21.15.73:0/2741844659 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39400bb20 con 0x7fc39c140d60 2023-11-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a13a9700 1 -- 172.21.15.73:0/2741844659 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39400be90 con 0x7fc39c140d60 2023-11-30T23:27:49.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a33ad700 1 -- 172.21.15.73:0/2741844659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc39c140d60 msgr2=0x7fc39c14dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a33ad700 1 --2- 172.21.15.73:0/2741844659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc39c140d60 0x7fc39c14dc40 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7fc394009d90 tx=0x7fc39400b330 comp rx=0 tx=0).stop 2023-11-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a33ad700 1 -- 172.21.15.73:0/2741844659 shutdown_connections 2023-11-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a33ad700 1 --2- 172.21.15.73:0/2741844659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc39c140d60 0x7fc39c14dc40 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a33ad700 1 --2- 172.21.15.73:0/2741844659 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc39c146910 0x7fc39c06b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a33ad700 1 -- 172.21.15.73:0/2741844659 >> 172.21.15.73:0/2741844659 conn(0x7fc39c06a180 msgr2=0x7fc39c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a33ad700 1 -- 172.21.15.73:0/2741844659 shutdown_connections 2023-11-30T23:27:49.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.994+0000 7fc3a33ad700 1 -- 172.21.15.73:0/2741844659 wait complete. 2023-11-30T23:27:49.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a33ad700 1 Processor -- start 2023-11-30T23:27:49.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a33ad700 1 -- start start 2023-11-30T23:27:49.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a33ad700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc39c073380 0x7fc39c070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a33ad700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc39c140d60 0x7fc39c070e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a33ad700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc39c146910 0x7fc39c1dabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a33ad700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c070270 con 0x7fc39c146910 2023-11-30T23:27:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a33ad700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c071960 con 0x7fc39c140d60 2023-11-30T23:27:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a33ad700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c06fb60 con 0x7fc39c073380 2023-11-30T23:27:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a2bac700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc39c146910 0x7fc39c1dabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a1baa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc39c140d60 0x7fc39c070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a2bac700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc39c146910 0x7fc39c1dabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60854/0 (socket says 172.21.15.73:60854) 2023-11-30T23:27:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a2bac700 1 -- 172.21.15.73:0/4144643093 learned_addr learned my addr 172.21.15.73:0/4144643093 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a23ab700 1 --2- 172.21.15.73:0/4144643093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc39c073380 0x7fc39c070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a2bac700 1 -- 172.21.15.73:0/4144643093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc39c073380 msgr2=0x7fc39c070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a2bac700 1 --2- 172.21.15.73:0/4144643093 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc39c073380 0x7fc39c070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a2bac700 1 -- 172.21.15.73:0/4144643093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc39c140d60 msgr2=0x7fc39c070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a2bac700 1 --2- 172.21.15.73:0/4144643093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc39c140d60 0x7fc39c070e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a2bac700 1 -- 172.21.15.73:0/4144643093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc394009a70 con 0x7fc39c146910 2023-11-30T23:27:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a1baa700 1 --2- 172.21.15.73:0/4144643093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc39c140d60 0x7fc39c070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:27:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a2bac700 1 --2- 172.21.15.73:0/4144643093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc39c146910 0x7fc39c1dabd0 secure :-1 s=READY pgs=4231 cs=0 l=1 rev1=1 crypto rx=0x7fc394014040 tx=0x7fc394004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc392ffd700 1 -- 172.21.15.73:0/4144643093 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394004940 con 0x7fc39c146910 2023-11-30T23:27:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc392ffd700 1 -- 172.21.15.73:0/4144643093 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc394003e30 con 0x7fc39c146910 2023-11-30T23:27:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a33ad700 1 -- 172.21.15.73:0/4144643093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39c06ff90 con 0x7fc39c146910 2023-11-30T23:27:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc392ffd700 1 -- 172.21.15.73:0/4144643093 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394012670 con 0x7fc39c146910 2023-11-30T23:27:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:48.998+0000 7fc3a33ad700 1 -- 172.21.15.73:0/4144643093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39c146000 con 0x7fc39c146910 2023-11-30T23:27:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.002+0000 7fc3a33ad700 1 -- 172.21.15.73:0/4144643093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc39c0b1b50 con 0x7fc39c146910 2023-11-30T23:27:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.002+0000 7fc392ffd700 1 -- 172.21.15.73:0/4144643093 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc3940127d0 con 0x7fc39c146910 2023-11-30T23:27:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.002+0000 7fc392ffd700 1 --2- 172.21.15.73:0/4144643093 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc380065ad0 0x7fc380067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.002+0000 7fc392ffd700 1 -- 172.21.15.73:0/4144643093 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc3940855f0 con 0x7fc39c146910 2023-11-30T23:27:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.002+0000 7fc3a23ab700 1 --2- 172.21.15.73:0/4144643093 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc380065ad0 0x7fc380067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.002+0000 7fc392ffd700 1 --2- 172.21.15.73:0/4144643093 >> [v2:172.21.15.73:6824/36688,v1:172.21.15.73:6825/36688] conn(0x7fc38006de50 0x7fc3800702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.002+0000 7fc392ffd700 1 -- 172.21.15.73:0/4144643093 --> [v2:172.21.15.73:6824/36688,v1:172.21.15.73:6825/36688] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3800709c0 con 0x7fc38006de50 2023-11-30T23:27:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.002+0000 7fc392ffd700 1 -- 172.21.15.73:0/4144643093 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc394087bd0 con 0x7fc39c146910 2023-11-30T23:27:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.002+0000 7fc3a1baa700 1 --2- 172.21.15.73:0/4144643093 >> [v2:172.21.15.73:6824/36688,v1:172.21.15.73:6825/36688] conn(0x7fc38006de50 0x7fc3800702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.002+0000 7fc3a1baa700 1 --2- 172.21.15.73:0/4144643093 >> [v2:172.21.15.73:6824/36688,v1:172.21.15.73:6825/36688] conn(0x7fc38006de50 0x7fc3800702f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.002+0000 7fc3a23ab700 1 --2- 172.21.15.73:0/4144643093 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc380065ad0 0x7fc380067f90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc398007fd0 tx=0x7fc398009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.006+0000 7fc392ffd700 1 -- 172.21.15.73:0/4144643093 <== osd.2 v2:172.21.15.73:6824/36688 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc3800709c0 con 0x7fc38006de50 2023-11-30T23:27:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.022+0000 7fc3a33ad700 1 -- 172.21.15.73:0/4144643093 --> [v2:172.21.15.73:6824/36688,v1:172.21.15.73:6825/36688] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc39c0b1870 con 0x7fc38006de50 2023-11-30T23:27:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.022+0000 7fc392ffd700 1 -- 172.21.15.73:0/4144643093 <== osd.2 v2:172.21.15.73:6824/36688 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc38c0114a0 con 0x7fc38006de50 2023-11-30T23:27:49.027 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-30T23:27:49.027 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-30T23:27:49.027 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-30T23:27:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.022+0000 7fc3a33ad700 1 -- 172.21.15.73:0/4144643093 >> [v2:172.21.15.73:6824/36688,v1:172.21.15.73:6825/36688] conn(0x7fc38006de50 msgr2=0x7fc3800702f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.022+0000 7fc3a33ad700 1 --2- 172.21.15.73:0/4144643093 >> [v2:172.21.15.73:6824/36688,v1:172.21.15.73:6825/36688] conn(0x7fc38006de50 0x7fc3800702f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.022+0000 7fc3a33ad700 1 -- 172.21.15.73:0/4144643093 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc380065ad0 msgr2=0x7fc380067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.022+0000 7fc3a33ad700 1 --2- 172.21.15.73:0/4144643093 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc380065ad0 0x7fc380067f90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc398007fd0 tx=0x7fc398009040 comp rx=0 tx=0).stop 2023-11-30T23:27:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.022+0000 7fc3a33ad700 1 -- 172.21.15.73:0/4144643093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc39c146910 msgr2=0x7fc39c1dabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.022+0000 7fc3a33ad700 1 --2- 172.21.15.73:0/4144643093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc39c146910 0x7fc39c1dabd0 secure :-1 s=READY pgs=4231 cs=0 l=1 rev1=1 crypto rx=0x7fc394014040 tx=0x7fc394004af0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.022+0000 7fc3a2bac700 1 -- 172.21.15.73:0/4144643093 reap_dead start 2023-11-30T23:27:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.022+0000 7fc3a33ad700 1 -- 172.21.15.73:0/4144643093 shutdown_connections 2023-11-30T23:27:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.022+0000 7fc3a33ad700 1 -- 172.21.15.73:0/4144643093 >> 172.21.15.73:0/4144643093 conn(0x7fc39c06a180 msgr2=0x7fc39c0b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.022+0000 7fc3a33ad700 1 -- 172.21.15.73:0/4144643093 shutdown_connections 2023-11-30T23:27:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.022+0000 7fc3a33ad700 1 -- 172.21.15.73:0/4144643093 wait complete. 2023-11-30T23:27:49.040 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-30T23:27:49.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62cb1b4700 1 Processor -- start 2023-11-30T23:27:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62cb1b4700 1 -- start start 2023-11-30T23:27:49.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62cb1b4700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f62c4140b80 0x7f62c406c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62cb1b4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f62c40b80b0 0x7f62c406c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62cb1b4700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c40b95e0 con 0x7f62c40b9ff0 2023-11-30T23:27:49.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62cb1b4700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c406cdc0 con 0x7f62c40b80b0 2023-11-30T23:27:49.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62cb1b4700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c40ba3d0 con 0x7f62c4140b80 2023-11-30T23:27:49.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62ca9b3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f62c40b80b0 0x7f62c406c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62ca9b3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f62c40b80b0 0x7f62c406c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60868/0 (socket says 172.21.15.73:60868) 2023-11-30T23:27:49.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62ca1b2700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f62c40b9ff0 0x7f62c4140470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48520/0 (socket says 172.21.15.73:48520) 2023-11-30T23:27:49.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62ca9b3700 1 -- 172.21.15.73:0/3402566596 learned_addr learned my addr 172.21.15.73:0/3402566596 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:49.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62c99b1700 1 --2- 172.21.15.73:0/3402566596 >> v2:172.21.15.156:3300/0 conn(0x7f62c4140b80 0x7f62c406c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62ca9b3700 1 -- 172.21.15.73:0/3402566596 >> v2:172.21.15.156:3300/0 conn(0x7f62c4140b80 msgr2=0x7f62c406c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:49.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62ca9b3700 1 --2- 172.21.15.73:0/3402566596 >> v2:172.21.15.156:3300/0 conn(0x7f62c4140b80 0x7f62c406c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62ca9b3700 1 -- 172.21.15.73:0/3402566596 >> v1:172.21.15.73:6789/0 conn(0x7f62c40b9ff0 legacy=0x7f62c4140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62ca9b3700 1 -- 172.21.15.73:0/3402566596 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40b8f90 con 0x7f62c40b80b0 2023-11-30T23:27:49.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62ca9b3700 1 --2- 172.21.15.73:0/3402566596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62c40b80b0 0x7f62c406c880 secure :-1 s=READY pgs=4233 cs=0 l=1 rev1=1 crypto rx=0x7f62c40ba760 tx=0x7f62bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cb8d4da2284684 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:49.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62c91b0700 1 -- 172.21.15.73:0/3402566596 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc00e070 con 0x7f62c40b80b0 2023-11-30T23:27:49.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62c91b0700 1 -- 172.21.15.73:0/3402566596 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc00b910 con 0x7f62c40b80b0 2023-11-30T23:27:49.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62c91b0700 1 -- 172.21.15.73:0/3402566596 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc00bcc0 con 0x7f62c40b80b0 2023-11-30T23:27:49.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62cb1b4700 1 -- 172.21.15.73:0/3402566596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62c40b80b0 msgr2=0x7f62c406c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62cb1b4700 1 --2- 172.21.15.73:0/3402566596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62c40b80b0 0x7f62c406c880 secure :-1 s=READY pgs=4233 cs=0 l=1 rev1=1 crypto rx=0x7f62c40ba760 tx=0x7f62bc00b330 comp rx=0 tx=0).stop 2023-11-30T23:27:49.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62cb1b4700 1 -- 172.21.15.73:0/3402566596 shutdown_connections 2023-11-30T23:27:49.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62cb1b4700 1 --2- 172.21.15.73:0/3402566596 >> v2:172.21.15.156:3300/0 conn(0x7f62c4140b80 0x7f62c406c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62cb1b4700 1 --2- 172.21.15.73:0/3402566596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62c40b80b0 0x7f62c406c880 unknown :-1 s=CLOSED pgs=4233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62cb1b4700 1 -- 172.21.15.73:0/3402566596 >> 172.21.15.73:0/3402566596 conn(0x7f62c406a180 msgr2=0x7f62c406a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:49.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62cb1b4700 1 -- 172.21.15.73:0/3402566596 shutdown_connections 2023-11-30T23:27:49.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.154+0000 7f62cb1b4700 1 -- 172.21.15.73:0/3402566596 wait complete. 2023-11-30T23:27:49.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62cb1b4700 1 Processor -- start 2023-11-30T23:27:49.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62cb1b4700 1 -- start start 2023-11-30T23:27:49.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62cb1b4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62c40b80b0 0x7f62c41420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62cb1b4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62c40b9ff0 0x7f62c41dee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62cb1b4700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62c4140b80 0x7f62c41df340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62cb1b4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c41425f0 con 0x7f62c40b80b0 2023-11-30T23:27:49.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62cb1b4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4141a40 con 0x7f62c40b9ff0 2023-11-30T23:27:49.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62cb1b4700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4143db0 con 0x7f62c4140b80 2023-11-30T23:27:49.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62ca1b2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62c40b80b0 0x7f62c41420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62ca1b2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62c40b80b0 0x7f62c41420b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60872/0 (socket says 172.21.15.73:60872) 2023-11-30T23:27:49.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62ca1b2700 1 -- 172.21.15.73:0/1035437042 learned_addr learned my addr 172.21.15.73:0/1035437042 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:49.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62c99b1700 1 --2- 172.21.15.73:0/1035437042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62c40b9ff0 0x7f62c41dee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62ca9b3700 1 --2- 172.21.15.73:0/1035437042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62c4140b80 0x7f62c41df340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62ca1b2700 1 -- 172.21.15.73:0/1035437042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62c4140b80 msgr2=0x7f62c41df340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62ca1b2700 1 --2- 172.21.15.73:0/1035437042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62c4140b80 0x7f62c41df340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62ca1b2700 1 -- 172.21.15.73:0/1035437042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62c40b9ff0 msgr2=0x7f62c41dee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62ca1b2700 1 --2- 172.21.15.73:0/1035437042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62c40b9ff0 0x7f62c41dee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62ca1b2700 1 -- 172.21.15.73:0/1035437042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc009b30 con 0x7f62c40b80b0 2023-11-30T23:27:49.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62ca1b2700 1 --2- 172.21.15.73:0/1035437042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62c40b80b0 0x7f62c41420b0 secure :-1 s=READY pgs=4234 cs=0 l=1 rev1=1 crypto rx=0x7f62c000c500 tx=0x7f62c000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:49.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62baffd700 1 -- 172.21.15.73:0/1035437042 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c0005cd0 con 0x7f62c40b80b0 2023-11-30T23:27:49.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62baffd700 1 -- 172.21.15.73:0/1035437042 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c0005e30 con 0x7f62c40b80b0 2023-11-30T23:27:49.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62cb1b4700 1 -- 172.21.15.73:0/1035437042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c41413f0 con 0x7f62c40b80b0 2023-11-30T23:27:49.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62baffd700 1 -- 172.21.15.73:0/1035437042 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c00072f0 con 0x7f62c40b80b0 2023-11-30T23:27:49.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.158+0000 7f62cb1b4700 1 -- 172.21.15.73:0/1035437042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c4143ad0 con 0x7f62c40b80b0 2023-11-30T23:27:49.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.162+0000 7f62cb1b4700 1 -- 172.21.15.73:0/1035437042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c404ed80 con 0x7f62c40b80b0 2023-11-30T23:27:49.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.162+0000 7f62baffd700 1 -- 172.21.15.73:0/1035437042 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f62c0007450 con 0x7f62c40b80b0 2023-11-30T23:27:49.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.162+0000 7f62baffd700 1 --2- 172.21.15.73:0/1035437042 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f62a8065b00 0x7f62a8067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.162+0000 7f62baffd700 1 -- 172.21.15.73:0/1035437042 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f62c00824f0 con 0x7f62c40b80b0 2023-11-30T23:27:49.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.162+0000 7f62c99b1700 1 --2- 172.21.15.73:0/1035437042 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f62a8065b00 0x7f62a8067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.162+0000 7f62c99b1700 1 --2- 172.21.15.73:0/1035437042 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f62a8065b00 0x7f62a8067fc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f62c4145f30 tx=0x7f62b4009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:49.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.170+0000 7f62baffd700 1 -- 172.21.15.73:0/1035437042 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f62c004feb0 con 0x7f62c40b80b0 2023-11-30T23:27:49.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.334+0000 7f62cb1b4700 1 -- 172.21.15.73:0/1035437042 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f62c40b9270 con 0x7f62a8065b00 2023-11-30T23:27:49.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.334+0000 7f62baffd700 1 -- 172.21.15.73:0/1035437042 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f62b4011830 con 0x7f62a8065b00 2023-11-30T23:27:49.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.338+0000 7f62cb1b4700 1 -- 172.21.15.73:0/1035437042 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f62a8065b00 msgr2=0x7f62a8067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.338+0000 7f62cb1b4700 1 --2- 172.21.15.73:0/1035437042 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f62a8065b00 0x7f62a8067fc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f62c4145f30 tx=0x7f62b4009240 comp rx=0 tx=0).stop 2023-11-30T23:27:49.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.338+0000 7f62cb1b4700 1 -- 172.21.15.73:0/1035437042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62c40b80b0 msgr2=0x7f62c41420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.338+0000 7f62cb1b4700 1 --2- 172.21.15.73:0/1035437042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62c40b80b0 0x7f62c41420b0 secure :-1 s=READY pgs=4234 cs=0 l=1 rev1=1 crypto rx=0x7f62c000c500 tx=0x7f62c000c810 comp rx=0 tx=0).stop 2023-11-30T23:27:49.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.338+0000 7f62cb1b4700 1 -- 172.21.15.73:0/1035437042 shutdown_connections 2023-11-30T23:27:49.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.338+0000 7f62cb1b4700 1 --2- 172.21.15.73:0/1035437042 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f62c4140b80 0x7f62c41df340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.338+0000 7f62cb1b4700 1 --2- 172.21.15.73:0/1035437042 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f62a8065b00 0x7f62a8067fc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.338+0000 7f62cb1b4700 1 --2- 172.21.15.73:0/1035437042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62c40b9ff0 0x7f62c41dee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.338+0000 7f62cb1b4700 1 --2- 172.21.15.73:0/1035437042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62c40b80b0 0x7f62c41420b0 unknown :-1 s=CLOSED pgs=4234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.338+0000 7f62cb1b4700 1 -- 172.21.15.73:0/1035437042 >> 172.21.15.73:0/1035437042 conn(0x7f62c406a180 msgr2=0x7f62c406c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:49.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.338+0000 7f62cb1b4700 1 -- 172.21.15.73:0/1035437042 shutdown_connections 2023-11-30T23:27:49.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.338+0000 7f62cb1b4700 1 -- 172.21.15.73:0/1035437042 wait complete. 2023-11-30T23:27:49.344 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 2 to deep-scrub 2023-11-30T23:27:49.354 INFO:tasks.ceph:Scrubbing osd.3 2023-11-30T23:27:49.355 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-30T23:27:49.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff065486700 1 Processor -- start 2023-11-30T23:27:49.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff065486700 1 -- start start 2023-11-30T23:27:49.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff065486700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff0600bcb00 0x7ff0600b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff065486700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff060140550 0x7ff0601409a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff065486700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0600b4010 con 0x7ff06014a150 2023-11-30T23:27:49.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff065486700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0600b6110 con 0x7ff0600bcb00 2023-11-30T23:27:49.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff065486700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0600b4820 con 0x7ff060140550 2023-11-30T23:27:49.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff05ffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff0600bcb00 0x7ff0600b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff05f7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff06014a150 0x7ff06014a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48528/0 (socket says 172.21.15.73:48528) 2023-11-30T23:27:49.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff05f7fe700 1 -- 172.21.15.73:0/4093016929 learned_addr learned my addr 172.21.15.73:0/4093016929 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:27:49.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff05ffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff0600bcb00 0x7ff0600b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60880/0 (socket says 172.21.15.73:60880) 2023-11-30T23:27:49.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff064c85700 1 --2- 172.21.15.73:0/4093016929 >> v2:172.21.15.156:3300/0 conn(0x7ff060140550 0x7ff0601409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff05ffff700 1 -- 172.21.15.73:0/4093016929 >> v2:172.21.15.156:3300/0 conn(0x7ff060140550 msgr2=0x7ff0601409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:49.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff05ffff700 1 --2- 172.21.15.73:0/4093016929 >> v2:172.21.15.156:3300/0 conn(0x7ff060140550 0x7ff0601409a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff05ffff700 1 -- 172.21.15.73:0/4093016929 >> v1:172.21.15.73:6789/0 conn(0x7ff06014a150 legacy=0x7ff06014a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff05ffff700 1 -- 172.21.15.73:0/4093016929 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0600bcee0 con 0x7ff0600bcb00 2023-11-30T23:27:49.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff064c85700 1 --2- 172.21.15.73:0/4093016929 >> v2:172.21.15.156:3300/0 conn(0x7ff060140550 0x7ff0601409a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:27:49.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff05ffff700 1 --2- 172.21.15.73:0/4093016929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0600bcb00 0x7ff0600b5040 secure :-1 s=READY pgs=4236 cs=0 l=1 rev1=1 crypto rx=0x7ff0600b8ac0 tx=0x7ff054009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a49396cd19ab06 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:49.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff05effd700 1 -- 172.21.15.73:0/4093016929 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff054011830 con 0x7ff0600bcb00 2023-11-30T23:27:49.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff05effd700 1 -- 172.21.15.73:0/4093016929 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff054011990 con 0x7ff0600bcb00 2023-11-30T23:27:49.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff05effd700 1 -- 172.21.15.73:0/4093016929 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff054011d40 con 0x7ff0600bcb00 2023-11-30T23:27:49.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff065486700 1 -- 172.21.15.73:0/4093016929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0600bcb00 msgr2=0x7ff0600b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff065486700 1 --2- 172.21.15.73:0/4093016929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0600bcb00 0x7ff0600b5040 secure :-1 s=READY pgs=4236 cs=0 l=1 rev1=1 crypto rx=0x7ff0600b8ac0 tx=0x7ff054009b30 comp rx=0 tx=0).stop 2023-11-30T23:27:49.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff065486700 1 -- 172.21.15.73:0/4093016929 shutdown_connections 2023-11-30T23:27:49.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff065486700 1 --2- 172.21.15.73:0/4093016929 >> v2:172.21.15.156:3300/0 conn(0x7ff060140550 0x7ff0601409a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff065486700 1 --2- 172.21.15.73:0/4093016929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0600bcb00 0x7ff0600b5040 unknown :-1 s=CLOSED pgs=4236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff065486700 1 -- 172.21.15.73:0/4093016929 >> 172.21.15.73:0/4093016929 conn(0x7ff060071ff0 msgr2=0x7ff0600bc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:49.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff065486700 1 -- 172.21.15.73:0/4093016929 shutdown_connections 2023-11-30T23:27:49.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.466+0000 7ff065486700 1 -- 172.21.15.73:0/4093016929 wait complete. 2023-11-30T23:27:49.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff065486700 1 Processor -- start 2023-11-30T23:27:49.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff065486700 1 -- start start 2023-11-30T23:27:49.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff065486700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0600bcb00 0x7ff060145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff065486700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff060140550 0x7ff0601cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff065486700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff06014a150 0x7ff060136310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff065486700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0601d0d10 con 0x7ff0600bcb00 2023-11-30T23:27:49.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff065486700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0601d0ef0 con 0x7ff06014a150 2023-11-30T23:27:49.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff065486700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0601449f0 con 0x7ff060140550 2023-11-30T23:27:49.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff05ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0600bcb00 0x7ff060145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff05ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0600bcb00 0x7ff060145eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60890/0 (socket says 172.21.15.73:60890) 2023-11-30T23:27:49.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff05ffff700 1 -- 172.21.15.73:0/2260635867 learned_addr learned my addr 172.21.15.73:0/2260635867 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:49.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff064c85700 1 --2- 172.21.15.73:0/2260635867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff06014a150 0x7ff060136310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff05f7fe700 1 --2- 172.21.15.73:0/2260635867 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff060140550 0x7ff0601cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff05ffff700 1 -- 172.21.15.73:0/2260635867 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff060140550 msgr2=0x7ff0601cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff05ffff700 1 --2- 172.21.15.73:0/2260635867 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff060140550 0x7ff0601cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff05ffff700 1 -- 172.21.15.73:0/2260635867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff06014a150 msgr2=0x7ff060136310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff05ffff700 1 --2- 172.21.15.73:0/2260635867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff06014a150 0x7ff060136310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff05ffff700 1 -- 172.21.15.73:0/2260635867 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0540094b0 con 0x7ff0600bcb00 2023-11-30T23:27:49.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff05ffff700 1 --2- 172.21.15.73:0/2260635867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0600bcb00 0x7ff060145eb0 secure :-1 s=READY pgs=4237 cs=0 l=1 rev1=1 crypto rx=0x7ff0540090b0 tx=0x7ff054004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:49.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff05cff9700 1 -- 172.21.15.73:0/2260635867 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0540036c0 con 0x7ff0600bcb00 2023-11-30T23:27:49.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff05cff9700 1 -- 172.21.15.73:0/2260635867 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05401e070 con 0x7ff0600bcb00 2023-11-30T23:27:49.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff065486700 1 -- 172.21.15.73:0/2260635867 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff06013c2e0 con 0x7ff0600bcb00 2023-11-30T23:27:49.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff05cff9700 1 -- 172.21.15.73:0/2260635867 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff054003a80 con 0x7ff0600bcb00 2023-11-30T23:27:49.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.470+0000 7ff065486700 1 -- 172.21.15.73:0/2260635867 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0601454d0 con 0x7ff0600bcb00 2023-11-30T23:27:49.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.474+0000 7ff065486700 1 -- 172.21.15.73:0/2260635867 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff0600b4260 con 0x7ff0600bcb00 2023-11-30T23:27:49.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.474+0000 7ff05cff9700 1 -- 172.21.15.73:0/2260635867 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff054003be0 con 0x7ff0600bcb00 2023-11-30T23:27:49.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.474+0000 7ff05cff9700 1 --2- 172.21.15.73:0/2260635867 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff04c065ad0 0x7ff04c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.474+0000 7ff05cff9700 1 -- 172.21.15.73:0/2260635867 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7ff054020070 con 0x7ff0600bcb00 2023-11-30T23:27:49.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.474+0000 7ff05cff9700 1 --2- 172.21.15.73:0/2260635867 >> [v2:172.21.15.73:6800/36685,v1:172.21.15.73:6801/36685] conn(0x7ff04c06de50 0x7ff04c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.474+0000 7ff05cff9700 1 -- 172.21.15.73:0/2260635867 --> [v2:172.21.15.73:6800/36685,v1:172.21.15.73:6801/36685] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff04c0709c0 con 0x7ff04c06de50 2023-11-30T23:27:49.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.474+0000 7ff05cff9700 1 -- 172.21.15.73:0/2260635867 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff054084e50 con 0x7ff0600bcb00 2023-11-30T23:27:49.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.474+0000 7ff05f7fe700 1 --2- 172.21.15.73:0/2260635867 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff04c065ad0 0x7ff04c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.474+0000 7ff064c85700 1 --2- 172.21.15.73:0/2260635867 >> [v2:172.21.15.73:6800/36685,v1:172.21.15.73:6801/36685] conn(0x7ff04c06de50 0x7ff04c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.474+0000 7ff064c85700 1 --2- 172.21.15.73:0/2260635867 >> [v2:172.21.15.73:6800/36685,v1:172.21.15.73:6801/36685] conn(0x7ff04c06de50 0x7ff04c0702f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:49.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.474+0000 7ff05f7fe700 1 --2- 172.21.15.73:0/2260635867 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff04c065ad0 0x7ff04c067f90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff06013c1a0 tx=0x7ff050009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:49.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.478+0000 7ff05cff9700 1 -- 172.21.15.73:0/2260635867 <== osd.3 v2:172.21.15.73:6800/36685 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff04c0709c0 con 0x7ff04c06de50 2023-11-30T23:27:49.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.490+0000 7ff065486700 1 -- 172.21.15.73:0/2260635867 --> [v2:172.21.15.73:6800/36685,v1:172.21.15.73:6801/36685] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff060140ee0 con 0x7ff04c06de50 2023-11-30T23:27:49.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.490+0000 7ff05cff9700 1 -- 172.21.15.73:0/2260635867 <== osd.3 v2:172.21.15.73:6800/36685 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff05800f040 con 0x7ff04c06de50 2023-11-30T23:27:49.496 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-30T23:27:49.497 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-30T23:27:49.497 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-30T23:27:49.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.490+0000 7ff065486700 1 -- 172.21.15.73:0/2260635867 >> [v2:172.21.15.73:6800/36685,v1:172.21.15.73:6801/36685] conn(0x7ff04c06de50 msgr2=0x7ff04c0702f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.490+0000 7ff065486700 1 --2- 172.21.15.73:0/2260635867 >> [v2:172.21.15.73:6800/36685,v1:172.21.15.73:6801/36685] conn(0x7ff04c06de50 0x7ff04c0702f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.490+0000 7ff065486700 1 -- 172.21.15.73:0/2260635867 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff04c065ad0 msgr2=0x7ff04c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.490+0000 7ff065486700 1 --2- 172.21.15.73:0/2260635867 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff04c065ad0 0x7ff04c067f90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff06013c1a0 tx=0x7ff050009040 comp rx=0 tx=0).stop 2023-11-30T23:27:49.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.490+0000 7ff065486700 1 -- 172.21.15.73:0/2260635867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0600bcb00 msgr2=0x7ff060145eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.490+0000 7ff065486700 1 --2- 172.21.15.73:0/2260635867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0600bcb00 0x7ff060145eb0 secure :-1 s=READY pgs=4237 cs=0 l=1 rev1=1 crypto rx=0x7ff0540090b0 tx=0x7ff054004770 comp rx=0 tx=0).stop 2023-11-30T23:27:49.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.490+0000 7ff064c85700 1 -- 172.21.15.73:0/2260635867 reap_dead start 2023-11-30T23:27:49.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.490+0000 7ff065486700 1 -- 172.21.15.73:0/2260635867 shutdown_connections 2023-11-30T23:27:49.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.490+0000 7ff065486700 1 -- 172.21.15.73:0/2260635867 >> 172.21.15.73:0/2260635867 conn(0x7ff060071ff0 msgr2=0x7ff060066490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:49.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.490+0000 7ff065486700 1 -- 172.21.15.73:0/2260635867 shutdown_connections 2023-11-30T23:27:49.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.490+0000 7ff065486700 1 -- 172.21.15.73:0/2260635867 wait complete. 2023-11-30T23:27:49.510 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-30T23:27:49.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f327af700 1 Processor -- start 2023-11-30T23:27:49.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f327af700 1 -- start start 2023-11-30T23:27:49.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f327af700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c144be0 0x7f6f2c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f327af700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2c071460 con 0x7f6f2c0b3840 2023-11-30T23:27:49.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f327af700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2c0b3c20 con 0x7f6f2c13e980 2023-11-30T23:27:49.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f327af700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c0b0d90 con 0x7f6f2c144be0 2023-11-30T23:27:49.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f317ad700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6f2c0b3840 0x7f6f2c13e270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48534/0 (socket says 172.21.15.73:48534) 2023-11-30T23:27:49.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f317ad700 1 -- 172.21.15.73:0/3822344674 learned_addr learned my addr 172.21.15.73:0/3822344674 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:27:49.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f31fae700 1 --2- 172.21.15.73:0/3822344674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c144be0 0x7f6f2c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f1ffff700 1 -- 172.21.15.73:0/3822344674 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136026046 0 0) 0x7f6f2c071460 con 0x7f6f2c0b3840 2023-11-30T23:27:49.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f1ffff700 1 -- 172.21.15.73:0/3822344674 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f180035d0 con 0x7f6f2c0b3840 2023-11-30T23:27:49.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f1ffff700 1 -- 172.21.15.73:0/3822344674 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287846652 0 0) 0x7f6f2c0b3c20 con 0x7f6f2c13e980 2023-11-30T23:27:49.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f1ffff700 1 -- 172.21.15.73:0/3822344674 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f2c071460 con 0x7f6f2c13e980 2023-11-30T23:27:49.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f31fae700 1 -- 172.21.15.73:0/3822344674 >> v1:172.21.15.156:6789/0 conn(0x7f6f2c13e980 legacy=0x7f6f2c1444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f31fae700 1 -- 172.21.15.73:0/3822344674 >> v1:172.21.15.73:6789/0 conn(0x7f6f2c0b3840 legacy=0x7f6f2c13e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f31fae700 1 -- 172.21.15.73:0/3822344674 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c06d030 con 0x7f6f2c144be0 2023-11-30T23:27:49.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f31fae700 1 --2- 172.21.15.73:0/3822344674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c144be0 0x7f6f2c0b4e10 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f6f24009dc0 tx=0x7f6f2400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24030547f494070d server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:49.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f1ffff700 1 -- 172.21.15.73:0/3822344674 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2400e070 con 0x7f6f2c144be0 2023-11-30T23:27:49.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f1ffff700 1 -- 172.21.15.73:0/3822344674 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2400bb20 con 0x7f6f2c144be0 2023-11-30T23:27:49.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f1ffff700 1 -- 172.21.15.73:0/3822344674 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24012430 con 0x7f6f2c144be0 2023-11-30T23:27:49.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f327af700 1 -- 172.21.15.73:0/3822344674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c144be0 msgr2=0x7f6f2c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f327af700 1 --2- 172.21.15.73:0/3822344674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c144be0 0x7f6f2c0b4e10 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f6f24009dc0 tx=0x7f6f2400b330 comp rx=0 tx=0).stop 2023-11-30T23:27:49.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f327af700 1 -- 172.21.15.73:0/3822344674 shutdown_connections 2023-11-30T23:27:49.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f327af700 1 --2- 172.21.15.73:0/3822344674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c144be0 0x7f6f2c0b4e10 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f327af700 1 -- 172.21.15.73:0/3822344674 >> 172.21.15.73:0/3822344674 conn(0x7f6f2c06b290 msgr2=0x7f6f2c06b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:49.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f327af700 1 -- 172.21.15.73:0/3822344674 shutdown_connections 2023-11-30T23:27:49.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.626+0000 7f6f327af700 1 -- 172.21.15.73:0/3822344674 wait complete. 2023-11-30T23:27:49.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f327af700 1 Processor -- start 2023-11-30T23:27:49.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f327af700 1 -- start start 2023-11-30T23:27:49.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f327af700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0b3840 0x7f6f2c143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f327af700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f2c13e980 0x7f6f2c1428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f327af700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f2c144be0 0x7f6f2c06f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f327af700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c13f8f0 con 0x7f6f2c13e980 2023-11-30T23:27:49.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f327af700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c143fc0 con 0x7f6f2c144be0 2023-11-30T23:27:49.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f327af700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c142340 con 0x7f6f2c0b3840 2023-11-30T23:27:49.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f30fac700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f2c13e980 0x7f6f2c1428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f30fac700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f2c13e980 0x7f6f2c1428b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60898/0 (socket says 172.21.15.73:60898) 2023-11-30T23:27:49.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f30fac700 1 -- 172.21.15.73:0/3589354169 learned_addr learned my addr 172.21.15.73:0/3589354169 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:49.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f317ad700 1 --2- 172.21.15.73:0/3589354169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0b3840 0x7f6f2c143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f31fae700 1 --2- 172.21.15.73:0/3589354169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f2c144be0 0x7f6f2c06f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f30fac700 1 -- 172.21.15.73:0/3589354169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0b3840 msgr2=0x7f6f2c143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f30fac700 1 --2- 172.21.15.73:0/3589354169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0b3840 0x7f6f2c143a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f30fac700 1 -- 172.21.15.73:0/3589354169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f2c144be0 msgr2=0x7f6f2c06f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f30fac700 1 --2- 172.21.15.73:0/3589354169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f2c144be0 0x7f6f2c06f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f30fac700 1 -- 172.21.15.73:0/3589354169 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f24009a70 con 0x7f6f2c13e980 2023-11-30T23:27:49.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f317ad700 1 --2- 172.21.15.73:0/3589354169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0b3840 0x7f6f2c143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:27:49.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f30fac700 1 --2- 172.21.15.73:0/3589354169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f2c13e980 0x7f6f2c1428b0 secure :-1 s=READY pgs=4239 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c730 tx=0x7f6f2000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:49.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f1dffb700 1 -- 172.21.15.73:0/3589354169 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f200052d0 con 0x7f6f2c13e980 2023-11-30T23:27:49.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f1dffb700 1 -- 172.21.15.73:0/3589354169 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f20005450 con 0x7f6f2c13e980 2023-11-30T23:27:49.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f327af700 1 -- 172.21.15.73:0/3589354169 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f2c1441a0 con 0x7f6f2c13e980 2023-11-30T23:27:49.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f1dffb700 1 -- 172.21.15.73:0/3589354169 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f200038e0 con 0x7f6f2c13e980 2023-11-30T23:27:49.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.630+0000 7f6f327af700 1 -- 172.21.15.73:0/3589354169 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f2c142df0 con 0x7f6f2c13e980 2023-11-30T23:27:49.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.634+0000 7f6f327af700 1 -- 172.21.15.73:0/3589354169 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f2c06f1b0 con 0x7f6f2c13e980 2023-11-30T23:27:49.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.634+0000 7f6f1dffb700 1 -- 172.21.15.73:0/3589354169 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6f20003a40 con 0x7f6f2c13e980 2023-11-30T23:27:49.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.634+0000 7f6f1dffb700 1 --2- 172.21.15.73:0/3589354169 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6f10065ad0 0x7f6f10067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.634+0000 7f6f1dffb700 1 -- 172.21.15.73:0/3589354169 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f6f20082750 con 0x7f6f2c13e980 2023-11-30T23:27:49.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.634+0000 7f6f317ad700 1 --2- 172.21.15.73:0/3589354169 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6f10065ad0 0x7f6f10067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.634+0000 7f6f317ad700 1 --2- 172.21.15.73:0/3589354169 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6f10065ad0 0x7f6f10067f90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6f280011e0 tx=0x7f6f28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:49.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.646+0000 7f6f1dffb700 1 -- 172.21.15.73:0/3589354169 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f6f2c06f1b0 con 0x7f6f2c13e980 2023-11-30T23:27:49.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.802+0000 7f6f327af700 1 -- 172.21.15.73:0/3589354169 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f2c0719e0 con 0x7f6f10065ad0 2023-11-30T23:27:49.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.802+0000 7f6f1dffb700 1 -- 172.21.15.73:0/3589354169 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6f280014f0 con 0x7f6f10065ad0 2023-11-30T23:27:49.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.806+0000 7f6f327af700 1 -- 172.21.15.73:0/3589354169 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6f10065ad0 msgr2=0x7f6f10067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.806+0000 7f6f327af700 1 --2- 172.21.15.73:0/3589354169 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6f10065ad0 0x7f6f10067f90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6f280011e0 tx=0x7f6f28009040 comp rx=0 tx=0).stop 2023-11-30T23:27:49.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.806+0000 7f6f327af700 1 -- 172.21.15.73:0/3589354169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f2c13e980 msgr2=0x7f6f2c1428b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.806+0000 7f6f327af700 1 --2- 172.21.15.73:0/3589354169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f2c13e980 0x7f6f2c1428b0 secure :-1 s=READY pgs=4239 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c730 tx=0x7f6f2000ca40 comp rx=0 tx=0).stop 2023-11-30T23:27:49.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.806+0000 7f6f327af700 1 -- 172.21.15.73:0/3589354169 shutdown_connections 2023-11-30T23:27:49.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.806+0000 7f6f327af700 1 --2- 172.21.15.73:0/3589354169 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6f10065ad0 0x7f6f10067f90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.806+0000 7f6f327af700 1 --2- 172.21.15.73:0/3589354169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f2c144be0 0x7f6f2c06f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.806+0000 7f6f327af700 1 --2- 172.21.15.73:0/3589354169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f2c13e980 0x7f6f2c1428b0 unknown :-1 s=CLOSED pgs=4239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.806+0000 7f6f327af700 1 --2- 172.21.15.73:0/3589354169 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6f2c0b3840 0x7f6f2c143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.806+0000 7f6f327af700 1 -- 172.21.15.73:0/3589354169 >> 172.21.15.73:0/3589354169 conn(0x7f6f2c06b290 msgr2=0x7f6f2c13cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:49.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.806+0000 7f6f327af700 1 -- 172.21.15.73:0/3589354169 shutdown_connections 2023-11-30T23:27:49.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.806+0000 7f6f327af700 1 -- 172.21.15.73:0/3589354169 wait complete. 2023-11-30T23:27:49.813 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 3 to deep-scrub 2023-11-30T23:27:49.823 INFO:tasks.ceph:Scrubbing osd.4 2023-11-30T23:27:49.823 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-30T23:27:49.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1c892700 1 Processor -- start 2023-11-30T23:27:49.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1c892700 1 -- start start 2023-11-30T23:27:49.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1c892700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3f18140a50 0x7f3f18149d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1c892700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f1814a2c0 0x7f3f18150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1c892700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f180b4e70 con 0x7f3f180bc8b0 2023-11-30T23:27:49.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1c892700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f180b5da0 con 0x7f3f18140a50 2023-11-30T23:27:49.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1c892700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1814a730 con 0x7f3f1814a2c0 2023-11-30T23:27:49.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f16d9d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3f180bc8b0 0x7f3f18140340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48546/0 (socket says 172.21.15.73:48546) 2023-11-30T23:27:49.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f16d9d700 1 -- 172.21.15.73:0/2467254114 learned_addr learned my addr 172.21.15.73:0/2467254114 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:27:49.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1659c700 1 --2- 172.21.15.73:0/2467254114 >> v2:172.21.15.156:3300/0 conn(0x7f3f18140a50 0x7f3f18149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1759e700 1 --2- 172.21.15.73:0/2467254114 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f1814a2c0 0x7f3f18150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f15d9b700 1 -- 172.21.15.73:0/2467254114 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408565826 0 0) 0x7f3f180b4e70 con 0x7f3f180bc8b0 2023-11-30T23:27:49.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f15d9b700 1 -- 172.21.15.73:0/2467254114 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f040035d0 con 0x7f3f180bc8b0 2023-11-30T23:27:49.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1659c700 1 -- 172.21.15.73:0/2467254114 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f1814a2c0 msgr2=0x7f3f18150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:49.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1659c700 1 --2- 172.21.15.73:0/2467254114 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f1814a2c0 0x7f3f18150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1659c700 1 -- 172.21.15.73:0/2467254114 >> v1:172.21.15.73:6789/0 conn(0x7f3f180bc8b0 legacy=0x7f3f18140340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1659c700 1 -- 172.21.15.73:0/2467254114 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f180bcc90 con 0x7f3f18140a50 2023-11-30T23:27:49.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1659c700 1 --2- 172.21.15.73:0/2467254114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f18140a50 0x7f3f18149d80 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009850 tx=0x7f3f00009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75446970e7bd0e32 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:49.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f15d9b700 1 -- 172.21.15.73:0/2467254114 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00011830 con 0x7f3f18140a50 2023-11-30T23:27:49.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f15d9b700 1 -- 172.21.15.73:0/2467254114 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f00011990 con 0x7f3f18140a50 2023-11-30T23:27:49.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f15d9b700 1 -- 172.21.15.73:0/2467254114 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00011d40 con 0x7f3f18140a50 2023-11-30T23:27:49.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1c892700 1 -- 172.21.15.73:0/2467254114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f18140a50 msgr2=0x7f3f18149d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1c892700 1 --2- 172.21.15.73:0/2467254114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f18140a50 0x7f3f18149d80 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009850 tx=0x7f3f00009b60 comp rx=0 tx=0).stop 2023-11-30T23:27:49.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1c892700 1 -- 172.21.15.73:0/2467254114 shutdown_connections 2023-11-30T23:27:49.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1c892700 1 --2- 172.21.15.73:0/2467254114 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f1814a2c0 0x7f3f18150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1c892700 1 --2- 172.21.15.73:0/2467254114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f18140a50 0x7f3f18149d80 unknown :-1 s=CLOSED pgs=2357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1c892700 1 -- 172.21.15.73:0/2467254114 >> 172.21.15.73:0/2467254114 conn(0x7f3f18071ee0 msgr2=0x7f3f180bbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:49.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1c892700 1 -- 172.21.15.73:0/2467254114 shutdown_connections 2023-11-30T23:27:49.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.942+0000 7f3f1c892700 1 -- 172.21.15.73:0/2467254114 wait complete. 2023-11-30T23:27:49.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1c892700 1 Processor -- start 2023-11-30T23:27:49.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1c892700 1 -- start start 2023-11-30T23:27:49.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1c892700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f180bc8b0 0x7f3f181df7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1c892700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f1814a2c0 0x7f3f18145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1c892700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f18145fb0 0x7f3f181443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1c892700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f18143f00 con 0x7f3f1814a2c0 2023-11-30T23:27:49.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1c892700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f18146de0 con 0x7f3f18145fb0 2023-11-30T23:27:49.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1c892700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f181df340 con 0x7f3f180bc8b0 2023-11-30T23:27:49.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f1814a2c0 0x7f3f18145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f1814a2c0 0x7f3f18145a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60910/0 (socket says 172.21.15.73:60910) 2023-11-30T23:27:49.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1659c700 1 -- 172.21.15.73:0/4256134030 learned_addr learned my addr 172.21.15.73:0/4256134030 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:49.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f16d9d700 1 --2- 172.21.15.73:0/4256134030 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f180bc8b0 0x7f3f181df7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1759e700 1 --2- 172.21.15.73:0/4256134030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f18145fb0 0x7f3f181443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1659c700 1 -- 172.21.15.73:0/4256134030 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f180bc8b0 msgr2=0x7f3f181df7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1659c700 1 --2- 172.21.15.73:0/4256134030 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3f180bc8b0 0x7f3f181df7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1659c700 1 -- 172.21.15.73:0/4256134030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f18145fb0 msgr2=0x7f3f181443c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1659c700 1 --2- 172.21.15.73:0/4256134030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f18145fb0 0x7f3f181443c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1659c700 1 -- 172.21.15.73:0/4256134030 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f000094b0 con 0x7f3f1814a2c0 2023-11-30T23:27:49.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1659c700 1 --2- 172.21.15.73:0/4256134030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f1814a2c0 0x7f3f18145a70 secure :-1 s=READY pgs=4241 cs=0 l=1 rev1=1 crypto rx=0x7f3f180bd030 tx=0x7f3f00004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:49.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f0f7fe700 1 -- 172.21.15.73:0/4256134030 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00004300 con 0x7f3f1814a2c0 2023-11-30T23:27:49.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f0f7fe700 1 -- 172.21.15.73:0/4256134030 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0001f070 con 0x7f3f1814a2c0 2023-11-30T23:27:49.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1c892700 1 -- 172.21.15.73:0/4256134030 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f18144130 con 0x7f3f1814a2c0 2023-11-30T23:27:49.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f0f7fe700 1 -- 172.21.15.73:0/4256134030 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f000036c0 con 0x7f3f1814a2c0 2023-11-30T23:27:49.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1c892700 1 -- 172.21.15.73:0/4256134030 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f18147030 con 0x7f3f1814a2c0 2023-11-30T23:27:49.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.946+0000 7f3f1c892700 1 -- 172.21.15.73:0/4256134030 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3f180b4820 con 0x7f3f1814a2c0 2023-11-30T23:27:49.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.950+0000 7f3f0f7fe700 1 -- 172.21.15.73:0/4256134030 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3f00021030 con 0x7f3f1814a2c0 2023-11-30T23:27:49.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.950+0000 7f3f0f7fe700 1 --2- 172.21.15.73:0/4256134030 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3ef8065ad0 0x7f3ef8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.950+0000 7f3f16d9d700 1 --2- 172.21.15.73:0/4256134030 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3ef8065ad0 0x7f3ef8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.950+0000 7f3f0f7fe700 1 -- 172.21.15.73:0/4256134030 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f3f000849f0 con 0x7f3f1814a2c0 2023-11-30T23:27:49.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.950+0000 7f3f0f7fe700 1 --2- 172.21.15.73:0/4256134030 >> [v2:172.21.15.156:6800/36908,v1:172.21.15.156:6801/36908] conn(0x7f3ef806de50 0x7f3ef80702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:49.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.950+0000 7f3f0f7fe700 1 -- 172.21.15.73:0/4256134030 --> [v2:172.21.15.156:6800/36908,v1:172.21.15.156:6801/36908] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ef80709c0 con 0x7f3ef806de50 2023-11-30T23:27:49.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.950+0000 7f3f0f7fe700 1 -- 172.21.15.73:0/4256134030 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f00084e40 con 0x7f3f1814a2c0 2023-11-30T23:27:49.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.950+0000 7f3f16d9d700 1 --2- 172.21.15.73:0/4256134030 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3ef8065ad0 0x7f3ef8067f90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3f08007fd0 tx=0x7f3f08007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:49.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.950+0000 7f3f1759e700 1 --2- 172.21.15.73:0/4256134030 >> [v2:172.21.15.156:6800/36908,v1:172.21.15.156:6801/36908] conn(0x7f3ef806de50 0x7f3ef80702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:49.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.950+0000 7f3f1759e700 1 --2- 172.21.15.73:0/4256134030 >> [v2:172.21.15.156:6800/36908,v1:172.21.15.156:6801/36908] conn(0x7f3ef806de50 0x7f3ef80702f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:49.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.954+0000 7f3f0f7fe700 1 -- 172.21.15.73:0/4256134030 <== osd.4 v2:172.21.15.156:6800/36908 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3ef80709c0 con 0x7f3ef806de50 2023-11-30T23:27:49.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.974+0000 7f3f1c892700 1 -- 172.21.15.73:0/4256134030 --> [v2:172.21.15.156:6800/36908,v1:172.21.15.156:6801/36908] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3f180b4040 con 0x7f3ef806de50 2023-11-30T23:27:49.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.974+0000 7f3f0f7fe700 1 -- 172.21.15.73:0/4256134030 <== osd.4 v2:172.21.15.156:6800/36908 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3f1000f040 con 0x7f3ef806de50 2023-11-30T23:27:49.979 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-30T23:27:49.979 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-30T23:27:49.979 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-30T23:27:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.974+0000 7f3f1c892700 1 -- 172.21.15.73:0/4256134030 >> [v2:172.21.15.156:6800/36908,v1:172.21.15.156:6801/36908] conn(0x7f3ef806de50 msgr2=0x7f3ef80702f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.974+0000 7f3f1c892700 1 --2- 172.21.15.73:0/4256134030 >> [v2:172.21.15.156:6800/36908,v1:172.21.15.156:6801/36908] conn(0x7f3ef806de50 0x7f3ef80702f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.974+0000 7f3f1c892700 1 -- 172.21.15.73:0/4256134030 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3ef8065ad0 msgr2=0x7f3ef8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.974+0000 7f3f1c892700 1 --2- 172.21.15.73:0/4256134030 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3ef8065ad0 0x7f3ef8067f90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3f08007fd0 tx=0x7f3f08007de0 comp rx=0 tx=0).stop 2023-11-30T23:27:49.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.974+0000 7f3f1c892700 1 -- 172.21.15.73:0/4256134030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f1814a2c0 msgr2=0x7f3f18145a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:49.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.974+0000 7f3f1c892700 1 --2- 172.21.15.73:0/4256134030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f1814a2c0 0x7f3f18145a70 secure :-1 s=READY pgs=4241 cs=0 l=1 rev1=1 crypto rx=0x7f3f180bd030 tx=0x7f3f00004770 comp rx=0 tx=0).stop 2023-11-30T23:27:49.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.974+0000 7f3f1759e700 1 -- 172.21.15.73:0/4256134030 reap_dead start 2023-11-30T23:27:49.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.974+0000 7f3f1c892700 1 -- 172.21.15.73:0/4256134030 shutdown_connections 2023-11-30T23:27:49.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.974+0000 7f3f1c892700 1 -- 172.21.15.73:0/4256134030 >> 172.21.15.73:0/4256134030 conn(0x7f3f18071ee0 msgr2=0x7f3f18148c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:49.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.974+0000 7f3f1c892700 1 -- 172.21.15.73:0/4256134030 shutdown_connections 2023-11-30T23:27:49.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:49.974+0000 7f3f1c892700 1 -- 172.21.15.73:0/4256134030 wait complete. 2023-11-30T23:27:49.992 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-30T23:27:50.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd25cca6700 1 Processor -- start 2023-11-30T23:27:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd25cca6700 1 -- start start 2023-11-30T23:27:50.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd25cca6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2581440d0 0x7fd258070220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd25cca6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd25806f800 con 0x7fd258070760 2023-11-30T23:27:50.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd25cca6700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2581435f0 con 0x7fd25806f420 2023-11-30T23:27:50.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd25cca6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2581438d0 con 0x7fd2581440d0 2023-11-30T23:27:50.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd257fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd258070760 0x7fd25813d360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48552/0 (socket says 172.21.15.73:48552) 2023-11-30T23:27:50.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd257fff700 1 -- 172.21.15.73:0/160983177 learned_addr learned my addr 172.21.15.73:0/160983177 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:27:50.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd24effd700 1 --2- 172.21.15.73:0/160983177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2581440d0 0x7fd258070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd256ffd700 1 -- 172.21.15.73:0/160983177 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925281495 0 0) 0x7fd25806f800 con 0x7fd258070760 2023-11-30T23:27:50.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd256ffd700 1 -- 172.21.15.73:0/160983177 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2440035d0 con 0x7fd258070760 2023-11-30T23:27:50.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd256ffd700 1 -- 172.21.15.73:0/160983177 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3404425982 0 0) 0x7fd2581435f0 con 0x7fd25806f420 2023-11-30T23:27:50.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd256ffd700 1 -- 172.21.15.73:0/160983177 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd25806f800 con 0x7fd25806f420 2023-11-30T23:27:50.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd24effd700 1 -- 172.21.15.73:0/160983177 >> v1:172.21.15.156:6789/0 conn(0x7fd25806f420 legacy=0x7fd2580b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd24effd700 1 -- 172.21.15.73:0/160983177 >> v1:172.21.15.73:6789/0 conn(0x7fd258070760 legacy=0x7fd25813d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd24effd700 1 -- 172.21.15.73:0/160983177 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd258143bb0 con 0x7fd2581440d0 2023-11-30T23:27:50.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd24effd700 1 --2- 172.21.15.73:0/160983177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2581440d0 0x7fd258070220 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fd240009880 tx=0x7fd240009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5858acffea2a6338 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:50.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd256ffd700 1 -- 172.21.15.73:0/160983177 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240011830 con 0x7fd2581440d0 2023-11-30T23:27:50.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd256ffd700 1 -- 172.21.15.73:0/160983177 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd240011990 con 0x7fd2581440d0 2023-11-30T23:27:50.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd256ffd700 1 -- 172.21.15.73:0/160983177 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240011d20 con 0x7fd2581440d0 2023-11-30T23:27:50.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd25cca6700 1 -- 172.21.15.73:0/160983177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2581440d0 msgr2=0x7fd258070220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd25cca6700 1 --2- 172.21.15.73:0/160983177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2581440d0 0x7fd258070220 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fd240009880 tx=0x7fd240009b90 comp rx=0 tx=0).stop 2023-11-30T23:27:50.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd25cca6700 1 -- 172.21.15.73:0/160983177 shutdown_connections 2023-11-30T23:27:50.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd25cca6700 1 --2- 172.21.15.73:0/160983177 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd2581440d0 0x7fd258070220 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd25cca6700 1 -- 172.21.15.73:0/160983177 >> 172.21.15.73:0/160983177 conn(0x7fd25806b290 msgr2=0x7fd25806b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:50.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd25cca6700 1 -- 172.21.15.73:0/160983177 shutdown_connections 2023-11-30T23:27:50.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd25cca6700 1 -- 172.21.15.73:0/160983177 wait complete. 2023-11-30T23:27:50.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.098+0000 7fd25cca6700 1 Processor -- start 2023-11-30T23:27:50.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd25cca6700 1 -- start start 2023-11-30T23:27:50.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd25cca6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd25806f420 0x7fd25813fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd25cca6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd258070760 0x7fd2581dc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd25cca6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2581440d0 0x7fd2581dc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd25cca6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2580b3060 con 0x7fd2581440d0 2023-11-30T23:27:50.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd25cca6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2581c9c50 con 0x7fd258070760 2023-11-30T23:27:50.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd25cca6700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2581c9ea0 con 0x7fd25806f420 2023-11-30T23:27:50.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd257fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2581440d0 0x7fd2581dc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd2577fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd25806f420 0x7fd25813fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd2577fe700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd25806f420 0x7fd25813fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:45876/0 (socket says 172.21.15.73:45876) 2023-11-30T23:27:50.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd2577fe700 1 -- 172.21.15.73:0/3225941090 learned_addr learned my addr 172.21.15.73:0/3225941090 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:50.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd257fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2581440d0 0x7fd2581dc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60918/0 (socket says 172.21.15.73:60918) 2023-11-30T23:27:50.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd24effd700 1 --2- 172.21.15.73:0/3225941090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd258070760 0x7fd2581dc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd257fff700 1 -- 172.21.15.73:0/3225941090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd25806f420 msgr2=0x7fd25813fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd257fff700 1 --2- 172.21.15.73:0/3225941090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd25806f420 0x7fd25813fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd257fff700 1 -- 172.21.15.73:0/3225941090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd258070760 msgr2=0x7fd2581dc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd257fff700 1 --2- 172.21.15.73:0/3225941090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd258070760 0x7fd2581dc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd257fff700 1 -- 172.21.15.73:0/3225941090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2400094b0 con 0x7fd2581440d0 2023-11-30T23:27:50.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd2577fe700 1 --2- 172.21.15.73:0/3225941090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd25806f420 0x7fd25813fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:27:50.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd24effd700 1 --2- 172.21.15.73:0/3225941090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd258070760 0x7fd2581dc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:27:50.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd257fff700 1 --2- 172.21.15.73:0/3225941090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2581440d0 0x7fd2581dc760 secure :-1 s=READY pgs=4243 cs=0 l=1 rev1=1 crypto rx=0x7fd258065fc0 tx=0x7fd25000ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:50.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd254ff9700 1 -- 172.21.15.73:0/3225941090 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250007480 con 0x7fd2581440d0 2023-11-30T23:27:50.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd254ff9700 1 -- 172.21.15.73:0/3225941090 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2500075e0 con 0x7fd2581440d0 2023-11-30T23:27:50.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd25cca6700 1 -- 172.21.15.73:0/3225941090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2581ca180 con 0x7fd2581440d0 2023-11-30T23:27:50.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd254ff9700 1 -- 172.21.15.73:0/3225941090 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250007950 con 0x7fd2581440d0 2023-11-30T23:27:50.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd25cca6700 1 -- 172.21.15.73:0/3225941090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2580b2d80 con 0x7fd2581440d0 2023-11-30T23:27:50.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.102+0000 7fd25cca6700 1 -- 172.21.15.73:0/3225941090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2581dcca0 con 0x7fd2581440d0 2023-11-30T23:27:50.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.106+0000 7fd254ff9700 1 -- 172.21.15.73:0/3225941090 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd250012400 con 0x7fd2581440d0 2023-11-30T23:27:50.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.106+0000 7fd254ff9700 1 --2- 172.21.15.73:0/3225941090 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd238065ad0 0x7fd238067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.106+0000 7fd254ff9700 1 -- 172.21.15.73:0/3225941090 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd250082960 con 0x7fd2581440d0 2023-11-30T23:27:50.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.106+0000 7fd2577fe700 1 --2- 172.21.15.73:0/3225941090 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd238065ad0 0x7fd238067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.106+0000 7fd2577fe700 1 --2- 172.21.15.73:0/3225941090 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd238065ad0 0x7fd238067f90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd2480011e0 tx=0x7fd248007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:50.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.114+0000 7fd254ff9700 1 -- 172.21.15.73:0/3225941090 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fd2500503d0 con 0x7fd2581440d0 2023-11-30T23:27:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.274+0000 7fd25cca6700 1 -- 172.21.15.73:0/3225941090 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2580b5370 con 0x7fd238065ad0 2023-11-30T23:27:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.274+0000 7fd254ff9700 1 -- 172.21.15.73:0/3225941090 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd248016070 con 0x7fd238065ad0 2023-11-30T23:27:50.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.278+0000 7fd25cca6700 1 -- 172.21.15.73:0/3225941090 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd238065ad0 msgr2=0x7fd238067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.278+0000 7fd25cca6700 1 --2- 172.21.15.73:0/3225941090 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd238065ad0 0x7fd238067f90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd2480011e0 tx=0x7fd248007e90 comp rx=0 tx=0).stop 2023-11-30T23:27:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.278+0000 7fd25cca6700 1 -- 172.21.15.73:0/3225941090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2581440d0 msgr2=0x7fd2581dc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.278+0000 7fd25cca6700 1 --2- 172.21.15.73:0/3225941090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2581440d0 0x7fd2581dc760 secure :-1 s=READY pgs=4243 cs=0 l=1 rev1=1 crypto rx=0x7fd258065fc0 tx=0x7fd25000ca70 comp rx=0 tx=0).stop 2023-11-30T23:27:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.278+0000 7fd25cca6700 1 -- 172.21.15.73:0/3225941090 shutdown_connections 2023-11-30T23:27:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.278+0000 7fd25cca6700 1 --2- 172.21.15.73:0/3225941090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2581440d0 0x7fd2581dc760 unknown :-1 s=CLOSED pgs=4243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.278+0000 7fd25cca6700 1 --2- 172.21.15.73:0/3225941090 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd238065ad0 0x7fd238067f90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.278+0000 7fd25cca6700 1 --2- 172.21.15.73:0/3225941090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd258070760 0x7fd2581dc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.278+0000 7fd25cca6700 1 --2- 172.21.15.73:0/3225941090 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd25806f420 0x7fd25813fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.278+0000 7fd25cca6700 1 -- 172.21.15.73:0/3225941090 >> 172.21.15.73:0/3225941090 conn(0x7fd25806b290 msgr2=0x7fd2580b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:50.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.278+0000 7fd25cca6700 1 -- 172.21.15.73:0/3225941090 shutdown_connections 2023-11-30T23:27:50.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.278+0000 7fd25cca6700 1 -- 172.21.15.73:0/3225941090 wait complete. 2023-11-30T23:27:50.286 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 4 to deep-scrub 2023-11-30T23:27:50.295 INFO:tasks.ceph:Scrubbing osd.5 2023-11-30T23:27:50.295 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-30T23:27:50.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de359e700 1 Processor -- start 2023-11-30T23:27:50.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de359e700 1 -- start start 2023-11-30T23:27:50.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de359e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6de413d9a0 0x7f6de40b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de359e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6de4143480 0x7f6de40b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de359e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de40ae7d0 con 0x7f6de40b2780 2023-11-30T23:27:50.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de359e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de406e900 con 0x7f6de4143480 2023-11-30T23:27:50.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de359e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de40aed50 con 0x7f6de413d9a0 2023-11-30T23:27:50.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de2d9d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6de4143480 0x7f6de40b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de2d9d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6de4143480 0x7f6de40b0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60932/0 (socket says 172.21.15.73:60932) 2023-11-30T23:27:50.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de259c700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6de40b2780 0x7f6de413d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.73:41054/0 (socket says 172.21.15.73:41054) 2023-11-30T23:27:50.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de2d9d700 1 -- 172.21.15.73:0/2059670774 learned_addr learned my addr 172.21.15.73:0/2059670774 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:50.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6ddbfff700 1 --2- 172.21.15.73:0/2059670774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6de413d9a0 0x7f6de40b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de2d9d700 1 -- 172.21.15.73:0/2059670774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6de413d9a0 msgr2=0x7f6de40b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:50.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de2d9d700 1 --2- 172.21.15.73:0/2059670774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6de413d9a0 0x7f6de40b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de2d9d700 1 -- 172.21.15.73:0/2059670774 >> v1:172.21.15.156:6789/0 conn(0x7f6de40b2780 legacy=0x7f6de413d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de2d9d700 1 -- 172.21.15.73:0/2059670774 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de40b2b60 con 0x7f6de4143480 2023-11-30T23:27:50.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de2d9d700 1 --2- 172.21.15.73:0/2059670774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de4143480 0x7f6de40b0f60 secure :-1 s=READY pgs=4244 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc00d180 tx=0x7f6ddc00d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296ffa3bc76b7580 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:50.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de1d9b700 1 -- 172.21.15.73:0/2059670774 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc010070 con 0x7f6de4143480 2023-11-30T23:27:50.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de1d9b700 1 -- 172.21.15.73:0/2059670774 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ddc00dd00 con 0x7f6de4143480 2023-11-30T23:27:50.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de1d9b700 1 -- 172.21.15.73:0/2059670774 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc00b310 con 0x7f6de4143480 2023-11-30T23:27:50.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de359e700 1 -- 172.21.15.73:0/2059670774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de4143480 msgr2=0x7f6de40b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de359e700 1 --2- 172.21.15.73:0/2059670774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de4143480 0x7f6de40b0f60 secure :-1 s=READY pgs=4244 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc00d180 tx=0x7f6ddc00d490 comp rx=0 tx=0).stop 2023-11-30T23:27:50.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de359e700 1 -- 172.21.15.73:0/2059670774 shutdown_connections 2023-11-30T23:27:50.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de359e700 1 --2- 172.21.15.73:0/2059670774 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6de413d9a0 0x7f6de40b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de359e700 1 --2- 172.21.15.73:0/2059670774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de4143480 0x7f6de40b0f60 unknown :-1 s=CLOSED pgs=4244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de359e700 1 -- 172.21.15.73:0/2059670774 >> 172.21.15.73:0/2059670774 conn(0x7f6de40b7b70 msgr2=0x7f6de40b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:50.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de359e700 1 -- 172.21.15.73:0/2059670774 shutdown_connections 2023-11-30T23:27:50.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.410+0000 7f6de359e700 1 -- 172.21.15.73:0/2059670774 wait complete. 2023-11-30T23:27:50.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de359e700 1 Processor -- start 2023-11-30T23:27:50.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de359e700 1 -- start start 2023-11-30T23:27:50.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de359e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6de40b2780 0x7f6de4136d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de359e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6de413d9a0 0x7f6de413c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de4143480 0x7f6de413acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de359e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de406f7a0 con 0x7f6de4143480 2023-11-30T23:27:50.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de359e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de413bfb0 con 0x7f6de40b2780 2023-11-30T23:27:50.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de359e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de40713a0 con 0x7f6de413d9a0 2023-11-30T23:27:50.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de2d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de4143480 0x7f6de413acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de2d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de4143480 0x7f6de413acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60934/0 (socket says 172.21.15.73:60934) 2023-11-30T23:27:50.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de2d9d700 1 -- 172.21.15.73:0/2776165560 learned_addr learned my addr 172.21.15.73:0/2776165560 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:50.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6ddbfff700 1 --2- 172.21.15.73:0/2776165560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6de413d9a0 0x7f6de413c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de259c700 1 --2- 172.21.15.73:0/2776165560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6de40b2780 0x7f6de4136d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de2d9d700 1 -- 172.21.15.73:0/2776165560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6de413d9a0 msgr2=0x7f6de413c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de2d9d700 1 --2- 172.21.15.73:0/2776165560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6de413d9a0 0x7f6de413c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de2d9d700 1 -- 172.21.15.73:0/2776165560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6de40b2780 msgr2=0x7f6de4136d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de2d9d700 1 --2- 172.21.15.73:0/2776165560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6de40b2780 0x7f6de4136d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de2d9d700 1 -- 172.21.15.73:0/2776165560 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc00bd40 con 0x7f6de4143480 2023-11-30T23:27:50.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6ddbfff700 1 --2- 172.21.15.73:0/2776165560 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6de413d9a0 0x7f6de413c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:27:50.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de259c700 1 --2- 172.21.15.73:0/2776165560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6de40b2780 0x7f6de4136d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:27:50.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de2d9d700 1 --2- 172.21.15.73:0/2776165560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de4143480 0x7f6de413acd0 secure :-1 s=READY pgs=4245 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc00a840 tx=0x7f6ddc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:50.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6ddaffd700 1 -- 172.21.15.73:0/2776165560 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc00b4c0 con 0x7f6de4143480 2023-11-30T23:27:50.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6ddaffd700 1 -- 172.21.15.73:0/2776165560 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ddc00ac70 con 0x7f6de4143480 2023-11-30T23:27:50.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de359e700 1 -- 172.21.15.73:0/2776165560 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de413c980 con 0x7f6de4143480 2023-11-30T23:27:50.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6ddaffd700 1 -- 172.21.15.73:0/2776165560 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc004040 con 0x7f6de4143480 2023-11-30T23:27:50.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de359e700 1 -- 172.21.15.73:0/2776165560 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de406fcb0 con 0x7f6de4143480 2023-11-30T23:27:50.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.414+0000 7f6de359e700 1 -- 172.21.15.73:0/2776165560 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6de40aea70 con 0x7f6de4143480 2023-11-30T23:27:50.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.418+0000 7f6ddaffd700 1 -- 172.21.15.73:0/2776165560 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6ddc0041a0 con 0x7f6de4143480 2023-11-30T23:27:50.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.418+0000 7f6ddaffd700 1 --2- 172.21.15.73:0/2776165560 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6dc4065ad0 0x7f6dc4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.418+0000 7f6ddaffd700 1 -- 172.21.15.73:0/2776165560 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f6ddc086de0 con 0x7f6de4143480 2023-11-30T23:27:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.418+0000 7f6de259c700 1 --2- 172.21.15.73:0/2776165560 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6dc4065ad0 0x7f6dc4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.418+0000 7f6ddaffd700 1 --2- 172.21.15.73:0/2776165560 >> [v2:172.21.15.156:6808/36909,v1:172.21.15.156:6809/36909] conn(0x7f6dc406de50 0x7f6dc40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.418+0000 7f6ddaffd700 1 -- 172.21.15.73:0/2776165560 --> [v2:172.21.15.156:6808/36909,v1:172.21.15.156:6809/36909] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6dc40709c0 con 0x7f6dc406de50 2023-11-30T23:27:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.418+0000 7f6ddaffd700 1 -- 172.21.15.73:0/2776165560 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ddc087230 con 0x7f6de4143480 2023-11-30T23:27:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.418+0000 7f6ddbfff700 1 --2- 172.21.15.73:0/2776165560 >> [v2:172.21.15.156:6808/36909,v1:172.21.15.156:6809/36909] conn(0x7f6dc406de50 0x7f6dc40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.418+0000 7f6de259c700 1 --2- 172.21.15.73:0/2776165560 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6dc4065ad0 0x7f6dc4067f90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4000fb0 tx=0x7f6dd4000f20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.418+0000 7f6ddbfff700 1 --2- 172.21.15.73:0/2776165560 >> [v2:172.21.15.156:6808/36909,v1:172.21.15.156:6809/36909] conn(0x7f6dc406de50 0x7f6dc40702f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.426+0000 7f6ddaffd700 1 -- 172.21.15.73:0/2776165560 <== osd.5 v2:172.21.15.156:6808/36909 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6dc40709c0 con 0x7f6dc406de50 2023-11-30T23:27:50.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.442+0000 7f6de359e700 1 -- 172.21.15.73:0/2776165560 --> [v2:172.21.15.156:6808/36909,v1:172.21.15.156:6809/36909] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6de406fe40 con 0x7f6dc406de50 2023-11-30T23:27:50.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.442+0000 7f6ddaffd700 1 -- 172.21.15.73:0/2776165560 <== osd.5 v2:172.21.15.156:6808/36909 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6de406fe40 con 0x7f6dc406de50 2023-11-30T23:27:50.443 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-30T23:27:50.444 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-30T23:27:50.444 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-30T23:27:50.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.442+0000 7f6de359e700 1 -- 172.21.15.73:0/2776165560 >> [v2:172.21.15.156:6808/36909,v1:172.21.15.156:6809/36909] conn(0x7f6dc406de50 msgr2=0x7f6dc40702f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.442+0000 7f6de359e700 1 --2- 172.21.15.73:0/2776165560 >> [v2:172.21.15.156:6808/36909,v1:172.21.15.156:6809/36909] conn(0x7f6dc406de50 0x7f6dc40702f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.442+0000 7f6de359e700 1 -- 172.21.15.73:0/2776165560 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6dc4065ad0 msgr2=0x7f6dc4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.442+0000 7f6de359e700 1 --2- 172.21.15.73:0/2776165560 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6dc4065ad0 0x7f6dc4067f90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4000fb0 tx=0x7f6dd4000f20 comp rx=0 tx=0).stop 2023-11-30T23:27:50.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.442+0000 7f6de359e700 1 -- 172.21.15.73:0/2776165560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de4143480 msgr2=0x7f6de413acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.442+0000 7f6de359e700 1 --2- 172.21.15.73:0/2776165560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de4143480 0x7f6de413acd0 secure :-1 s=READY pgs=4245 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc00a840 tx=0x7f6ddc004af0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.442+0000 7f6de2d9d700 1 -- 172.21.15.73:0/2776165560 reap_dead start 2023-11-30T23:27:50.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.442+0000 7f6de359e700 1 -- 172.21.15.73:0/2776165560 shutdown_connections 2023-11-30T23:27:50.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.442+0000 7f6de359e700 1 -- 172.21.15.73:0/2776165560 >> 172.21.15.73:0/2776165560 conn(0x7f6de40b7b70 msgr2=0x7f6de40b4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:50.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.442+0000 7f6de359e700 1 -- 172.21.15.73:0/2776165560 shutdown_connections 2023-11-30T23:27:50.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.442+0000 7f6de359e700 1 -- 172.21.15.73:0/2776165560 wait complete. 2023-11-30T23:27:50.461 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-30T23:27:50.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.578+0000 7f1cc4a86700 1 Processor -- start 2023-11-30T23:27:50.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.578+0000 7f1cc4a86700 1 -- start start 2023-11-30T23:27:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cc4a86700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1cc013d070 0x7f1cc013d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cc4a86700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1cc0146990 0x7f1cc0146e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cc4a86700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc006f210 con 0x7f1cc00b2710 2023-11-30T23:27:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cc4a86700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc00afe30 con 0x7f1cc0146990 2023-11-30T23:27:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cc4a86700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc0147340 con 0x7f1cc013d070 2023-11-30T23:27:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cbffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1cc0146990 0x7f1cc0146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cbffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1cc0146990 0x7f1cc0146e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60938/0 (socket says 172.21.15.73:60938) 2023-11-30T23:27:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cbffff700 1 -- 172.21.15.73:0/3052302400 learned_addr learned my addr 172.21.15.73:0/3052302400 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:50.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cb6ffd700 1 --2- 172.21.15.73:0/3052302400 >> v2:172.21.15.156:3300/0 conn(0x7f1cc013d070 0x7f1cc013d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cbffff700 1 -- 172.21.15.73:0/3052302400 >> v2:172.21.15.156:3300/0 conn(0x7f1cc013d070 msgr2=0x7f1cc013d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:50.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cbffff700 1 --2- 172.21.15.73:0/3052302400 >> v2:172.21.15.156:3300/0 conn(0x7f1cc013d070 0x7f1cc013d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cbffff700 1 -- 172.21.15.73:0/3052302400 >> v1:172.21.15.73:6789/0 conn(0x7f1cc00b2710 legacy=0x7f1cc00aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cbffff700 1 -- 172.21.15.73:0/3052302400 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc00b2af0 con 0x7f1cc0146990 2023-11-30T23:27:50.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cb6ffd700 1 --2- 172.21.15.73:0/3052302400 >> v2:172.21.15.156:3300/0 conn(0x7f1cc013d070 0x7f1cc013d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:27:50.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cbffff700 1 --2- 172.21.15.73:0/3052302400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cc0146990 0x7f1cc0146e00 secure :-1 s=READY pgs=4247 cs=0 l=1 rev1=1 crypto rx=0x7f1cc00b5640 tx=0x7f1cb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1732bb15aa66afcf server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:50.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cbeffd700 1 -- 172.21.15.73:0/3052302400 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb800e070 con 0x7f1cc0146990 2023-11-30T23:27:50.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cbeffd700 1 -- 172.21.15.73:0/3052302400 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb800b9c0 con 0x7f1cc0146990 2023-11-30T23:27:50.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cbeffd700 1 -- 172.21.15.73:0/3052302400 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb800bd70 con 0x7f1cc0146990 2023-11-30T23:27:50.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cc4a86700 1 -- 172.21.15.73:0/3052302400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cc0146990 msgr2=0x7f1cc0146e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cc4a86700 1 --2- 172.21.15.73:0/3052302400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cc0146990 0x7f1cc0146e00 secure :-1 s=READY pgs=4247 cs=0 l=1 rev1=1 crypto rx=0x7f1cc00b5640 tx=0x7f1cb800b330 comp rx=0 tx=0).stop 2023-11-30T23:27:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cc4a86700 1 -- 172.21.15.73:0/3052302400 shutdown_connections 2023-11-30T23:27:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cc4a86700 1 --2- 172.21.15.73:0/3052302400 >> v2:172.21.15.156:3300/0 conn(0x7f1cc013d070 0x7f1cc013d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cc4a86700 1 --2- 172.21.15.73:0/3052302400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cc0146990 0x7f1cc0146e00 unknown :-1 s=CLOSED pgs=4247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cc4a86700 1 -- 172.21.15.73:0/3052302400 >> 172.21.15.73:0/3052302400 conn(0x7f1cc00b45a0 msgr2=0x7f1cc00b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cc4a86700 1 -- 172.21.15.73:0/3052302400 shutdown_connections 2023-11-30T23:27:50.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.582+0000 7f1cc4a86700 1 -- 172.21.15.73:0/3052302400 wait complete. 2023-11-30T23:27:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.586+0000 7f1cc4a86700 1 Processor -- start 2023-11-30T23:27:50.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.586+0000 7f1cc4a86700 1 -- start start 2023-11-30T23:27:50.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.586+0000 7f1cc4a86700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cc00b2710 0x7f1cc01dc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.586+0000 7f1cc4a86700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1cc013d070 0x7f1cc0143680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.586+0000 7f1cc4a86700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cc0146990 0x7f1cc0071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.586+0000 7f1cc4a86700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc0143230 con 0x7f1cc0146990 2023-11-30T23:27:50.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.586+0000 7f1cc4a86700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc0142e60 con 0x7f1cc00b2710 2023-11-30T23:27:50.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.586+0000 7f1cc4a86700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc013ea70 con 0x7f1cc013d070 2023-11-30T23:27:50.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.586+0000 7f1cbffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cc0146990 0x7f1cc0071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.586+0000 7f1cbffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cc0146990 0x7f1cc0071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60940/0 (socket says 172.21.15.73:60940) 2023-11-30T23:27:50.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.586+0000 7f1cbffff700 1 -- 172.21.15.73:0/2264721986 learned_addr learned my addr 172.21.15.73:0/2264721986 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:50.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.586+0000 7f1cbf7fe700 1 --2- 172.21.15.73:0/2264721986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cc00b2710 0x7f1cc01dc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.586+0000 7f1cb6ffd700 1 --2- 172.21.15.73:0/2264721986 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1cc013d070 0x7f1cc0143680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.590+0000 7f1cbffff700 1 -- 172.21.15.73:0/2264721986 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1cc013d070 msgr2=0x7f1cc0143680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.590+0000 7f1cbffff700 1 --2- 172.21.15.73:0/2264721986 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1cc013d070 0x7f1cc0143680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.590+0000 7f1cbffff700 1 -- 172.21.15.73:0/2264721986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cc00b2710 msgr2=0x7f1cc01dc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.590+0000 7f1cbffff700 1 --2- 172.21.15.73:0/2264721986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cc00b2710 0x7f1cc01dc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.590+0000 7f1cbffff700 1 -- 172.21.15.73:0/2264721986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb8009b30 con 0x7f1cc0146990 2023-11-30T23:27:50.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.590+0000 7f1cbffff700 1 --2- 172.21.15.73:0/2264721986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cc0146990 0x7f1cc0071bb0 secure :-1 s=READY pgs=4248 cs=0 l=1 rev1=1 crypto rx=0x7f1cc006c9a0 tx=0x7f1cb8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:50.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.590+0000 7f1cbcff9700 1 -- 172.21.15.73:0/2264721986 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80092e0 con 0x7f1cc0146990 2023-11-30T23:27:50.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.590+0000 7f1cbcff9700 1 -- 172.21.15.73:0/2264721986 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb8004250 con 0x7f1cc0146990 2023-11-30T23:27:50.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.590+0000 7f1cc4a86700 1 -- 172.21.15.73:0/2264721986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc0142b80 con 0x7f1cc0146990 2023-11-30T23:27:50.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.590+0000 7f1cbcff9700 1 -- 172.21.15.73:0/2264721986 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8004620 con 0x7f1cc0146990 2023-11-30T23:27:50.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.590+0000 7f1cc4a86700 1 -- 172.21.15.73:0/2264721986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc01423d0 con 0x7f1cc0146990 2023-11-30T23:27:50.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.590+0000 7f1cc4a86700 1 -- 172.21.15.73:0/2264721986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc006ed00 con 0x7f1cc0146990 2023-11-30T23:27:50.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.590+0000 7f1cbcff9700 1 -- 172.21.15.73:0/2264721986 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1cb8004780 con 0x7f1cc0146990 2023-11-30T23:27:50.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.590+0000 7f1cbcff9700 1 --2- 172.21.15.73:0/2264721986 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f1ca0065b00 0x7f1ca0067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.590+0000 7f1cbcff9700 1 -- 172.21.15.73:0/2264721986 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f1cb80842c0 con 0x7f1cc0146990 2023-11-30T23:27:50.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.590+0000 7f1cbf7fe700 1 --2- 172.21.15.73:0/2264721986 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f1ca0065b00 0x7f1ca0067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.594+0000 7f1cbf7fe700 1 --2- 172.21.15.73:0/2264721986 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f1ca0065b00 0x7f1ca0067fc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0001880 tx=0x7f1cb0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:50.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.602+0000 7f1cbcff9700 1 -- 172.21.15.73:0/2264721986 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f1cb8051c80 con 0x7f1cc0146990 2023-11-30T23:27:50.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.766+0000 7f1cc4a86700 1 -- 172.21.15.73:0/2264721986 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f1cc00afa50 con 0x7f1ca0065b00 2023-11-30T23:27:50.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.766+0000 7f1cbcff9700 1 -- 172.21.15.73:0/2264721986 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1cb0001d50 con 0x7f1ca0065b00 2023-11-30T23:27:50.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.770+0000 7f1cc4a86700 1 -- 172.21.15.73:0/2264721986 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f1ca0065b00 msgr2=0x7f1ca0067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.770+0000 7f1cc4a86700 1 --2- 172.21.15.73:0/2264721986 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f1ca0065b00 0x7f1ca0067fc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0001880 tx=0x7f1cb0009040 comp rx=0 tx=0).stop 2023-11-30T23:27:50.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.770+0000 7f1cc4a86700 1 -- 172.21.15.73:0/2264721986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cc0146990 msgr2=0x7f1cc0071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.770+0000 7f1cc4a86700 1 --2- 172.21.15.73:0/2264721986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cc0146990 0x7f1cc0071bb0 secure :-1 s=READY pgs=4248 cs=0 l=1 rev1=1 crypto rx=0x7f1cc006c9a0 tx=0x7f1cb8004af0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.770+0000 7f1cc4a86700 1 -- 172.21.15.73:0/2264721986 shutdown_connections 2023-11-30T23:27:50.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.770+0000 7f1cc4a86700 1 --2- 172.21.15.73:0/2264721986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cc0146990 0x7f1cc0071bb0 unknown :-1 s=CLOSED pgs=4248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.770+0000 7f1cc4a86700 1 --2- 172.21.15.73:0/2264721986 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f1cc013d070 0x7f1cc0143680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.770+0000 7f1cc4a86700 1 --2- 172.21.15.73:0/2264721986 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f1ca0065b00 0x7f1ca0067fc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.770+0000 7f1cc4a86700 1 --2- 172.21.15.73:0/2264721986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cc00b2710 0x7f1cc01dc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.770+0000 7f1cc4a86700 1 -- 172.21.15.73:0/2264721986 >> 172.21.15.73:0/2264721986 conn(0x7f1cc00b45a0 msgr2=0x7f1cc013c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:50.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.770+0000 7f1cc4a86700 1 -- 172.21.15.73:0/2264721986 shutdown_connections 2023-11-30T23:27:50.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.770+0000 7f1cc4a86700 1 -- 172.21.15.73:0/2264721986 wait complete. 2023-11-30T23:27:50.774 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 5 to deep-scrub 2023-11-30T23:27:50.790 INFO:tasks.ceph:Scrubbing osd.6 2023-11-30T23:27:50.790 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-30T23:27:50.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.914+0000 7fe602d1d700 1 Processor -- start 2023-11-30T23:27:50.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.914+0000 7fe602d1d700 1 -- start start 2023-11-30T23:27:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe602d1d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5fc0b8fd0 0x7fe5fc140580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe602d1d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe5fc0b8400 0x7fe5fc140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe602d1d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc0b3370 con 0x7fe5fc0b25c0 2023-11-30T23:27:50.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe602d1d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5fc0b3650 con 0x7fe5fc0b8400 2023-11-30T23:27:50.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe602d1d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0b63a0 con 0x7fe5fc0b8fd0 2023-11-30T23:27:50.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe60151a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe5fc0b8400 0x7fe5fc140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe60251c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe5fc0b25c0 0x7fe5fc0b42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48576/0 (socket says 172.21.15.73:48576) 2023-11-30T23:27:50.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe60251c700 1 -- 172.21.15.73:0/2052555736 learned_addr learned my addr 172.21.15.73:0/2052555736 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:27:50.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe601d1b700 1 --2- 172.21.15.73:0/2052555736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5fc0b8fd0 0x7fe5fc140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe60151a700 1 -- 172.21.15.73:0/2052555736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5fc0b8fd0 msgr2=0x7fe5fc140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:50.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe60151a700 1 --2- 172.21.15.73:0/2052555736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5fc0b8fd0 0x7fe5fc140580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe60151a700 1 -- 172.21.15.73:0/2052555736 >> v1:172.21.15.73:6789/0 conn(0x7fe5fc0b25c0 legacy=0x7fe5fc0b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe60151a700 1 -- 172.21.15.73:0/2052555736 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc0b93b0 con 0x7fe5fc0b8400 2023-11-30T23:27:50.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe601d1b700 1 --2- 172.21.15.73:0/2052555736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5fc0b8fd0 0x7fe5fc140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:27:50.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe60151a700 1 --2- 172.21.15.73:0/2052555736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5fc0b8400 0x7fe5fc140ac0 secure :-1 s=READY pgs=4250 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009850 tx=0x7fe5f8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b368ea2e8c45a56 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:50.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe600d19700 1 -- 172.21.15.73:0/2052555736 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8011830 con 0x7fe5fc0b8400 2023-11-30T23:27:50.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe600d19700 1 -- 172.21.15.73:0/2052555736 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f8011990 con 0x7fe5fc0b8400 2023-11-30T23:27:50.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe600d19700 1 -- 172.21.15.73:0/2052555736 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8011d20 con 0x7fe5fc0b8400 2023-11-30T23:27:50.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe602d1d700 1 -- 172.21.15.73:0/2052555736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5fc0b8400 msgr2=0x7fe5fc140ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe602d1d700 1 --2- 172.21.15.73:0/2052555736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5fc0b8400 0x7fe5fc140ac0 secure :-1 s=READY pgs=4250 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009850 tx=0x7fe5f8009b60 comp rx=0 tx=0).stop 2023-11-30T23:27:50.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe602d1d700 1 -- 172.21.15.73:0/2052555736 shutdown_connections 2023-11-30T23:27:50.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe602d1d700 1 --2- 172.21.15.73:0/2052555736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5fc0b8400 0x7fe5fc140ac0 unknown :-1 s=CLOSED pgs=4250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe602d1d700 1 --2- 172.21.15.73:0/2052555736 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5fc0b8fd0 0x7fe5fc140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe602d1d700 1 -- 172.21.15.73:0/2052555736 >> 172.21.15.73:0/2052555736 conn(0x7fe5fc071a90 msgr2=0x7fe5fc071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:50.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe602d1d700 1 -- 172.21.15.73:0/2052555736 shutdown_connections 2023-11-30T23:27:50.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.918+0000 7fe602d1d700 1 -- 172.21.15.73:0/2052555736 wait complete. 2023-11-30T23:27:50.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe602d1d700 1 Processor -- start 2023-11-30T23:27:50.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe602d1d700 1 -- start start 2023-11-30T23:27:50.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe602d1d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5fc0b25c0 0x7fe5fc0bc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe602d1d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5fc0b8400 0x7fe5fc143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe602d1d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5fc0b8fd0 0x7fe5fc0baa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe602d1d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc143d50 con 0x7fe5fc0b25c0 2023-11-30T23:27:50.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe602d1d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0bbe80 con 0x7fe5fc0b8fd0 2023-11-30T23:27:50.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe602d1d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0b9f60 con 0x7fe5fc0b8400 2023-11-30T23:27:50.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe601d1b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5fc0b25c0 0x7fe5fc0bc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe601d1b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5fc0b25c0 0x7fe5fc0bc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60964/0 (socket says 172.21.15.73:60964) 2023-11-30T23:27:50.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe601d1b700 1 -- 172.21.15.73:0/3629057593 learned_addr learned my addr 172.21.15.73:0/3629057593 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:50.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe60151a700 1 --2- 172.21.15.73:0/3629057593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5fc0b8400 0x7fe5fc143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe60251c700 1 --2- 172.21.15.73:0/3629057593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5fc0b8fd0 0x7fe5fc0baa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe601d1b700 1 -- 172.21.15.73:0/3629057593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5fc0b8400 msgr2=0x7fe5fc143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe601d1b700 1 --2- 172.21.15.73:0/3629057593 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe5fc0b8400 0x7fe5fc143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe601d1b700 1 -- 172.21.15.73:0/3629057593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5fc0b8fd0 msgr2=0x7fe5fc0baa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe601d1b700 1 --2- 172.21.15.73:0/3629057593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5fc0b8fd0 0x7fe5fc0baa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe601d1b700 1 -- 172.21.15.73:0/3629057593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f80094b0 con 0x7fe5fc0b25c0 2023-11-30T23:27:50.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.922+0000 7fe60251c700 1 --2- 172.21.15.73:0/3629057593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5fc0b8fd0 0x7fe5fc0baa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:27:50.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.926+0000 7fe601d1b700 1 --2- 172.21.15.73:0/3629057593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5fc0b25c0 0x7fe5fc0bc8f0 secure :-1 s=READY pgs=4251 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00e810 tx=0x7fe5ec00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:50.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.926+0000 7fe5f27fc700 1 -- 172.21.15.73:0/3629057593 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec013610 con 0x7fe5fc0b25c0 2023-11-30T23:27:50.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.926+0000 7fe5f27fc700 1 -- 172.21.15.73:0/3629057593 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec013770 con 0x7fe5fc0b25c0 2023-11-30T23:27:50.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.926+0000 7fe602d1d700 1 -- 172.21.15.73:0/3629057593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc0ba240 con 0x7fe5fc0b25c0 2023-11-30T23:27:50.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.926+0000 7fe5f27fc700 1 -- 172.21.15.73:0/3629057593 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec013b00 con 0x7fe5fc0b25c0 2023-11-30T23:27:50.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.926+0000 7fe602d1d700 1 -- 172.21.15.73:0/3629057593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc0baf80 con 0x7fe5fc0b25c0 2023-11-30T23:27:50.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.926+0000 7fe602d1d700 1 -- 172.21.15.73:0/3629057593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe5fc0b3bf0 con 0x7fe5fc0b25c0 2023-11-30T23:27:50.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.926+0000 7fe5f27fc700 1 -- 172.21.15.73:0/3629057593 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe5ec013c60 con 0x7fe5fc0b25c0 2023-11-30T23:27:50.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.930+0000 7fe5f27fc700 1 --2- 172.21.15.73:0/3629057593 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fe5e0065b00 0x7fe5e0067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.930+0000 7fe5f27fc700 1 -- 172.21.15.73:0/3629057593 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fe5ec082d10 con 0x7fe5fc0b25c0 2023-11-30T23:27:50.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.930+0000 7fe60151a700 1 --2- 172.21.15.73:0/3629057593 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fe5e0065b00 0x7fe5e0067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.930+0000 7fe5f27fc700 1 --2- 172.21.15.73:0/3629057593 >> [v2:172.21.15.156:6816/36910,v1:172.21.15.156:6817/36910] conn(0x7fe5e006de80 0x7fe5e0070320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:50.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.930+0000 7fe5f27fc700 1 -- 172.21.15.73:0/3629057593 --> [v2:172.21.15.156:6816/36910,v1:172.21.15.156:6817/36910] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe5e00709f0 con 0x7fe5e006de80 2023-11-30T23:27:50.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.930+0000 7fe5f27fc700 1 -- 172.21.15.73:0/3629057593 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5ec086020 con 0x7fe5fc0b25c0 2023-11-30T23:27:50.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.930+0000 7fe60251c700 1 --2- 172.21.15.73:0/3629057593 >> [v2:172.21.15.156:6816/36910,v1:172.21.15.156:6817/36910] conn(0x7fe5e006de80 0x7fe5e0070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:50.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.930+0000 7fe60151a700 1 --2- 172.21.15.73:0/3629057593 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fe5e0065b00 0x7fe5e0067fc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009fd0 tx=0x7fe5f8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:50.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.930+0000 7fe60251c700 1 --2- 172.21.15.73:0/3629057593 >> [v2:172.21.15.156:6816/36910,v1:172.21.15.156:6817/36910] conn(0x7fe5e006de80 0x7fe5e0070320 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:50.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.930+0000 7fe5f27fc700 1 -- 172.21.15.73:0/3629057593 <== osd.6 v2:172.21.15.156:6816/36910 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe5e00709f0 con 0x7fe5e006de80 2023-11-30T23:27:50.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.950+0000 7fe602d1d700 1 -- 172.21.15.73:0/3629057593 --> [v2:172.21.15.156:6816/36910,v1:172.21.15.156:6817/36910] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe5fc0ba0d0 con 0x7fe5e006de80 2023-11-30T23:27:50.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.950+0000 7fe5f27fc700 1 -- 172.21.15.73:0/3629057593 <== osd.6 v2:172.21.15.156:6816/36910 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe5fc0ba0d0 con 0x7fe5e006de80 2023-11-30T23:27:50.958 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-30T23:27:50.958 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-30T23:27:50.958 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-30T23:27:50.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.950+0000 7fe602d1d700 1 -- 172.21.15.73:0/3629057593 >> [v2:172.21.15.156:6816/36910,v1:172.21.15.156:6817/36910] conn(0x7fe5e006de80 msgr2=0x7fe5e0070320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.950+0000 7fe602d1d700 1 --2- 172.21.15.73:0/3629057593 >> [v2:172.21.15.156:6816/36910,v1:172.21.15.156:6817/36910] conn(0x7fe5e006de80 0x7fe5e0070320 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:50.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.950+0000 7fe602d1d700 1 -- 172.21.15.73:0/3629057593 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fe5e0065b00 msgr2=0x7fe5e0067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.950+0000 7fe602d1d700 1 --2- 172.21.15.73:0/3629057593 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fe5e0065b00 0x7fe5e0067fc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009fd0 tx=0x7fe5f8008030 comp rx=0 tx=0).stop 2023-11-30T23:27:50.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.950+0000 7fe602d1d700 1 -- 172.21.15.73:0/3629057593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5fc0b25c0 msgr2=0x7fe5fc0bc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:50.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.950+0000 7fe602d1d700 1 --2- 172.21.15.73:0/3629057593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5fc0b25c0 0x7fe5fc0bc8f0 secure :-1 s=READY pgs=4251 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00e810 tx=0x7fe5ec00eb20 comp rx=0 tx=0).stop 2023-11-30T23:27:50.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.950+0000 7fe60251c700 1 -- 172.21.15.73:0/3629057593 reap_dead start 2023-11-30T23:27:50.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.950+0000 7fe602d1d700 1 -- 172.21.15.73:0/3629057593 shutdown_connections 2023-11-30T23:27:50.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.950+0000 7fe602d1d700 1 -- 172.21.15.73:0/3629057593 >> 172.21.15.73:0/3629057593 conn(0x7fe5fc071a90 msgr2=0x7fe5fc13f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:50.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.950+0000 7fe602d1d700 1 -- 172.21.15.73:0/3629057593 shutdown_connections 2023-11-30T23:27:50.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:50.950+0000 7fe602d1d700 1 -- 172.21.15.73:0/3629057593 wait complete. 2023-11-30T23:27:50.964 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-30T23:27:51.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.090+0000 7f06f9ae2700 1 Processor -- start 2023-11-30T23:27:51.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.090+0000 7f06f9ae2700 1 -- start start 2023-11-30T23:27:51.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f9ae2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06f40b4b10 0x7f06f4146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f9ae2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f06f41401e0 0x7f06f41405e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f9ae2700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f40b6130 con 0x7f06f40b6910 2023-11-30T23:27:51.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f9ae2700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f40b5f50 con 0x7f06f41401e0 2023-11-30T23:27:51.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f9ae2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f40b43c0 con 0x7f06f40b4b10 2023-11-30T23:27:51.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f92e1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f06f41401e0 0x7f06f41405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f8ae0700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06f40b4b10 0x7f06f4146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f92e1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f06f41401e0 0x7f06f41405e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60978/0 (socket says 172.21.15.73:60978) 2023-11-30T23:27:51.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f92e1700 1 -- 172.21.15.73:0/180486674 learned_addr learned my addr 172.21.15.73:0/180486674 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:51.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f92e1700 1 -- 172.21.15.73:0/180486674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06f40b4b10 msgr2=0x7f06f4146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:51.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f92e1700 1 --2- 172.21.15.73:0/180486674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06f40b4b10 0x7f06f4146fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f92e1700 1 -- 172.21.15.73:0/180486674 >> v1:172.21.15.156:6789/0 conn(0x7f06f40b6910 legacy=0x7f06f40b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f92e1700 1 -- 172.21.15.73:0/180486674 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f40b8700 con 0x7f06f41401e0 2023-11-30T23:27:51.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f92e1700 1 --2- 172.21.15.73:0/180486674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06f41401e0 0x7f06f41405e0 secure :-1 s=READY pgs=4252 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009e50 tx=0x7f06ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c24a24d81bb92f server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:51.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f37fe700 1 -- 172.21.15.73:0/180486674 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec00e070 con 0x7f06f41401e0 2023-11-30T23:27:51.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f37fe700 1 -- 172.21.15.73:0/180486674 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec00b910 con 0x7f06f41401e0 2023-11-30T23:27:51.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f37fe700 1 -- 172.21.15.73:0/180486674 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec00bcc0 con 0x7f06f41401e0 2023-11-30T23:27:51.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f9ae2700 1 -- 172.21.15.73:0/180486674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06f41401e0 msgr2=0x7f06f41405e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f9ae2700 1 --2- 172.21.15.73:0/180486674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06f41401e0 0x7f06f41405e0 secure :-1 s=READY pgs=4252 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009e50 tx=0x7f06ec00b330 comp rx=0 tx=0).stop 2023-11-30T23:27:51.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f9ae2700 1 -- 172.21.15.73:0/180486674 shutdown_connections 2023-11-30T23:27:51.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f9ae2700 1 --2- 172.21.15.73:0/180486674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06f41401e0 0x7f06f41405e0 unknown :-1 s=CLOSED pgs=4252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f9ae2700 1 --2- 172.21.15.73:0/180486674 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06f40b4b10 0x7f06f4146fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f9ae2700 1 -- 172.21.15.73:0/180486674 >> 172.21.15.73:0/180486674 conn(0x7f06f40b8a10 msgr2=0x7f06f40b8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:51.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f9ae2700 1 -- 172.21.15.73:0/180486674 shutdown_connections 2023-11-30T23:27:51.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.094+0000 7f06f9ae2700 1 -- 172.21.15.73:0/180486674 wait complete. 2023-11-30T23:27:51.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.098+0000 7f06f9ae2700 1 Processor -- start 2023-11-30T23:27:51.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.098+0000 7f06f9ae2700 1 -- start start 2023-11-30T23:27:51.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f9ae2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06f40b4b10 0x7f06f40bb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f9ae2700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06f40b6910 0x7f06f40acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f9ae2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06f41401e0 0x7f06f40b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f9ae2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f40ac760 con 0x7f06f40b4b10 2023-11-30T23:27:51.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f9ae2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f40ab360 con 0x7f06f41401e0 2023-11-30T23:27:51.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f9ae2700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f40ab8e0 con 0x7f06f40b6910 2023-11-30T23:27:51.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f8ae0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06f40b4b10 0x7f06f40bb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f8ae0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06f40b4b10 0x7f06f40bb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60980/0 (socket says 172.21.15.73:60980) 2023-11-30T23:27:51.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f8ae0700 1 -- 172.21.15.73:0/3515024296 learned_addr learned my addr 172.21.15.73:0/3515024296 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:51.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f3fff700 1 --2- 172.21.15.73:0/3515024296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06f40b6910 0x7f06f40acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f8ae0700 1 -- 172.21.15.73:0/3515024296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06f40b6910 msgr2=0x7f06f40acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f8ae0700 1 --2- 172.21.15.73:0/3515024296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06f40b6910 0x7f06f40acb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f8ae0700 1 -- 172.21.15.73:0/3515024296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06f41401e0 msgr2=0x7f06f40b1970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-30T23:27:51.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f8ae0700 1 --2- 172.21.15.73:0/3515024296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06f41401e0 0x7f06f40b1970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f8ae0700 1 -- 172.21.15.73:0/3515024296 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec009b30 con 0x7f06f40b4b10 2023-11-30T23:27:51.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f8ae0700 1 --2- 172.21.15.73:0/3515024296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06f40b4b10 0x7f06f40bb680 secure :-1 s=READY pgs=4253 cs=0 l=1 rev1=1 crypto rx=0x7f06e000e9d0 tx=0x7f06e000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:51.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f17fa700 1 -- 172.21.15.73:0/3515024296 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0009720 con 0x7f06f40b4b10 2023-11-30T23:27:51.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f17fa700 1 -- 172.21.15.73:0/3515024296 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e000c850 con 0x7f06f40b4b10 2023-11-30T23:27:51.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f9ae2700 1 -- 172.21.15.73:0/3515024296 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f40ab600 con 0x7f06f40b4b10 2023-11-30T23:27:51.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f17fa700 1 -- 172.21.15.73:0/3515024296 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e000cbc0 con 0x7f06f40b4b10 2023-11-30T23:27:51.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f9ae2700 1 -- 172.21.15.73:0/3515024296 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f40ac070 con 0x7f06f40b4b10 2023-11-30T23:27:51.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f9ae2700 1 -- 172.21.15.73:0/3515024296 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f404ed80 con 0x7f06f40b4b10 2023-11-30T23:27:51.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f17fa700 1 -- 172.21.15.73:0/3515024296 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f06e000cd20 con 0x7f06f40b4b10 2023-11-30T23:27:51.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f17fa700 1 --2- 172.21.15.73:0/3515024296 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f06d8065b00 0x7f06d8067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f17fa700 1 -- 172.21.15.73:0/3515024296 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f06e0083200 con 0x7f06f40b4b10 2023-11-30T23:27:51.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.102+0000 7f06f3fff700 1 --2- 172.21.15.73:0/3515024296 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f06d8065b00 0x7f06d8067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.106+0000 7f06f3fff700 1 --2- 172.21.15.73:0/3515024296 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f06d8065b00 0x7f06d8067fc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f06f41df900 tx=0x7f06e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:51.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.110+0000 7f06f17fa700 1 -- 172.21.15.73:0/3515024296 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f06e0050bc0 con 0x7f06f40b4b10 2023-11-30T23:27:51.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.278+0000 7f06f9ae2700 1 -- 172.21.15.73:0/3515024296 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f06f41467a0 con 0x7f06d8065b00 2023-11-30T23:27:51.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.278+0000 7f06f17fa700 1 -- 172.21.15.73:0/3515024296 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f06e80050d0 con 0x7f06d8065b00 2023-11-30T23:27:51.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.278+0000 7f06f9ae2700 1 -- 172.21.15.73:0/3515024296 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f06d8065b00 msgr2=0x7f06d8067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.278+0000 7f06f9ae2700 1 --2- 172.21.15.73:0/3515024296 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f06d8065b00 0x7f06d8067fc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f06f41df900 tx=0x7f06e8009040 comp rx=0 tx=0).stop 2023-11-30T23:27:51.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.278+0000 7f06f9ae2700 1 -- 172.21.15.73:0/3515024296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06f40b4b10 msgr2=0x7f06f40bb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.278+0000 7f06f9ae2700 1 --2- 172.21.15.73:0/3515024296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06f40b4b10 0x7f06f40bb680 secure :-1 s=READY pgs=4253 cs=0 l=1 rev1=1 crypto rx=0x7f06e000e9d0 tx=0x7f06e000ed90 comp rx=0 tx=0).stop 2023-11-30T23:27:51.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.282+0000 7f06f9ae2700 1 -- 172.21.15.73:0/3515024296 shutdown_connections 2023-11-30T23:27:51.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.282+0000 7f06f9ae2700 1 --2- 172.21.15.73:0/3515024296 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f06d8065b00 0x7f06d8067fc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.282+0000 7f06f9ae2700 1 --2- 172.21.15.73:0/3515024296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06f41401e0 0x7f06f40b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.282+0000 7f06f9ae2700 1 --2- 172.21.15.73:0/3515024296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f06f40b6910 0x7f06f40acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.282+0000 7f06f9ae2700 1 --2- 172.21.15.73:0/3515024296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06f40b4b10 0x7f06f40bb680 unknown :-1 s=CLOSED pgs=4253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.282+0000 7f06f9ae2700 1 -- 172.21.15.73:0/3515024296 >> 172.21.15.73:0/3515024296 conn(0x7f06f40b8a10 msgr2=0x7f06f41453f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:51.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.282+0000 7f06f9ae2700 1 -- 172.21.15.73:0/3515024296 shutdown_connections 2023-11-30T23:27:51.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.282+0000 7f06f9ae2700 1 -- 172.21.15.73:0/3515024296 wait complete. 2023-11-30T23:27:51.283 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 6 to deep-scrub 2023-11-30T23:27:51.295 INFO:tasks.ceph:Scrubbing osd.7 2023-11-30T23:27:51.295 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-30T23:27:51.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.418+0000 7fc3064b9700 1 Processor -- start 2023-11-30T23:27:51.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.418+0000 7fc3064b9700 1 -- start start 2023-11-30T23:27:51.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.418+0000 7fc3064b9700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc3000b1490 0x7fc3001446f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.418+0000 7fc3064b9700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc30006eff0 0x7fc300144c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.418+0000 7fc3064b9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc300071d20 0x7fc3000721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.418+0000 7fc3064b9700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc30013ed60 con 0x7fc3000b1490 2023-11-30T23:27:51.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.418+0000 7fc3064b9700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3000726f0 con 0x7fc30006eff0 2023-11-30T23:27:51.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.418+0000 7fc3064b9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3000b1870 con 0x7fc300071d20 2023-11-30T23:27:51.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.418+0000 7fc3054b7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc3000b1490 0x7fc3001446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.418+0000 7fc3054b7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc3000b1490 0x7fc3001446f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60988/0 (socket says 172.21.15.73:60988) 2023-11-30T23:27:51.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.418+0000 7fc3054b7700 1 -- 172.21.15.73:0/187615802 learned_addr learned my addr 172.21.15.73:0/187615802 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:51.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.418+0000 7fc305cb8700 1 --2- 172.21.15.73:0/187615802 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc300071d20 0x7fc3000721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.418+0000 7fc304cb6700 1 --2- 172.21.15.73:0/187615802 >> v2:172.21.15.156:3300/0 conn(0x7fc30006eff0 0x7fc300144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.422+0000 7fc3054b7700 1 -- 172.21.15.73:0/187615802 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc300071d20 msgr2=0x7fc3000721b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:51.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.422+0000 7fc3054b7700 1 --2- 172.21.15.73:0/187615802 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc300071d20 0x7fc3000721b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.422+0000 7fc3054b7700 1 -- 172.21.15.73:0/187615802 >> v2:172.21.15.156:3300/0 conn(0x7fc30006eff0 msgr2=0x7fc300144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:51.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.422+0000 7fc3054b7700 1 --2- 172.21.15.73:0/187615802 >> v2:172.21.15.156:3300/0 conn(0x7fc30006eff0 0x7fc300144c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.422+0000 7fc3054b7700 1 -- 172.21.15.73:0/187615802 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3000b3a00 con 0x7fc3000b1490 2023-11-30T23:27:51.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.422+0000 7fc3054b7700 1 --2- 172.21.15.73:0/187615802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3000b1490 0x7fc3001446f0 secure :-1 s=READY pgs=4254 cs=0 l=1 rev1=1 crypto rx=0x7fc3000b1ed0 tx=0x7fc2fc009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712b959f842b9aef server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:51.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc2f7fff700 1 -- 172.21.15.73:0/187615802 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc011830 con 0x7fc3000b1490 2023-11-30T23:27:51.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc2f7fff700 1 -- 172.21.15.73:0/187615802 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc011990 con 0x7fc3000b1490 2023-11-30T23:27:51.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc2f7fff700 1 -- 172.21.15.73:0/187615802 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc011d20 con 0x7fc3000b1490 2023-11-30T23:27:51.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3064b9700 1 -- 172.21.15.73:0/187615802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3000b1490 msgr2=0x7fc3001446f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3064b9700 1 --2- 172.21.15.73:0/187615802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3000b1490 0x7fc3001446f0 secure :-1 s=READY pgs=4254 cs=0 l=1 rev1=1 crypto rx=0x7fc3000b1ed0 tx=0x7fc2fc009be0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3064b9700 1 -- 172.21.15.73:0/187615802 shutdown_connections 2023-11-30T23:27:51.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3064b9700 1 --2- 172.21.15.73:0/187615802 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc300071d20 0x7fc3000721b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3064b9700 1 --2- 172.21.15.73:0/187615802 >> v2:172.21.15.156:3300/0 conn(0x7fc30006eff0 0x7fc300144c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3064b9700 1 --2- 172.21.15.73:0/187615802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3000b1490 0x7fc3001446f0 unknown :-1 s=CLOSED pgs=4254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3064b9700 1 -- 172.21.15.73:0/187615802 >> 172.21.15.73:0/187615802 conn(0x7fc3000b7b70 msgr2=0x7fc3000b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:51.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3064b9700 1 -- 172.21.15.73:0/187615802 shutdown_connections 2023-11-30T23:27:51.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3064b9700 1 -- 172.21.15.73:0/187615802 wait complete. 2023-11-30T23:27:51.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3064b9700 1 Processor -- start 2023-11-30T23:27:51.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3064b9700 1 -- start start 2023-11-30T23:27:51.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3064b9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc30006eff0 0x7fc3000a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3064b9700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc300071d20 0x7fc30013fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3064b9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3000b1490 0x7fc300140420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3064b9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3001423b0 con 0x7fc30006eff0 2023-11-30T23:27:51.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3064b9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc300142110 con 0x7fc3000b1490 2023-11-30T23:27:51.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3064b9700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30013f9c0 con 0x7fc300071d20 2023-11-30T23:27:51.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3054b7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc30006eff0 0x7fc3000a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3054b7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc30006eff0 0x7fc3000a9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32772/0 (socket says 172.21.15.73:32772) 2023-11-30T23:27:51.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc305cb8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3000b1490 0x7fc300140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc3054b7700 1 -- 172.21.15.73:0/2019955441 learned_addr learned my addr 172.21.15.73:0/2019955441 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:51.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.426+0000 7fc304cb6700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc300071d20 0x7fc30013fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc3054b7700 1 -- 172.21.15.73:0/2019955441 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc300071d20 msgr2=0x7fc30013fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc3054b7700 1 --2- 172.21.15.73:0/2019955441 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc300071d20 0x7fc30013fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc3054b7700 1 -- 172.21.15.73:0/2019955441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3000b1490 msgr2=0x7fc300140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc3054b7700 1 --2- 172.21.15.73:0/2019955441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3000b1490 0x7fc300140420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc3054b7700 1 -- 172.21.15.73:0/2019955441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc009510 con 0x7fc30006eff0 2023-11-30T23:27:51.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc305cb8700 1 --2- 172.21.15.73:0/2019955441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3000b1490 0x7fc300140420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:27:51.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc304cb6700 1 --2- 172.21.15.73:0/2019955441 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fc300071d20 0x7fc30013fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:27:51.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc3054b7700 1 --2- 172.21.15.73:0/2019955441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc30006eff0 0x7fc3000a9c40 secure :-1 s=READY pgs=4255 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc009c20 tx=0x7fc2fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:51.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc2f5ffb700 1 -- 172.21.15.73:0/2019955441 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc004450 con 0x7fc30006eff0 2023-11-30T23:27:51.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc2f5ffb700 1 -- 172.21.15.73:0/2019955441 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc01e070 con 0x7fc30006eff0 2023-11-30T23:27:51.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc3064b9700 1 -- 172.21.15.73:0/2019955441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3000ae6a0 con 0x7fc30006eff0 2023-11-30T23:27:51.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc2f5ffb700 1 -- 172.21.15.73:0/2019955441 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc003900 con 0x7fc30006eff0 2023-11-30T23:27:51.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc3064b9700 1 -- 172.21.15.73:0/2019955441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3001417f0 con 0x7fc30006eff0 2023-11-30T23:27:51.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc3064b9700 1 -- 172.21.15.73:0/2019955441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc30013f840 con 0x7fc30006eff0 2023-11-30T23:27:51.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc2f5ffb700 1 -- 172.21.15.73:0/2019955441 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc2fc003a60 con 0x7fc30006eff0 2023-11-30T23:27:51.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc2f5ffb700 1 --2- 172.21.15.73:0/2019955441 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc2e4065ad0 0x7fc2e4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc2f5ffb700 1 -- 172.21.15.73:0/2019955441 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc2fc020070 con 0x7fc30006eff0 2023-11-30T23:27:51.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc304cb6700 1 --2- 172.21.15.73:0/2019955441 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc2e4065ad0 0x7fc2e4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc2f5ffb700 1 --2- 172.21.15.73:0/2019955441 >> [v2:172.21.15.156:6824/36911,v1:172.21.15.156:6825/36911] conn(0x7fc2e406de50 0x7fc2e40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc2f5ffb700 1 -- 172.21.15.73:0/2019955441 --> [v2:172.21.15.156:6824/36911,v1:172.21.15.156:6825/36911] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2e40709c0 con 0x7fc2e406de50 2023-11-30T23:27:51.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc2f5ffb700 1 -- 172.21.15.73:0/2019955441 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2fc086780 con 0x7fc30006eff0 2023-11-30T23:27:51.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc305cb8700 1 --2- 172.21.15.73:0/2019955441 >> [v2:172.21.15.156:6824/36911,v1:172.21.15.156:6825/36911] conn(0x7fc2e406de50 0x7fc2e40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc304cb6700 1 --2- 172.21.15.73:0/2019955441 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc2e4065ad0 0x7fc2e4067f90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc30013a210 tx=0x7fc2f0009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:51.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.430+0000 7fc305cb8700 1 --2- 172.21.15.73:0/2019955441 >> [v2:172.21.15.156:6824/36911,v1:172.21.15.156:6825/36911] conn(0x7fc2e406de50 0x7fc2e40702f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:51.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.434+0000 7fc2f5ffb700 1 -- 172.21.15.73:0/2019955441 <== osd.7 v2:172.21.15.156:6824/36911 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc2e40709c0 con 0x7fc2e406de50 2023-11-30T23:27:51.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.450+0000 7fc3064b9700 1 -- 172.21.15.73:0/2019955441 --> [v2:172.21.15.156:6824/36911,v1:172.21.15.156:6825/36911] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc3000b3fc0 con 0x7fc2e406de50 2023-11-30T23:27:51.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.450+0000 7fc2f5ffb700 1 -- 172.21.15.73:0/2019955441 <== osd.7 v2:172.21.15.156:6824/36911 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc2f800f040 con 0x7fc2e406de50 2023-11-30T23:27:51.453 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-11-30T23:27:51.454 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-30T23:27:51.454 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-11-30T23:27:51.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.450+0000 7fc3064b9700 1 -- 172.21.15.73:0/2019955441 >> [v2:172.21.15.156:6824/36911,v1:172.21.15.156:6825/36911] conn(0x7fc2e406de50 msgr2=0x7fc2e40702f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.450+0000 7fc3064b9700 1 --2- 172.21.15.73:0/2019955441 >> [v2:172.21.15.156:6824/36911,v1:172.21.15.156:6825/36911] conn(0x7fc2e406de50 0x7fc2e40702f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.450+0000 7fc3064b9700 1 -- 172.21.15.73:0/2019955441 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc2e4065ad0 msgr2=0x7fc2e4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.450+0000 7fc3064b9700 1 --2- 172.21.15.73:0/2019955441 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fc2e4065ad0 0x7fc2e4067f90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc30013a210 tx=0x7fc2f0009240 comp rx=0 tx=0).stop 2023-11-30T23:27:51.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.450+0000 7fc3064b9700 1 -- 172.21.15.73:0/2019955441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc30006eff0 msgr2=0x7fc3000a9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.450+0000 7fc3064b9700 1 --2- 172.21.15.73:0/2019955441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc30006eff0 0x7fc3000a9c40 secure :-1 s=READY pgs=4255 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc009c20 tx=0x7fc2fc004770 comp rx=0 tx=0).stop 2023-11-30T23:27:51.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.450+0000 7fc305cb8700 1 -- 172.21.15.73:0/2019955441 reap_dead start 2023-11-30T23:27:51.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.450+0000 7fc3064b9700 1 -- 172.21.15.73:0/2019955441 shutdown_connections 2023-11-30T23:27:51.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.450+0000 7fc3064b9700 1 -- 172.21.15.73:0/2019955441 >> 172.21.15.73:0/2019955441 conn(0x7fc3000b7b70 msgr2=0x7fc3001425a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:51.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.450+0000 7fc3064b9700 1 -- 172.21.15.73:0/2019955441 shutdown_connections 2023-11-30T23:27:51.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.450+0000 7fc3064b9700 1 -- 172.21.15.73:0/2019955441 wait complete. 2023-11-30T23:27:51.465 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-30T23:27:51.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.582+0000 7fd79f464700 1 Processor -- start 2023-11-30T23:27:51.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.582+0000 7fd79f464700 1 -- start start 2023-11-30T23:27:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.582+0000 7fd79f464700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd7900385c0 0x7fd7900398c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.582+0000 7fd79f464700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd790035eb0 con 0x7fd7900c4a70 2023-11-30T23:27:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79f464700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7900389a0 con 0x7fd79003a480 2023-11-30T23:27:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79f464700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79003ac60 con 0x7fd7900385c0 2023-11-30T23:27:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79ec63700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd7900c4a70 0x7fd7900d4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48586/0 (socket says 172.21.15.73:48586) 2023-11-30T23:27:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79ec63700 1 -- 172.21.15.73:0/29481696 learned_addr learned my addr 172.21.15.73:0/29481696 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:27:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79e462700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd7900385c0 0x7fd7900398c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79d460700 1 -- 172.21.15.73:0/29481696 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2825377620 0 0) 0x7fd790035eb0 con 0x7fd7900c4a70 2023-11-30T23:27:51.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79d460700 1 -- 172.21.15.73:0/29481696 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7840035d0 con 0x7fd7900c4a70 2023-11-30T23:27:51.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79d460700 1 -- 172.21.15.73:0/29481696 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868793950 0 0) 0x7fd7900389a0 con 0x7fd79003a480 2023-11-30T23:27:51.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79d460700 1 -- 172.21.15.73:0/29481696 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd790035eb0 con 0x7fd79003a480 2023-11-30T23:27:51.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79e462700 1 -- 172.21.15.73:0/29481696 >> v1:172.21.15.156:6789/0 conn(0x7fd79003a480 legacy=0x7fd7900c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79d460700 1 -- 172.21.15.73:0/29481696 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 836475133 0 0) 0x7fd7840035d0 con 0x7fd7900c4a70 2023-11-30T23:27:51.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79e462700 1 -- 172.21.15.73:0/29481696 >> v1:172.21.15.73:6789/0 conn(0x7fd7900c4a70 legacy=0x7fd7900d4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79e462700 1 -- 172.21.15.73:0/29481696 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7900356b0 con 0x7fd7900385c0 2023-11-30T23:27:51.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79e462700 1 --2- 172.21.15.73:0/29481696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7900385c0 0x7fd7900398c0 secure :-1 s=READY pgs=4257 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009850 tx=0x7fd78c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34e1dba8dce70a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79d460700 1 -- 172.21.15.73:0/29481696 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd798072c00 con 0x7fd7900385c0 2023-11-30T23:27:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79d460700 1 -- 172.21.15.73:0/29481696 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c004030 con 0x7fd7900385c0 2023-11-30T23:27:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79d460700 1 -- 172.21.15.73:0/29481696 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0043e0 con 0x7fd7900385c0 2023-11-30T23:27:51.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79f464700 1 -- 172.21.15.73:0/29481696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7900385c0 msgr2=0x7fd7900398c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79f464700 1 --2- 172.21.15.73:0/29481696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7900385c0 0x7fd7900398c0 secure :-1 s=READY pgs=4257 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009850 tx=0x7fd78c009b60 comp rx=0 tx=0).stop 2023-11-30T23:27:51.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79f464700 1 -- 172.21.15.73:0/29481696 shutdown_connections 2023-11-30T23:27:51.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79f464700 1 --2- 172.21.15.73:0/29481696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7900385c0 0x7fd7900398c0 unknown :-1 s=CLOSED pgs=4257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79f464700 1 -- 172.21.15.73:0/29481696 >> 172.21.15.73:0/29481696 conn(0x7fd790008810 msgr2=0x7fd79003ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:51.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79f464700 1 -- 172.21.15.73:0/29481696 shutdown_connections 2023-11-30T23:27:51.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.586+0000 7fd79f464700 1 -- 172.21.15.73:0/29481696 wait complete. 2023-11-30T23:27:51.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79f464700 1 Processor -- start 2023-11-30T23:27:51.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79f464700 1 -- start start 2023-11-30T23:27:51.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79f464700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd7900385c0 0x7fd7900ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79f464700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd79003a480 0x7fd7900c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79f464700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7900c4a70 0x7fd790162c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79f464700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7900c77a0 con 0x7fd79003a480 2023-11-30T23:27:51.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79f464700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7900c7cd0 con 0x7fd7900c4a70 2023-11-30T23:27:51.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79f464700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7900c79f0 con 0x7fd7900385c0 2023-11-30T23:27:51.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79dc61700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd79003a480 0x7fd7900c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79dc61700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd79003a480 0x7fd7900c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32790/0 (socket says 172.21.15.73:32790) 2023-11-30T23:27:51.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79dc61700 1 -- 172.21.15.73:0/4066744291 learned_addr learned my addr 172.21.15.73:0/4066744291 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:51.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79e462700 1 --2- 172.21.15.73:0/4066744291 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd7900385c0 0x7fd7900ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79ec63700 1 --2- 172.21.15.73:0/4066744291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7900c4a70 0x7fd790162c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79dc61700 1 -- 172.21.15.73:0/4066744291 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd7900385c0 msgr2=0x7fd7900ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79dc61700 1 --2- 172.21.15.73:0/4066744291 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd7900385c0 0x7fd7900ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79dc61700 1 -- 172.21.15.73:0/4066744291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7900c4a70 msgr2=0x7fd790162c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79dc61700 1 --2- 172.21.15.73:0/4066744291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7900c4a70 0x7fd790162c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79dc61700 1 -- 172.21.15.73:0/4066744291 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c0094b0 con 0x7fd79003a480 2023-11-30T23:27:51.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79e462700 1 --2- 172.21.15.73:0/4066744291 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd7900385c0 0x7fd7900ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:27:51.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79dc61700 1 --2- 172.21.15.73:0/4066744291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd79003a480 0x7fd7900c6600 secure :-1 s=READY pgs=4258 cs=0 l=1 rev1=1 crypto rx=0x7fd79400c550 tx=0x7fd79400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:51.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd78affd700 1 -- 172.21.15.73:0/4066744291 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7940052d0 con 0x7fd79003a480 2023-11-30T23:27:51.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd78affd700 1 -- 172.21.15.73:0/4066744291 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd794005430 con 0x7fd79003a480 2023-11-30T23:27:51.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79f464700 1 -- 172.21.15.73:0/4066744291 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7900c60e0 con 0x7fd79003a480 2023-11-30T23:27:51.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd78affd700 1 -- 172.21.15.73:0/4066744291 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7940055a0 con 0x7fd79003a480 2023-11-30T23:27:51.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.590+0000 7fd79f464700 1 -- 172.21.15.73:0/4066744291 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7900c6b40 con 0x7fd79003a480 2023-11-30T23:27:51.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.594+0000 7fd78affd700 1 -- 172.21.15.73:0/4066744291 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd7940038e0 con 0x7fd79003a480 2023-11-30T23:27:51.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.594+0000 7fd79f464700 1 -- 172.21.15.73:0/4066744291 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7900c6320 con 0x7fd79003a480 2023-11-30T23:27:51.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.594+0000 7fd78affd700 1 --2- 172.21.15.73:0/4066744291 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd77c065b00 0x7fd77c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.594+0000 7fd79e462700 1 --2- 172.21.15.73:0/4066744291 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd77c065b00 0x7fd77c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.594+0000 7fd78affd700 1 -- 172.21.15.73:0/4066744291 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd7940825a0 con 0x7fd79003a480 2023-11-30T23:27:51.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.594+0000 7fd79e462700 1 --2- 172.21.15.73:0/4066744291 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd77c065b00 0x7fd77c067fc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0090b0 tx=0x7fd78c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:51.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.598+0000 7fd78affd700 1 -- 172.21.15.73:0/4066744291 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fd7900c6320 con 0x7fd79003a480 2023-11-30T23:27:51.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.778+0000 7fd79f464700 1 -- 172.21.15.73:0/4066744291 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fd79002bf70 con 0x7fd77c065b00 2023-11-30T23:27:51.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.778+0000 7fd78affd700 1 -- 172.21.15.73:0/4066744291 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd78c0045e0 con 0x7fd77c065b00 2023-11-30T23:27:51.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.778+0000 7fd79f464700 1 -- 172.21.15.73:0/4066744291 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd77c065b00 msgr2=0x7fd77c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.778+0000 7fd79f464700 1 --2- 172.21.15.73:0/4066744291 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd77c065b00 0x7fd77c067fc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0090b0 tx=0x7fd78c008030 comp rx=0 tx=0).stop 2023-11-30T23:27:51.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.778+0000 7fd79f464700 1 -- 172.21.15.73:0/4066744291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd79003a480 msgr2=0x7fd7900c6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.778+0000 7fd79f464700 1 --2- 172.21.15.73:0/4066744291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd79003a480 0x7fd7900c6600 secure :-1 s=READY pgs=4258 cs=0 l=1 rev1=1 crypto rx=0x7fd79400c550 tx=0x7fd79400c910 comp rx=0 tx=0).stop 2023-11-30T23:27:51.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.782+0000 7fd79f464700 1 -- 172.21.15.73:0/4066744291 shutdown_connections 2023-11-30T23:27:51.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.782+0000 7fd79f464700 1 --2- 172.21.15.73:0/4066744291 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd77c065b00 0x7fd77c067fc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.782+0000 7fd79f464700 1 --2- 172.21.15.73:0/4066744291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7900c4a70 0x7fd790162c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.782+0000 7fd79f464700 1 --2- 172.21.15.73:0/4066744291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd79003a480 0x7fd7900c6600 unknown :-1 s=CLOSED pgs=4258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.782+0000 7fd79f464700 1 --2- 172.21.15.73:0/4066744291 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd7900385c0 0x7fd7900ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.782+0000 7fd79f464700 1 -- 172.21.15.73:0/4066744291 >> 172.21.15.73:0/4066744291 conn(0x7fd790008810 msgr2=0x7fd7900bff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:51.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.782+0000 7fd79f464700 1 -- 172.21.15.73:0/4066744291 shutdown_connections 2023-11-30T23:27:51.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.782+0000 7fd79f464700 1 -- 172.21.15.73:0/4066744291 wait complete. 2023-11-30T23:27:51.783 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 7 to deep-scrub 2023-11-30T23:27:51.793 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T23:27:51.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.898+0000 7fd435b28700 1 Processor -- start 2023-11-30T23:27:51.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.898+0000 7fd435b28700 1 -- start start 2023-11-30T23:27:51.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.898+0000 7fd435b28700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd4300b1420 0x7fd430147970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.898+0000 7fd435b28700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd430147eb0 0x7fd43013e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.898+0000 7fd435b28700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43013ebe0 con 0x7fd43013e750 2023-11-30T23:27:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.898+0000 7fd435b28700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4300b40c0 con 0x7fd4300b1420 2023-11-30T23:27:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.898+0000 7fd435b28700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43006ee70 con 0x7fd430147eb0 2023-11-30T23:27:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.898+0000 7fd434b26700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd4300b1420 0x7fd430147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.898+0000 7fd435327700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd43013e750 0x7fd4300b24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48592/0 (socket says 172.21.15.73:48592) 2023-11-30T23:27:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.898+0000 7fd435327700 1 -- 172.21.15.73:0/200910658 learned_addr learned my addr 172.21.15.73:0/200910658 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:27:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.898+0000 7fd42ffff700 1 --2- 172.21.15.73:0/200910658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd430147eb0 0x7fd43013e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.898+0000 7fd42f7fe700 1 -- 172.21.15.73:0/200910658 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985101674 0 0) 0x7fd43013ebe0 con 0x7fd43013e750 2023-11-30T23:27:51.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.898+0000 7fd42f7fe700 1 -- 172.21.15.73:0/200910658 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4180035d0 con 0x7fd43013e750 2023-11-30T23:27:51.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.898+0000 7fd434b26700 1 -- 172.21.15.73:0/200910658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd430147eb0 msgr2=0x7fd43013e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:27:51.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.898+0000 7fd434b26700 1 --2- 172.21.15.73:0/200910658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd430147eb0 0x7fd43013e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.898+0000 7fd434b26700 1 -- 172.21.15.73:0/200910658 >> v1:172.21.15.73:6789/0 conn(0x7fd43013e750 legacy=0x7fd4300b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.898+0000 7fd434b26700 1 -- 172.21.15.73:0/200910658 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd430070050 con 0x7fd4300b1420 2023-11-30T23:27:51.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd434b26700 1 --2- 172.21.15.73:0/200910658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4300b1420 0x7fd430147970 secure :-1 s=READY pgs=4260 cs=0 l=1 rev1=1 crypto rx=0x7fd428009dc0 tx=0x7fd42800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45e8af564723f9c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:51.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd42f7fe700 1 -- 172.21.15.73:0/200910658 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42800e070 con 0x7fd4300b1420 2023-11-30T23:27:51.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd42f7fe700 1 -- 172.21.15.73:0/200910658 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42800bae0 con 0x7fd4300b1420 2023-11-30T23:27:51.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd42f7fe700 1 -- 172.21.15.73:0/200910658 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42800be90 con 0x7fd4300b1420 2023-11-30T23:27:51.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd435b28700 1 -- 172.21.15.73:0/200910658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4300b1420 msgr2=0x7fd430147970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd435b28700 1 --2- 172.21.15.73:0/200910658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4300b1420 0x7fd430147970 secure :-1 s=READY pgs=4260 cs=0 l=1 rev1=1 crypto rx=0x7fd428009dc0 tx=0x7fd42800b330 comp rx=0 tx=0).stop 2023-11-30T23:27:51.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd435b28700 1 -- 172.21.15.73:0/200910658 shutdown_connections 2023-11-30T23:27:51.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd435b28700 1 --2- 172.21.15.73:0/200910658 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd430147eb0 0x7fd43013e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd435b28700 1 --2- 172.21.15.73:0/200910658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4300b1420 0x7fd430147970 unknown :-1 s=CLOSED pgs=4260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd435b28700 1 -- 172.21.15.73:0/200910658 >> 172.21.15.73:0/200910658 conn(0x7fd4300b45a0 msgr2=0x7fd4300b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:51.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd435b28700 1 -- 172.21.15.73:0/200910658 shutdown_connections 2023-11-30T23:27:51.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd435b28700 1 -- 172.21.15.73:0/200910658 wait complete. 2023-11-30T23:27:51.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd435b28700 1 Processor -- start 2023-11-30T23:27:51.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd435b28700 1 -- start start 2023-11-30T23:27:51.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd435b28700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4300b1420 0x7fd4301de960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd435b28700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd43013e750 0x7fd430147070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd435b28700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd430147eb0 0x7fd4300ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd435b28700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd430072400 con 0x7fd4300b1420 2023-11-30T23:27:51.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd435b28700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300714b0 con 0x7fd430147eb0 2023-11-30T23:27:51.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.902+0000 7fd435b28700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300ad660 con 0x7fd43013e750 2023-11-30T23:27:51.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd434b26700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4300b1420 0x7fd4301de960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd434b26700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4300b1420 0x7fd4301de960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:32808/0 (socket says 172.21.15.73:32808) 2023-11-30T23:27:51.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd434b26700 1 -- 172.21.15.73:0/806612750 learned_addr learned my addr 172.21.15.73:0/806612750 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:27:51.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd42ffff700 1 --2- 172.21.15.73:0/806612750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd43013e750 0x7fd430147070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd435327700 1 --2- 172.21.15.73:0/806612750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd430147eb0 0x7fd4300ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd434b26700 1 -- 172.21.15.73:0/806612750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd43013e750 msgr2=0x7fd430147070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd434b26700 1 --2- 172.21.15.73:0/806612750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd43013e750 0x7fd430147070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd434b26700 1 -- 172.21.15.73:0/806612750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd430147eb0 msgr2=0x7fd4300ade60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:51.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd434b26700 1 --2- 172.21.15.73:0/806612750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd430147eb0 0x7fd4300ade60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:51.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd434b26700 1 -- 172.21.15.73:0/806612750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd428009a70 con 0x7fd4300b1420 2023-11-30T23:27:51.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd435327700 1 --2- 172.21.15.73:0/806612750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd430147eb0 0x7fd4300ade60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:27:51.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd434b26700 1 --2- 172.21.15.73:0/806612750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4300b1420 0x7fd4301de960 secure :-1 s=READY pgs=4261 cs=0 l=1 rev1=1 crypto rx=0x7fd428014040 tx=0x7fd428004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:51.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd42d7fa700 1 -- 172.21.15.73:0/806612750 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428004680 con 0x7fd4300b1420 2023-11-30T23:27:51.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd42d7fa700 1 -- 172.21.15.73:0/806612750 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd428020070 con 0x7fd4300b1420 2023-11-30T23:27:51.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd435b28700 1 -- 172.21.15.73:0/806612750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4300ad940 con 0x7fd4300b1420 2023-11-30T23:27:51.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd42d7fa700 1 -- 172.21.15.73:0/806612750 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428027480 con 0x7fd4300b1420 2023-11-30T23:27:51.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd435b28700 1 -- 172.21.15.73:0/806612750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4300710b0 con 0x7fd4300b1420 2023-11-30T23:27:51.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd435b28700 1 -- 172.21.15.73:0/806612750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43006f580 con 0x7fd4300b1420 2023-11-30T23:27:51.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.906+0000 7fd42d7fa700 1 -- 172.21.15.73:0/806612750 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd428012430 con 0x7fd4300b1420 2023-11-30T23:27:51.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.910+0000 7fd42d7fa700 1 --2- 172.21.15.73:0/806612750 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd41c065b00 0x7fd41c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:27:51.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.910+0000 7fd42d7fa700 1 -- 172.21.15.73:0/806612750 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd428022070 con 0x7fd4300b1420 2023-11-30T23:27:51.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.910+0000 7fd42ffff700 1 --2- 172.21.15.73:0/806612750 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd41c065b00 0x7fd41c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:27:51.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.910+0000 7fd42ffff700 1 --2- 172.21.15.73:0/806612750 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd41c065b00 0x7fd41c067fc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd4301dc520 tx=0x7fd424009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:27:51.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:51.914+0000 7fd42d7fa700 1 -- 172.21.15.73:0/806612750 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fd428052bf0 con 0x7fd4300b1420 2023-11-30T23:27:52.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:52.082+0000 7fd435b28700 1 -- 172.21.15.73:0/806612750 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd430071620 con 0x7fd41c065b00 2023-11-30T23:27:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:52.098+0000 7fd42d7fa700 1 -- 172.21.15.73:0/806612750 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290737 (secure 0 0 0) 0x7fd430071620 con 0x7fd41c065b00 2023-11-30T23:27:52.102 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:27:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:52.102+0000 7fd435b28700 1 -- 172.21.15.73:0/806612750 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd41c065b00 msgr2=0x7fd41c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:52.102+0000 7fd435b28700 1 --2- 172.21.15.73:0/806612750 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd41c065b00 0x7fd41c067fc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd4301dc520 tx=0x7fd424009240 comp rx=0 tx=0).stop 2023-11-30T23:27:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:52.102+0000 7fd435b28700 1 -- 172.21.15.73:0/806612750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4300b1420 msgr2=0x7fd4301de960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:27:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:52.102+0000 7fd435b28700 1 --2- 172.21.15.73:0/806612750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4300b1420 0x7fd4301de960 secure :-1 s=READY pgs=4261 cs=0 l=1 rev1=1 crypto rx=0x7fd428014040 tx=0x7fd428004af0 comp rx=0 tx=0).stop 2023-11-30T23:27:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:52.102+0000 7fd435b28700 1 -- 172.21.15.73:0/806612750 shutdown_connections 2023-11-30T23:27:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:52.102+0000 7fd435b28700 1 --2- 172.21.15.73:0/806612750 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fd41c065b00 0x7fd41c067fc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:52.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:52.102+0000 7fd435b28700 1 --2- 172.21.15.73:0/806612750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd430147eb0 0x7fd4300ade60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:52.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:52.102+0000 7fd435b28700 1 --2- 172.21.15.73:0/806612750 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fd43013e750 0x7fd430147070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:52.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:52.102+0000 7fd435b28700 1 --2- 172.21.15.73:0/806612750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4300b1420 0x7fd4301de960 unknown :-1 s=CLOSED pgs=4261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:27:52.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:52.102+0000 7fd435b28700 1 -- 172.21.15.73:0/806612750 >> 172.21.15.73:0/806612750 conn(0x7fd4300b45a0 msgr2=0x7fd4300b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:27:52.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:52.102+0000 7fd435b28700 1 -- 172.21.15.73:0/806612750 shutdown_connections 2023-11-30T23:27:52.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:27:52.102+0000 7fd435b28700 1 -- 172.21.15.73:0/806612750 wait complete. 2023-11-30T23:27:52.107 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-11-30T23:27:52.121 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":501,"stamp":"2023-11-30T23:27:50.672497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":275997093,"num_objects":743,"num_object_clones":28,"num_object_copies":1486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":743,"num_whiteouts":15,"num_read":1184,"num_read_kb":3541,"num_write":155912,"num_write_kb":668826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":540,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307609,"ondisk_log_size":307609,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2754012,"kb_used_data":543580,"kb_used_omap":0,"kb_used_meta":2210368,"kb_avail":752220708,"statfs":{"total":773094113280,"available":770274004992,"internally_reserved":0,"allocated":556625920,"data_stored":553990093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2263416832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1405815,"num_objects":6,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":3,"num_read":5,"num_read_kb":6,"num_write":92,"num_write_kb":1429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003033"},"pg_stats":[{"pgid":"3.3f","version":"48'3481","reported_seq":2877,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.915759+0000","last_change":"2023-11-30T23:27:40.777020+0000","last_active":"2023-11-30T23:27:48.915759+0000","last_peered":"2023-11-30T23:27:48.915759+0000","last_clean":"2023-11-30T23:27:48.915759+0000","last_became_active":"2023-11-30T23:12:47.512980+0000","last_became_peered":"2023-11-30T23:12:47.512980+0000","last_unstale":"2023-11-30T23:27:48.915759+0000","last_undegraded":"2023-11-30T23:27:48.915759+0000","last_fullsized":"2023-11-30T23:27:48.915759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:18:44.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0061607720000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1134,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"48'3347","reported_seq":2776,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.885177+0000","last_change":"2023-11-30T23:27:40.483369+0000","last_active":"2023-11-30T23:27:48.885177+0000","last_peered":"2023-11-30T23:27:48.885177+0000","last_clean":"2023-11-30T23:27:48.885177+0000","last_became_active":"2023-11-30T23:12:47.508771+0000","last_became_peered":"2023-11-30T23:12:47.508771+0000","last_unstale":"2023-11-30T23:27:48.885177+0000","last_undegraded":"2023-11-30T23:27:48.885177+0000","last_fullsized":"2023-11-30T23:27:48.885177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3347,"log_dups_size":0,"ondisk_log_size":3347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055178039999999998,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1093,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"48'3513","reported_seq":2916,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.402558+0000","last_change":"2023-11-30T23:27:40.561105+0000","last_active":"2023-11-30T23:27:48.402558+0000","last_peered":"2023-11-30T23:27:48.402558+0000","last_clean":"2023-11-30T23:27:48.402558+0000","last_became_active":"2023-11-30T23:12:47.507829+0000","last_became_peered":"2023-11-30T23:12:47.507829+0000","last_unstale":"2023-11-30T23:27:48.402558+0000","last_undegraded":"2023-11-30T23:27:48.402558+0000","last_fullsized":"2023-11-30T23:27:48.402558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3513,"log_dups_size":0,"ondisk_log_size":3513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031269901000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"48'3599","reported_seq":2963,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.069502+0000","last_change":"2023-11-30T23:27:40.523535+0000","last_active":"2023-11-30T23:27:49.069502+0000","last_peered":"2023-11-30T23:27:49.069502+0000","last_clean":"2023-11-30T23:27:49.069502+0000","last_became_active":"2023-11-30T23:12:47.522208+0000","last_became_peered":"2023-11-30T23:12:47.522208+0000","last_unstale":"2023-11-30T23:27:49.069502+0000","last_undegraded":"2023-11-30T23:27:49.069502+0000","last_fullsized":"2023-11-30T23:27:49.069502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3599,"log_dups_size":0,"ondisk_log_size":3599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020703408,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"48'3346","reported_seq":2727,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.884673+0000","last_change":"2023-11-30T23:27:40.475732+0000","last_active":"2023-11-30T23:27:48.884673+0000","last_peered":"2023-11-30T23:27:48.884673+0000","last_clean":"2023-11-30T23:27:48.884673+0000","last_became_active":"2023-11-30T23:13:30.302763+0000","last_became_peered":"2023-11-30T23:13:30.302763+0000","last_unstale":"2023-11-30T23:27:48.884673+0000","last_undegraded":"2023-11-30T23:27:48.884673+0000","last_fullsized":"2023-11-30T23:27:48.884673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3346,"log_dups_size":0,"ondisk_log_size":3346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047963988999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"48'3402","reported_seq":2818,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.069241+0000","last_change":"2023-11-30T23:27:40.521728+0000","last_active":"2023-11-30T23:27:49.069241+0000","last_peered":"2023-11-30T23:27:49.069241+0000","last_clean":"2023-11-30T23:27:49.069241+0000","last_became_active":"2023-11-30T23:12:47.513491+0000","last_became_peered":"2023-11-30T23:12:47.513491+0000","last_unstale":"2023-11-30T23:27:49.069241+0000","last_undegraded":"2023-11-30T23:27:49.069241+0000","last_fullsized":"2023-11-30T23:27:49.069241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:18:44.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019296939999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"48'3534","reported_seq":2943,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.913883+0000","last_change":"2023-11-30T23:27:40.773622+0000","last_active":"2023-11-30T23:27:48.913883+0000","last_peered":"2023-11-30T23:27:48.913883+0000","last_clean":"2023-11-30T23:27:48.913883+0000","last_became_active":"2023-11-30T23:12:47.507747+0000","last_became_peered":"2023-11-30T23:12:47.507747+0000","last_unstale":"2023-11-30T23:27:48.913883+0000","last_undegraded":"2023-11-30T23:27:48.913883+0000","last_fullsized":"2023-11-30T23:27:48.913883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3534,"log_dups_size":0,"ondisk_log_size":3534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:27.789422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0077627249999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"48'3400","reported_seq":2787,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.540573+0000","last_change":"2023-11-30T23:27:40.523065+0000","last_active":"2023-11-30T23:27:48.540573+0000","last_peered":"2023-11-30T23:27:48.540573+0000","last_clean":"2023-11-30T23:27:48.540573+0000","last_became_active":"2023-11-30T23:12:47.523430+0000","last_became_peered":"2023-11-30T23:12:47.523430+0000","last_unstale":"2023-11-30T23:27:48.540573+0000","last_undegraded":"2023-11-30T23:27:48.540573+0000","last_fullsized":"2023-11-30T23:27:48.540573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3400,"log_dups_size":0,"ondisk_log_size":3400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:26:33.640383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023650336000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"48'3724","reported_seq":3061,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.915896+0000","last_change":"2023-11-30T23:27:40.778901+0000","last_active":"2023-11-30T23:27:48.915896+0000","last_peered":"2023-11-30T23:27:48.915896+0000","last_clean":"2023-11-30T23:27:48.915896+0000","last_became_active":"2023-11-30T23:12:47.521393+0000","last_became_peered":"2023-11-30T23:12:47.521393+0000","last_unstale":"2023-11-30T23:27:48.915896+0000","last_undegraded":"2023-11-30T23:27:48.915896+0000","last_fullsized":"2023-11-30T23:27:48.915896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3724,"log_dups_size":0,"ondisk_log_size":3724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:23:17.254251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078674580000000008,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1228,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"48'3647","reported_seq":3115,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.410399+0000","last_change":"2023-11-30T23:27:40.786256+0000","last_active":"2023-11-30T23:27:48.410399+0000","last_peered":"2023-11-30T23:27:48.410399+0000","last_clean":"2023-11-30T23:27:48.410399+0000","last_became_active":"2023-11-30T23:12:47.522618+0000","last_became_peered":"2023-11-30T23:12:47.522618+0000","last_unstale":"2023-11-30T23:27:48.410399+0000","last_undegraded":"2023-11-30T23:27:48.410399+0000","last_fullsized":"2023-11-30T23:27:48.410399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3647,"log_dups_size":0,"ondisk_log_size":3647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016421781999999999,"stat_sum":{"num_bytes":4110,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":1106,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"48'3243","reported_seq":2732,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.409819+0000","last_change":"2023-11-30T23:27:40.786282+0000","last_active":"2023-11-30T23:27:48.409819+0000","last_peered":"2023-11-30T23:27:48.409819+0000","last_clean":"2023-11-30T23:27:48.409819+0000","last_became_active":"2023-11-30T23:13:30.304972+0000","last_became_peered":"2023-11-30T23:13:30.304972+0000","last_unstale":"2023-11-30T23:27:48.409819+0000","last_undegraded":"2023-11-30T23:27:48.409819+0000","last_fullsized":"2023-11-30T23:27:48.409819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3243,"log_dups_size":0,"ondisk_log_size":3243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:28:50.030806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016353854000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"48'3479","reported_seq":2855,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.831486+0000","last_change":"2023-11-30T23:27:40.778402+0000","last_active":"2023-11-30T23:27:48.831486+0000","last_peered":"2023-11-30T23:27:48.831486+0000","last_clean":"2023-11-30T23:27:48.831486+0000","last_became_active":"2023-11-30T23:12:47.513401+0000","last_became_peered":"2023-11-30T23:12:47.513401+0000","last_unstale":"2023-11-30T23:27:48.831486+0000","last_undegraded":"2023-11-30T23:27:48.831486+0000","last_fullsized":"2023-11-30T23:27:48.831486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3479,"log_dups_size":0,"ondisk_log_size":3479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:22.086661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011359997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"48'3375","reported_seq":2826,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.541635+0000","last_change":"2023-11-30T23:27:40.524064+0000","last_active":"2023-11-30T23:27:48.541635+0000","last_peered":"2023-11-30T23:27:48.541635+0000","last_clean":"2023-11-30T23:27:48.541635+0000","last_became_active":"2023-11-30T23:12:47.513714+0000","last_became_peered":"2023-11-30T23:12:47.513714+0000","last_unstale":"2023-11-30T23:27:48.541635+0000","last_undegraded":"2023-11-30T23:27:48.541635+0000","last_fullsized":"2023-11-30T23:27:48.541635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3375,"log_dups_size":0,"ondisk_log_size":3375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:20:31.102899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024370613999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1066,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"48'3643","reported_seq":3003,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.402376+0000","last_change":"2023-11-30T23:27:40.553372+0000","last_active":"2023-11-30T23:27:48.402376+0000","last_peered":"2023-11-30T23:27:48.402376+0000","last_clean":"2023-11-30T23:27:48.402376+0000","last_became_active":"2023-11-30T23:12:47.506967+0000","last_became_peered":"2023-11-30T23:12:47.506967+0000","last_unstale":"2023-11-30T23:27:48.402376+0000","last_undegraded":"2023-11-30T23:27:48.402376+0000","last_fullsized":"2023-11-30T23:27:48.402376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3643,"log_dups_size":0,"ondisk_log_size":3643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025050587999999999,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"48'3636","reported_seq":2969,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.884503+0000","last_change":"2023-11-30T23:27:40.490577+0000","last_active":"2023-11-30T23:27:48.884503+0000","last_peered":"2023-11-30T23:27:48.884503+0000","last_clean":"2023-11-30T23:27:48.884503+0000","last_became_active":"2023-11-30T23:12:47.513018+0000","last_became_peered":"2023-11-30T23:12:47.513018+0000","last_unstale":"2023-11-30T23:27:48.884503+0000","last_undegraded":"2023-11-30T23:27:48.884503+0000","last_fullsized":"2023-11-30T23:27:48.884503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3636,"log_dups_size":0,"ondisk_log_size":3636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059143527000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1251,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"48'3670","reported_seq":3019,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.068554+0000","last_change":"2023-11-30T23:27:40.518027+0000","last_active":"2023-11-30T23:27:49.068554+0000","last_peered":"2023-11-30T23:27:49.068554+0000","last_clean":"2023-11-30T23:27:49.068554+0000","last_became_active":"2023-11-30T23:12:47.520518+0000","last_became_peered":"2023-11-30T23:12:47.520518+0000","last_unstale":"2023-11-30T23:27:49.068554+0000","last_undegraded":"2023-11-30T23:27:49.068554+0000","last_fullsized":"2023-11-30T23:27:49.068554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3670,"log_dups_size":0,"ondisk_log_size":3670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:27.789422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016206259000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"48'3892","reported_seq":3188,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.071274+0000","last_change":"2023-11-30T23:27:40.522656+0000","last_active":"2023-11-30T23:27:49.071274+0000","last_peered":"2023-11-30T23:27:49.071274+0000","last_clean":"2023-11-30T23:27:49.071274+0000","last_became_active":"2023-11-30T23:12:47.516382+0000","last_became_peered":"2023-11-30T23:12:47.516382+0000","last_unstale":"2023-11-30T23:27:49.071274+0000","last_undegraded":"2023-11-30T23:27:49.071274+0000","last_fullsized":"2023-11-30T23:27:49.071274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:54:46.925262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020102808999999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"48'3336","reported_seq":2816,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.404528+0000","last_change":"2023-11-30T23:27:40.437357+0000","last_active":"2023-11-30T23:27:48.404528+0000","last_peered":"2023-11-30T23:27:48.404528+0000","last_clean":"2023-11-30T23:27:48.404528+0000","last_became_active":"2023-11-30T23:12:47.509340+0000","last_became_peered":"2023-11-30T23:12:47.509340+0000","last_unstale":"2023-11-30T23:27:48.404528+0000","last_undegraded":"2023-11-30T23:27:48.404528+0000","last_fullsized":"2023-11-30T23:27:48.404528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3336,"log_dups_size":0,"ondisk_log_size":3336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:29.167074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0085862969999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1061,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"48'3630","reported_seq":3001,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.915284+0000","last_change":"2023-11-30T23:27:40.776746+0000","last_active":"2023-11-30T23:27:48.915284+0000","last_peered":"2023-11-30T23:27:48.915284+0000","last_clean":"2023-11-30T23:27:48.915284+0000","last_became_active":"2023-11-30T23:12:47.506733+0000","last_became_peered":"2023-11-30T23:12:47.506733+0000","last_unstale":"2023-11-30T23:27:48.915284+0000","last_undegraded":"2023-11-30T23:27:48.915284+0000","last_fullsized":"2023-11-30T23:27:48.915284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3630,"log_dups_size":0,"ondisk_log_size":3630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010198370999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"48'3600","reported_seq":2960,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.409801+0000","last_change":"2023-11-30T23:27:40.784471+0000","last_active":"2023-11-30T23:27:48.409801+0000","last_peered":"2023-11-30T23:27:48.409801+0000","last_clean":"2023-11-30T23:27:48.409801+0000","last_became_active":"2023-11-30T23:12:47.518819+0000","last_became_peered":"2023-11-30T23:12:47.518819+0000","last_unstale":"2023-11-30T23:27:48.409801+0000","last_undegraded":"2023-11-30T23:27:48.409801+0000","last_fullsized":"2023-11-30T23:27:48.409801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014700833,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"48'3683","reported_seq":3066,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.402410+0000","last_change":"2023-11-30T23:27:40.567066+0000","last_active":"2023-11-30T23:27:48.402410+0000","last_peered":"2023-11-30T23:27:48.402410+0000","last_clean":"2023-11-30T23:27:48.402410+0000","last_became_active":"2023-11-30T23:12:47.514223+0000","last_became_peered":"2023-11-30T23:12:47.514223+0000","last_unstale":"2023-11-30T23:27:48.402410+0000","last_undegraded":"2023-11-30T23:27:48.402410+0000","last_fullsized":"2023-11-30T23:27:48.402410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3683,"log_dups_size":0,"ondisk_log_size":3683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036942162000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"48'4029","reported_seq":3324,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.069228+0000","last_change":"2023-11-30T23:27:40.526135+0000","last_active":"2023-11-30T23:27:49.069228+0000","last_peered":"2023-11-30T23:27:49.069228+0000","last_clean":"2023-11-30T23:27:49.069228+0000","last_became_active":"2023-11-30T23:12:47.520228+0000","last_became_peered":"2023-11-30T23:12:47.520228+0000","last_unstale":"2023-11-30T23:27:49.069228+0000","last_undegraded":"2023-11-30T23:27:49.069228+0000","last_fullsized":"2023-11-30T23:27:49.069228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":4029,"log_dups_size":0,"ondisk_log_size":4029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:26:06.870586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023056817,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1244,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"48'3705","reported_seq":3081,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.540604+0000","last_change":"2023-11-30T23:27:40.526288+0000","last_active":"2023-11-30T23:27:48.540604+0000","last_peered":"2023-11-30T23:27:48.540604+0000","last_clean":"2023-11-30T23:27:48.540604+0000","last_became_active":"2023-11-30T23:12:47.515247+0000","last_became_peered":"2023-11-30T23:12:47.515247+0000","last_unstale":"2023-11-30T23:27:48.540604+0000","last_undegraded":"2023-11-30T23:27:48.540604+0000","last_fullsized":"2023-11-30T23:27:48.540604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3705,"log_dups_size":0,"ondisk_log_size":3705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026511877,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"48'3602","reported_seq":2955,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.068569+0000","last_change":"2023-11-30T23:27:40.526691+0000","last_active":"2023-11-30T23:27:49.068569+0000","last_peered":"2023-11-30T23:27:49.068569+0000","last_clean":"2023-11-30T23:27:49.068569+0000","last_became_active":"2023-11-30T23:12:47.511097+0000","last_became_peered":"2023-11-30T23:12:47.511097+0000","last_unstale":"2023-11-30T23:27:49.068569+0000","last_undegraded":"2023-11-30T23:27:49.068569+0000","last_fullsized":"2023-11-30T23:27:49.068569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023833039,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"48'3199","reported_seq":2628,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.543014+0000","last_change":"2023-11-30T23:27:40.532323+0000","last_active":"2023-11-30T23:27:48.543014+0000","last_peered":"2023-11-30T23:27:48.543014+0000","last_clean":"2023-11-30T23:27:48.543014+0000","last_became_active":"2023-11-30T23:12:47.510404+0000","last_became_peered":"2023-11-30T23:12:47.510404+0000","last_unstale":"2023-11-30T23:27:48.543014+0000","last_undegraded":"2023-11-30T23:27:48.543014+0000","last_fullsized":"2023-11-30T23:27:48.543014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3199,"log_dups_size":0,"ondisk_log_size":3199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:51:07.547718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031984205000000002,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"48'3855","reported_seq":3187,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.410128+0000","last_change":"2023-11-30T23:27:40.788046+0000","last_active":"2023-11-30T23:27:48.410128+0000","last_peered":"2023-11-30T23:27:48.410128+0000","last_clean":"2023-11-30T23:27:48.410128+0000","last_became_active":"2023-11-30T23:12:47.516539+0000","last_became_peered":"2023-11-30T23:12:47.516539+0000","last_unstale":"2023-11-30T23:27:48.410128+0000","last_undegraded":"2023-11-30T23:27:48.410128+0000","last_fullsized":"2023-11-30T23:27:48.410128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3855,"log_dups_size":0,"ondisk_log_size":3855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018080019999999999,"stat_sum":{"num_bytes":4105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"48'3361","reported_seq":2776,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.885066+0000","last_change":"2023-11-30T23:27:40.486640+0000","last_active":"2023-11-30T23:27:48.885066+0000","last_peered":"2023-11-30T23:27:48.885066+0000","last_clean":"2023-11-30T23:27:48.885066+0000","last_became_active":"2023-11-30T23:12:47.506284+0000","last_became_peered":"2023-11-30T23:12:47.506284+0000","last_unstale":"2023-11-30T23:27:48.885066+0000","last_undegraded":"2023-11-30T23:27:48.885066+0000","last_fullsized":"2023-11-30T23:27:48.885066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3361,"log_dups_size":0,"ondisk_log_size":3361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058342590999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"48'3356","reported_seq":2747,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.541993+0000","last_change":"2023-11-30T23:27:40.535487+0000","last_active":"2023-11-30T23:27:48.541993+0000","last_peered":"2023-11-30T23:27:48.541993+0000","last_clean":"2023-11-30T23:27:48.541993+0000","last_became_active":"2023-11-30T23:12:47.511800+0000","last_became_peered":"2023-11-30T23:12:47.511800+0000","last_unstale":"2023-11-30T23:27:48.541993+0000","last_undegraded":"2023-11-30T23:27:48.541993+0000","last_fullsized":"2023-11-30T23:27:48.541993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3356,"log_dups_size":0,"ondisk_log_size":3356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034899355,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1130,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"48'3593","reported_seq":3003,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.402628+0000","last_change":"2023-11-30T23:27:40.562740+0000","last_active":"2023-11-30T23:27:48.402628+0000","last_peered":"2023-11-30T23:27:48.402628+0000","last_clean":"2023-11-30T23:27:48.402628+0000","last_became_active":"2023-11-30T23:12:47.512978+0000","last_became_peered":"2023-11-30T23:12:47.512978+0000","last_unstale":"2023-11-30T23:27:48.402628+0000","last_undegraded":"2023-11-30T23:27:48.402628+0000","last_fullsized":"2023-11-30T23:27:48.402628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3593,"log_dups_size":0,"ondisk_log_size":3593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032442869999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1122,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"48'3350","reported_seq":2780,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.069581+0000","last_change":"2023-11-30T23:27:40.524098+0000","last_active":"2023-11-30T23:27:49.069581+0000","last_peered":"2023-11-30T23:27:49.069581+0000","last_clean":"2023-11-30T23:27:49.069581+0000","last_became_active":"2023-11-30T23:12:47.511699+0000","last_became_peered":"2023-11-30T23:12:47.511699+0000","last_unstale":"2023-11-30T23:27:49.069581+0000","last_undegraded":"2023-11-30T23:27:49.069581+0000","last_fullsized":"2023-11-30T23:27:49.069581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3350,"log_dups_size":0,"ondisk_log_size":3350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021133078,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"48'4043","reported_seq":3294,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.404032+0000","last_change":"2023-11-30T23:27:40.435514+0000","last_active":"2023-11-30T23:27:48.404032+0000","last_peered":"2023-11-30T23:27:48.404032+0000","last_clean":"2023-11-30T23:27:48.404032+0000","last_became_active":"2023-11-30T23:12:47.521604+0000","last_became_peered":"2023-11-30T23:12:47.521604+0000","last_unstale":"2023-11-30T23:27:48.404032+0000","last_undegraded":"2023-11-30T23:27:48.404032+0000","last_fullsized":"2023-11-30T23:27:48.404032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":4043,"log_dups_size":0,"ondisk_log_size":4043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:02.220181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081020610000000007,"stat_sum":{"num_bytes":4121,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1336,"num_write_kb":721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"48'3908","reported_seq":3231,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.409584+0000","last_change":"2023-11-30T23:27:40.784516+0000","last_active":"2023-11-30T23:27:48.409584+0000","last_peered":"2023-11-30T23:27:48.409584+0000","last_clean":"2023-11-30T23:27:48.409584+0000","last_became_active":"2023-11-30T23:12:47.517283+0000","last_became_peered":"2023-11-30T23:12:47.517283+0000","last_unstale":"2023-11-30T23:27:48.409584+0000","last_undegraded":"2023-11-30T23:27:48.409584+0000","last_fullsized":"2023-11-30T23:27:48.409584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3908,"log_dups_size":0,"ondisk_log_size":3908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016665117,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"48'3480","reported_seq":2879,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.830665+0000","last_change":"2023-11-30T23:27:40.776963+0000","last_active":"2023-11-30T23:27:48.830665+0000","last_peered":"2023-11-30T23:27:48.830665+0000","last_clean":"2023-11-30T23:27:48.830665+0000","last_became_active":"2023-11-30T23:12:47.508725+0000","last_became_peered":"2023-11-30T23:12:47.508725+0000","last_unstale":"2023-11-30T23:27:48.830665+0000","last_undegraded":"2023-11-30T23:27:48.830665+0000","last_fullsized":"2023-11-30T23:27:48.830665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3480,"log_dups_size":0,"ondisk_log_size":3480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:54.893320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010267352,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1134,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"43'3981","reported_seq":4027,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.542074+0000","last_change":"2023-11-30T23:12:47.139071+0000","last_active":"2023-11-30T23:27:48.542074+0000","last_peered":"2023-11-30T23:27:48.542074+0000","last_clean":"2023-11-30T23:27:48.542074+0000","last_became_active":"2023-11-30T23:12:47.138768+0000","last_became_peered":"2023-11-30T23:12:47.138768+0000","last_unstale":"2023-11-30T23:27:48.542074+0000","last_undegraded":"2023-11-30T23:27:48.542074+0000","last_fullsized":"2023-11-30T23:27:48.542074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3981,"log_dups_size":0,"ondisk_log_size":3981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":4054,"num_write_kb":19067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"48'3595","reported_seq":2991,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.402823+0000","last_change":"2023-11-30T23:27:40.568024+0000","last_active":"2023-11-30T23:27:48.402823+0000","last_peered":"2023-11-30T23:27:48.402823+0000","last_clean":"2023-11-30T23:27:48.402823+0000","last_became_active":"2023-11-30T23:12:47.516214+0000","last_became_peered":"2023-11-30T23:12:47.516214+0000","last_unstale":"2023-11-30T23:27:48.402823+0000","last_undegraded":"2023-11-30T23:27:48.402823+0000","last_fullsized":"2023-11-30T23:27:48.402823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037604525,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"48'4547","reported_seq":4593,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.409875+0000","last_change":"2023-11-30T23:12:47.130416+0000","last_active":"2023-11-30T23:27:48.409875+0000","last_peered":"2023-11-30T23:27:48.409875+0000","last_clean":"2023-11-30T23:27:48.409875+0000","last_became_active":"2023-11-30T23:12:47.129771+0000","last_became_peered":"2023-11-30T23:12:47.129771+0000","last_unstale":"2023-11-30T23:27:48.409875+0000","last_undegraded":"2023-11-30T23:27:48.409875+0000","last_fullsized":"2023-11-30T23:27:48.409875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4547,"log_dups_size":0,"ondisk_log_size":4547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7867003,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":4621,"num_write_kb":33841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"41'851","reported_seq":897,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.501169+0000","last_change":"2023-11-30T23:12:47.133733+0000","last_active":"2023-11-30T23:27:40.501169+0000","last_peered":"2023-11-30T23:27:40.501169+0000","last_clean":"2023-11-30T23:27:40.501169+0000","last_became_active":"2023-11-30T23:12:47.133440+0000","last_became_peered":"2023-11-30T23:12:47.133440+0000","last_unstale":"2023-11-30T23:27:40.501169+0000","last_undegraded":"2023-11-30T23:27:40.501169+0000","last_fullsized":"2023-11-30T23:27:40.501169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:48.913175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":928,"num_write_kb":12986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"48'3961","reported_seq":3215,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.540524+0000","last_change":"2023-11-30T23:27:40.521787+0000","last_active":"2023-11-30T23:27:48.540524+0000","last_peered":"2023-11-30T23:27:48.540524+0000","last_clean":"2023-11-30T23:27:48.540524+0000","last_became_active":"2023-11-30T23:12:47.507617+0000","last_became_peered":"2023-11-30T23:12:47.507617+0000","last_unstale":"2023-11-30T23:27:48.540524+0000","last_undegraded":"2023-11-30T23:27:48.540524+0000","last_fullsized":"2023-11-30T23:27:48.540524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3961,"log_dups_size":0,"ondisk_log_size":3961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:08:47.117163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022313091,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1298,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"42'3803","reported_seq":3849,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.502250+0000","last_change":"2023-11-30T23:12:47.132638+0000","last_active":"2023-11-30T23:27:40.502250+0000","last_peered":"2023-11-30T23:27:40.502250+0000","last_clean":"2023-11-30T23:27:40.502250+0000","last_became_active":"2023-11-30T23:12:47.132351+0000","last_became_peered":"2023-11-30T23:12:47.132351+0000","last_unstale":"2023-11-30T23:27:40.502250+0000","last_undegraded":"2023-11-30T23:27:40.502250+0000","last_fullsized":"2023-11-30T23:27:40.502250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3803,"log_dups_size":0,"ondisk_log_size":3803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":3859,"num_write_kb":38490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"48'3665","reported_seq":3065,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.884979+0000","last_change":"2023-11-30T23:27:40.479741+0000","last_active":"2023-11-30T23:27:48.884979+0000","last_peered":"2023-11-30T23:27:48.884979+0000","last_clean":"2023-11-30T23:27:48.884979+0000","last_became_active":"2023-11-30T23:12:47.506082+0000","last_became_peered":"2023-11-30T23:12:47.506082+0000","last_unstale":"2023-11-30T23:27:48.884979+0000","last_undegraded":"2023-11-30T23:27:48.884979+0000","last_fullsized":"2023-11-30T23:27:48.884979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052118631999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"43'1096","reported_seq":1142,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.770111+0000","last_change":"2023-11-30T23:12:47.139722+0000","last_active":"2023-11-30T23:27:40.770111+0000","last_peered":"2023-11-30T23:27:40.770111+0000","last_clean":"2023-11-30T23:27:40.770111+0000","last_became_active":"2023-11-30T23:12:47.139400+0000","last_became_peered":"2023-11-30T23:12:47.139400+0000","last_unstale":"2023-11-30T23:27:40.770111+0000","last_undegraded":"2023-11-30T23:27:40.770111+0000","last_fullsized":"2023-11-30T23:27:40.770111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1096,"log_dups_size":0,"ondisk_log_size":1096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":1152,"num_write_kb":13161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"48'3679","reported_seq":3045,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.404497+0000","last_change":"2023-11-30T23:27:40.435297+0000","last_active":"2023-11-30T23:27:48.404497+0000","last_peered":"2023-11-30T23:27:48.404497+0000","last_clean":"2023-11-30T23:27:48.404497+0000","last_became_active":"2023-11-30T23:13:30.596915+0000","last_became_peered":"2023-11-30T23:13:30.596915+0000","last_unstale":"2023-11-30T23:27:48.404497+0000","last_undegraded":"2023-11-30T23:27:48.404497+0000","last_fullsized":"2023-11-30T23:27:48.404497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3679,"log_dups_size":0,"ondisk_log_size":3679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:51:12.828715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066900809999999996,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"48'1872","reported_seq":1918,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.566616+0000","last_change":"2023-11-30T23:12:47.139328+0000","last_active":"2023-11-30T23:27:41.566616+0000","last_peered":"2023-11-30T23:27:41.566616+0000","last_clean":"2023-11-30T23:27:41.566616+0000","last_became_active":"2023-11-30T23:12:47.139047+0000","last_became_peered":"2023-11-30T23:12:47.139047+0000","last_unstale":"2023-11-30T23:27:41.566616+0000","last_undegraded":"2023-11-30T23:27:41.566616+0000","last_fullsized":"2023-11-30T23:27:41.566616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1872,"log_dups_size":0,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":1932,"num_write_kb":25642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"48'3570","reported_seq":2954,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.403572+0000","last_change":"2023-11-30T23:27:40.558523+0000","last_active":"2023-11-30T23:27:48.403572+0000","last_peered":"2023-11-30T23:27:48.403572+0000","last_clean":"2023-11-30T23:27:48.403572+0000","last_became_active":"2023-11-30T23:12:47.522711+0000","last_became_peered":"2023-11-30T23:12:47.522711+0000","last_unstale":"2023-11-30T23:27:48.403572+0000","last_undegraded":"2023-11-30T23:27:48.403572+0000","last_fullsized":"2023-11-30T23:27:48.403572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.028725985999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"48'3057","reported_seq":3104,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.884601+0000","last_change":"2023-11-30T23:12:47.140794+0000","last_active":"2023-11-30T23:27:48.884601+0000","last_peered":"2023-11-30T23:27:48.884601+0000","last_clean":"2023-11-30T23:27:48.884601+0000","last_became_active":"2023-11-30T23:12:47.140531+0000","last_became_peered":"2023-11-30T23:12:47.140531+0000","last_unstale":"2023-11-30T23:27:48.884601+0000","last_undegraded":"2023-11-30T23:27:48.884601+0000","last_fullsized":"2023-11-30T23:27:48.884601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3057,"log_dups_size":0,"ondisk_log_size":3057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":3128,"num_write_kb":22065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"48'3770","reported_seq":3132,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.831745+0000","last_change":"2023-11-30T23:27:40.777802+0000","last_active":"2023-11-30T23:27:48.831745+0000","last_peered":"2023-11-30T23:27:48.831745+0000","last_clean":"2023-11-30T23:27:48.831745+0000","last_became_active":"2023-11-30T23:12:47.513983+0000","last_became_peered":"2023-11-30T23:12:47.513983+0000","last_unstale":"2023-11-30T23:27:48.831745+0000","last_undegraded":"2023-11-30T23:27:48.831745+0000","last_fullsized":"2023-11-30T23:27:48.831745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3770,"log_dups_size":0,"ondisk_log_size":3770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:39.696562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010376995,"stat_sum":{"num_bytes":9,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1166,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"48'3845","reported_seq":3891,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:46.015147+0000","last_change":"2023-11-30T23:12:47.140168+0000","last_active":"2023-11-30T23:27:46.015147+0000","last_peered":"2023-11-30T23:27:46.015147+0000","last_clean":"2023-11-30T23:27:46.015147+0000","last_became_active":"2023-11-30T23:12:47.139799+0000","last_became_peered":"2023-11-30T23:12:47.139799+0000","last_unstale":"2023-11-30T23:27:46.015147+0000","last_undegraded":"2023-11-30T23:27:46.015147+0000","last_fullsized":"2023-11-30T23:27:46.015147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3845,"log_dups_size":0,"ondisk_log_size":3845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":3911,"num_write_kb":30389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"48'3523","reported_seq":2902,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.914801+0000","last_change":"2023-11-30T23:27:40.772832+0000","last_active":"2023-11-30T23:27:48.914801+0000","last_peered":"2023-11-30T23:27:48.914801+0000","last_clean":"2023-11-30T23:27:48.914801+0000","last_became_active":"2023-11-30T23:12:47.503333+0000","last_became_peered":"2023-11-30T23:12:47.503333+0000","last_unstale":"2023-11-30T23:27:48.914801+0000","last_undegraded":"2023-11-30T23:27:48.914801+0000","last_fullsized":"2023-11-30T23:27:48.914801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3523,"log_dups_size":0,"ondisk_log_size":3523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070303589999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"41'1920","reported_seq":1967,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.389384+0000","last_change":"2023-11-30T23:12:47.136931+0000","last_active":"2023-11-30T23:27:48.389384+0000","last_peered":"2023-11-30T23:27:48.389384+0000","last_clean":"2023-11-30T23:27:48.389384+0000","last_became_active":"2023-11-30T23:12:47.136620+0000","last_became_peered":"2023-11-30T23:12:47.136620+0000","last_unstale":"2023-11-30T23:27:48.389384+0000","last_undegraded":"2023-11-30T23:27:48.389384+0000","last_fullsized":"2023-11-30T23:27:48.389384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1920,"log_dups_size":0,"ondisk_log_size":1920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":2012,"num_write_kb":17264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"48'3603","reported_seq":2978,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.402586+0000","last_change":"2023-11-30T23:27:40.557057+0000","last_active":"2023-11-30T23:27:48.402586+0000","last_peered":"2023-11-30T23:27:48.402586+0000","last_clean":"2023-11-30T23:27:48.402586+0000","last_became_active":"2023-11-30T23:12:47.503294+0000","last_became_peered":"2023-11-30T23:12:47.503294+0000","last_unstale":"2023-11-30T23:27:48.402586+0000","last_undegraded":"2023-11-30T23:27:48.402586+0000","last_fullsized":"2023-11-30T23:27:48.402586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3603,"log_dups_size":0,"ondisk_log_size":3603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.028538382000000001,"stat_sum":{"num_bytes":8235,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1203,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"44'82","reported_seq":128,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.503221+0000","last_change":"2023-11-30T23:12:47.140575+0000","last_active":"2023-11-30T23:27:40.503221+0000","last_peered":"2023-11-30T23:27:40.503221+0000","last_clean":"2023-11-30T23:27:40.503221+0000","last_became_active":"2023-11-30T23:12:47.140125+0000","last_became_peered":"2023-11-30T23:12:47.140125+0000","last_unstale":"2023-11-30T23:27:40.503221+0000","last_undegraded":"2023-11-30T23:27:40.503221+0000","last_fullsized":"2023-11-30T23:27:40.503221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":140,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"48'3957","reported_seq":3287,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.914271+0000","last_change":"2023-11-30T23:27:40.777472+0000","last_active":"2023-11-30T23:27:48.914271+0000","last_peered":"2023-11-30T23:27:48.914271+0000","last_clean":"2023-11-30T23:27:48.914271+0000","last_became_active":"2023-11-30T23:12:47.515427+0000","last_became_peered":"2023-11-30T23:12:47.515427+0000","last_unstale":"2023-11-30T23:27:48.914271+0000","last_undegraded":"2023-11-30T23:27:48.914271+0000","last_fullsized":"2023-11-30T23:27:48.914271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3957,"log_dups_size":0,"ondisk_log_size":3957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:26:06.870586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066010289999999996,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"41'1117","reported_seq":1163,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.767717+0000","last_change":"2023-11-30T23:12:47.129492+0000","last_active":"2023-11-30T23:27:40.767717+0000","last_peered":"2023-11-30T23:27:40.767717+0000","last_clean":"2023-11-30T23:27:40.767717+0000","last_became_active":"2023-11-30T23:12:47.129180+0000","last_became_peered":"2023-11-30T23:12:47.129180+0000","last_unstale":"2023-11-30T23:27:40.767717+0000","last_undegraded":"2023-11-30T23:27:40.767717+0000","last_fullsized":"2023-11-30T23:27:40.767717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1117,"log_dups_size":0,"ondisk_log_size":1117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":1162,"num_write_kb":9042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"48'3496","reported_seq":2887,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.409584+0000","last_change":"2023-11-30T23:27:40.782626+0000","last_active":"2023-11-30T23:27:48.409584+0000","last_peered":"2023-11-30T23:27:48.409584+0000","last_clean":"2023-11-30T23:27:48.409584+0000","last_became_active":"2023-11-30T23:12:47.516980+0000","last_became_peered":"2023-11-30T23:12:47.516980+0000","last_unstale":"2023-11-30T23:27:48.409584+0000","last_undegraded":"2023-11-30T23:27:48.409584+0000","last_fullsized":"2023-11-30T23:27:48.409584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3496,"log_dups_size":0,"ondisk_log_size":3496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:19:17.128527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014912678,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"44'1300","reported_seq":1346,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.427175+0000","last_change":"2023-11-30T23:12:47.129703+0000","last_active":"2023-11-30T23:27:40.427175+0000","last_peered":"2023-11-30T23:27:40.427175+0000","last_clean":"2023-11-30T23:27:40.427175+0000","last_became_active":"2023-11-30T23:12:47.129349+0000","last_became_peered":"2023-11-30T23:12:47.129349+0000","last_unstale":"2023-11-30T23:27:40.427175+0000","last_undegraded":"2023-11-30T23:27:40.427175+0000","last_fullsized":"2023-11-30T23:27:40.427175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1300,"log_dups_size":0,"ondisk_log_size":1300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":1371,"num_write_kb":13381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"48'3743","reported_seq":3065,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.913798+0000","last_change":"2023-11-30T23:27:40.775036+0000","last_active":"2023-11-30T23:27:48.913798+0000","last_peered":"2023-11-30T23:27:48.913798+0000","last_clean":"2023-11-30T23:27:48.913798+0000","last_became_active":"2023-11-30T23:12:47.514140+0000","last_became_peered":"2023-11-30T23:12:47.514140+0000","last_unstale":"2023-11-30T23:27:48.913798+0000","last_undegraded":"2023-11-30T23:27:48.913798+0000","last_fullsized":"2023-11-30T23:27:48.913798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3743,"log_dups_size":0,"ondisk_log_size":3743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:54:46.925262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0087768900000000007,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1241,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"48'1098","reported_seq":1144,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:42.506396+0000","last_change":"2023-11-30T23:12:47.136924+0000","last_active":"2023-11-30T23:27:42.506396+0000","last_peered":"2023-11-30T23:27:42.506396+0000","last_clean":"2023-11-30T23:27:42.506396+0000","last_became_active":"2023-11-30T23:12:47.136631+0000","last_became_peered":"2023-11-30T23:12:47.136631+0000","last_unstale":"2023-11-30T23:27:42.506396+0000","last_undegraded":"2023-11-30T23:27:42.506396+0000","last_fullsized":"2023-11-30T23:27:42.506396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1098,"log_dups_size":0,"ondisk_log_size":1098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:22:48.835054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":1176,"num_write_kb":13385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"48'3434","reported_seq":2836,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.914807+0000","last_change":"2023-11-30T23:27:40.773928+0000","last_active":"2023-11-30T23:27:48.914807+0000","last_peered":"2023-11-30T23:27:48.914807+0000","last_clean":"2023-11-30T23:27:48.914807+0000","last_became_active":"2023-11-30T23:12:47.514053+0000","last_became_peered":"2023-11-30T23:12:47.514053+0000","last_unstale":"2023-11-30T23:27:48.914807+0000","last_undegraded":"2023-11-30T23:27:48.914807+0000","last_fullsized":"2023-11-30T23:27:48.914807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:59:43.860328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0080231629999999998,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"48'2035","reported_seq":2081,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:42.514312+0000","last_change":"2023-11-30T23:12:47.138008+0000","last_active":"2023-11-30T23:27:42.514312+0000","last_peered":"2023-11-30T23:27:42.514312+0000","last_clean":"2023-11-30T23:27:42.514312+0000","last_became_active":"2023-11-30T23:12:47.137695+0000","last_became_peered":"2023-11-30T23:12:47.137695+0000","last_unstale":"2023-11-30T23:27:42.514312+0000","last_undegraded":"2023-11-30T23:27:42.514312+0000","last_fullsized":"2023-11-30T23:27:42.514312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":2104,"num_write_kb":13092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"48'3567","reported_seq":2930,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.915942+0000","last_change":"2023-11-30T23:27:40.778859+0000","last_active":"2023-11-30T23:27:48.915942+0000","last_peered":"2023-11-30T23:27:48.915942+0000","last_clean":"2023-11-30T23:27:48.915942+0000","last_became_active":"2023-11-30T23:12:47.514822+0000","last_became_peered":"2023-11-30T23:12:47.514822+0000","last_unstale":"2023-11-30T23:27:48.915942+0000","last_undegraded":"2023-11-30T23:27:48.915942+0000","last_fullsized":"2023-11-30T23:27:48.915942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3567,"log_dups_size":0,"ondisk_log_size":3567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:02:36.020857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076646960000000004,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"43'4595","reported_seq":4642,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.884565+0000","last_change":"2023-11-30T23:12:47.129184+0000","last_active":"2023-11-30T23:27:48.884565+0000","last_peered":"2023-11-30T23:27:48.884565+0000","last_clean":"2023-11-30T23:27:48.884565+0000","last_became_active":"2023-11-30T23:12:47.128682+0000","last_became_peered":"2023-11-30T23:12:47.128682+0000","last_unstale":"2023-11-30T23:27:48.884565+0000","last_undegraded":"2023-11-30T23:27:48.884565+0000","last_fullsized":"2023-11-30T23:27:48.884565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4595,"log_dups_size":0,"ondisk_log_size":4595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583127,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":4657,"num_write_kb":26783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"48'3659","reported_seq":2966,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.070086+0000","last_change":"2023-11-30T23:27:40.521110+0000","last_active":"2023-11-30T23:27:49.070086+0000","last_peered":"2023-11-30T23:27:49.070086+0000","last_clean":"2023-11-30T23:27:49.070086+0000","last_became_active":"2023-11-30T23:12:47.516317+0000","last_became_peered":"2023-11-30T23:12:47.516317+0000","last_unstale":"2023-11-30T23:27:49.070086+0000","last_undegraded":"2023-11-30T23:27:49.070086+0000","last_fullsized":"2023-11-30T23:27:49.070086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3659,"log_dups_size":0,"ondisk_log_size":3659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:20:31.102899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018738761999999999,"stat_sum":{"num_bytes":16384,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1262,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"48'4363","reported_seq":4409,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.566903+0000","last_change":"2023-11-30T23:12:47.140679+0000","last_active":"2023-11-30T23:27:41.566903+0000","last_peered":"2023-11-30T23:27:41.566903+0000","last_clean":"2023-11-30T23:27:41.566903+0000","last_became_active":"2023-11-30T23:12:47.140400+0000","last_became_peered":"2023-11-30T23:12:47.140400+0000","last_unstale":"2023-11-30T23:27:41.566903+0000","last_undegraded":"2023-11-30T23:27:41.566903+0000","last_fullsized":"2023-11-30T23:27:41.566903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4363,"log_dups_size":0,"ondisk_log_size":4363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:28:05.674632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4418,"num_write_kb":27644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"48'3509","reported_seq":2935,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.914807+0000","last_change":"2023-11-30T23:27:40.776512+0000","last_active":"2023-11-30T23:27:48.914807+0000","last_peered":"2023-11-30T23:27:48.914807+0000","last_clean":"2023-11-30T23:27:48.914807+0000","last_became_active":"2023-11-30T23:12:47.521481+0000","last_became_peered":"2023-11-30T23:12:47.521481+0000","last_unstale":"2023-11-30T23:27:48.914807+0000","last_undegraded":"2023-11-30T23:27:48.914807+0000","last_fullsized":"2023-11-30T23:27:48.914807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3509,"log_dups_size":0,"ondisk_log_size":3509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:17:01.774183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010302225,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1071,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.764928+0000","last_change":"2023-11-30T23:12:36.558633+0000","last_active":"2023-11-30T23:27:40.764928+0000","last_peered":"2023-11-30T23:27:40.764928+0000","last_clean":"2023-11-30T23:27:40.764928+0000","last_became_active":"2023-11-30T23:12:36.556455+0000","last_became_peered":"2023-11-30T23:12:36.556455+0000","last_unstale":"2023-11-30T23:27:40.764928+0000","last_undegraded":"2023-11-30T23:27:40.764928+0000","last_fullsized":"2023-11-30T23:27:40.764928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:34.652815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:34.652815+0000","last_clean_scrub_stamp":"2023-11-30T23:12:34.652815+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:36:52.941511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"48'933","reported_seq":980,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.557889+0000","last_change":"2023-11-30T23:12:47.132985+0000","last_active":"2023-11-30T23:27:41.557889+0000","last_peered":"2023-11-30T23:27:41.557889+0000","last_clean":"2023-11-30T23:27:41.557889+0000","last_became_active":"2023-11-30T23:12:47.132365+0000","last_became_peered":"2023-11-30T23:12:47.132365+0000","last_unstale":"2023-11-30T23:27:41.557889+0000","last_undegraded":"2023-11-30T23:27:41.557889+0000","last_fullsized":"2023-11-30T23:27:41.557889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":1011,"num_write_kb":13216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"48'3463","reported_seq":2900,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.541139+0000","last_change":"2023-11-30T23:27:40.529546+0000","last_active":"2023-11-30T23:27:48.541139+0000","last_peered":"2023-11-30T23:27:48.541139+0000","last_clean":"2023-11-30T23:27:48.541139+0000","last_became_active":"2023-11-30T23:12:47.508677+0000","last_became_peered":"2023-11-30T23:12:47.508677+0000","last_unstale":"2023-11-30T23:27:48.541139+0000","last_undegraded":"2023-11-30T23:27:48.541139+0000","last_fullsized":"2023-11-30T23:27:48.541139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3463,"log_dups_size":0,"ondisk_log_size":3463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:55.467615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029660272000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1097,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"43'3512","reported_seq":3559,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.765451+0000","last_change":"2023-11-30T23:12:47.148775+0000","last_active":"2023-11-30T23:27:40.765451+0000","last_peered":"2023-11-30T23:27:40.765451+0000","last_clean":"2023-11-30T23:27:40.765451+0000","last_became_active":"2023-11-30T23:12:47.148547+0000","last_became_peered":"2023-11-30T23:12:47.148547+0000","last_unstale":"2023-11-30T23:27:40.765451+0000","last_undegraded":"2023-11-30T23:27:40.765451+0000","last_fullsized":"2023-11-30T23:27:40.765451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3512,"log_dups_size":0,"ondisk_log_size":3512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:01.207700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":3602,"num_write_kb":26128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"48'3481","reported_seq":2876,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.402372+0000","last_change":"2023-11-30T23:27:40.549560+0000","last_active":"2023-11-30T23:27:48.402372+0000","last_peered":"2023-11-30T23:27:48.402372+0000","last_clean":"2023-11-30T23:27:48.402372+0000","last_became_active":"2023-11-30T23:12:47.515553+0000","last_became_peered":"2023-11-30T23:12:47.515553+0000","last_unstale":"2023-11-30T23:27:48.402372+0000","last_undegraded":"2023-11-30T23:27:48.402372+0000","last_fullsized":"2023-11-30T23:27:48.402372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021186228000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1162,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"48'2695","reported_seq":3257,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:42.508811+0000","last_change":"2023-11-30T23:12:47.136018+0000","last_active":"2023-11-30T23:27:42.508811+0000","last_peered":"2023-11-30T23:27:42.508811+0000","last_clean":"2023-11-30T23:27:42.508811+0000","last_became_active":"2023-11-30T23:12:47.135746+0000","last_became_peered":"2023-11-30T23:12:47.135746+0000","last_unstale":"2023-11-30T23:27:42.508811+0000","last_undegraded":"2023-11-30T23:27:42.508811+0000","last_fullsized":"2023-11-30T23:27:42.508811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2695,"log_dups_size":0,"ondisk_log_size":2695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:08:11.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3169767,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":530,"num_read_kb":3420,"num_write":2759,"num_write_kb":16501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"48'3593","reported_seq":2964,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.885287+0000","last_change":"2023-11-30T23:27:40.472409+0000","last_active":"2023-11-30T23:27:48.885287+0000","last_peered":"2023-11-30T23:27:48.885287+0000","last_clean":"2023-11-30T23:27:48.885287+0000","last_became_active":"2023-11-30T23:12:47.510024+0000","last_became_peered":"2023-11-30T23:12:47.510024+0000","last_unstale":"2023-11-30T23:27:48.885287+0000","last_undegraded":"2023-11-30T23:27:48.885287+0000","last_fullsized":"2023-11-30T23:27:48.885287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3593,"log_dups_size":0,"ondisk_log_size":3593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045211289000000002,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"48'4582","reported_seq":4629,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:42.508618+0000","last_change":"2023-11-30T23:12:47.141605+0000","last_active":"2023-11-30T23:27:42.508618+0000","last_peered":"2023-11-30T23:27:42.508618+0000","last_clean":"2023-11-30T23:27:42.508618+0000","last_became_active":"2023-11-30T23:12:47.141115+0000","last_became_peered":"2023-11-30T23:12:47.141115+0000","last_unstale":"2023-11-30T23:27:42.508618+0000","last_undegraded":"2023-11-30T23:27:42.508618+0000","last_fullsized":"2023-11-30T23:27:42.508618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4582,"log_dups_size":0,"ondisk_log_size":4582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:41:16.416482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":4625,"num_write_kb":30671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"48'3767","reported_seq":3097,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.831334+0000","last_change":"2023-11-30T23:27:40.778459+0000","last_active":"2023-11-30T23:27:48.831334+0000","last_peered":"2023-11-30T23:27:48.831334+0000","last_clean":"2023-11-30T23:27:48.831334+0000","last_became_active":"2023-11-30T23:12:47.514572+0000","last_became_peered":"2023-11-30T23:12:47.514572+0000","last_unstale":"2023-11-30T23:27:48.831334+0000","last_undegraded":"2023-11-30T23:27:48.831334+0000","last_fullsized":"2023-11-30T23:27:48.831334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3767,"log_dups_size":0,"ondisk_log_size":3767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:29.167074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010674993000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"41'153","reported_seq":201,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.884489+0000","last_change":"2023-11-30T23:12:47.141801+0000","last_active":"2023-11-30T23:27:48.884489+0000","last_peered":"2023-11-30T23:27:48.884489+0000","last_clean":"2023-11-30T23:27:48.884489+0000","last_became_active":"2023-11-30T23:12:47.141411+0000","last_became_peered":"2023-11-30T23:12:47.141411+0000","last_unstale":"2023-11-30T23:27:48.884489+0000","last_undegraded":"2023-11-30T23:27:48.884489+0000","last_fullsized":"2023-11-30T23:27:48.884489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":238,"num_write_kb":8770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"48'3575","reported_seq":2931,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.070233+0000","last_change":"2023-11-30T23:27:40.519690+0000","last_active":"2023-11-30T23:27:49.070233+0000","last_peered":"2023-11-30T23:27:49.070233+0000","last_clean":"2023-11-30T23:27:49.070233+0000","last_became_active":"2023-11-30T23:13:30.305367+0000","last_became_peered":"2023-11-30T23:13:30.305367+0000","last_unstale":"2023-11-30T23:27:49.070233+0000","last_undegraded":"2023-11-30T23:27:49.070233+0000","last_fullsized":"2023-11-30T23:27:49.070233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3575,"log_dups_size":0,"ondisk_log_size":3575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:54:08.569710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017828157000000001,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"48'2056","reported_seq":2103,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:42.508053+0000","last_change":"2023-11-30T23:12:47.143317+0000","last_active":"2023-11-30T23:27:42.508053+0000","last_peered":"2023-11-30T23:27:42.508053+0000","last_clean":"2023-11-30T23:27:42.508053+0000","last_became_active":"2023-11-30T23:12:47.143061+0000","last_became_peered":"2023-11-30T23:12:47.143061+0000","last_unstale":"2023-11-30T23:27:42.508053+0000","last_undegraded":"2023-11-30T23:27:42.508053+0000","last_fullsized":"2023-11-30T23:27:42.508053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:33:38.684081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":2145,"num_write_kb":21845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"48'3505","reported_seq":2897,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.885165+0000","last_change":"2023-11-30T23:27:40.468495+0000","last_active":"2023-11-30T23:27:48.885165+0000","last_peered":"2023-11-30T23:27:48.885165+0000","last_clean":"2023-11-30T23:27:48.885165+0000","last_became_active":"2023-11-30T23:12:47.501516+0000","last_became_peered":"2023-11-30T23:12:47.501516+0000","last_unstale":"2023-11-30T23:27:48.885165+0000","last_undegraded":"2023-11-30T23:27:48.885165+0000","last_fullsized":"2023-11-30T23:27:48.885165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040930987000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"48'2108","reported_seq":2155,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.884893+0000","last_change":"2023-11-30T23:12:47.135053+0000","last_active":"2023-11-30T23:27:48.884893+0000","last_peered":"2023-11-30T23:27:48.884893+0000","last_clean":"2023-11-30T23:27:48.884893+0000","last_became_active":"2023-11-30T23:12:47.134776+0000","last_became_peered":"2023-11-30T23:12:47.134776+0000","last_unstale":"2023-11-30T23:27:48.884893+0000","last_undegraded":"2023-11-30T23:27:48.884893+0000","last_fullsized":"2023-11-30T23:27:48.884893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2108,"log_dups_size":0,"ondisk_log_size":2108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":2452,"num_write_kb":16294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"48'3245","reported_seq":2659,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.542998+0000","last_change":"2023-11-30T23:27:40.533855+0000","last_active":"2023-11-30T23:27:48.542998+0000","last_peered":"2023-11-30T23:27:48.542998+0000","last_clean":"2023-11-30T23:27:48.542998+0000","last_became_active":"2023-11-30T23:12:47.498631+0000","last_became_peered":"2023-11-30T23:12:47.498631+0000","last_unstale":"2023-11-30T23:27:48.542998+0000","last_undegraded":"2023-11-30T23:27:48.542998+0000","last_fullsized":"2023-11-30T23:27:48.542998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3245,"log_dups_size":0,"ondisk_log_size":3245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:06:59.026622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033287613000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1095,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"48'1686","reported_seq":1732,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:41.561460+0000","last_change":"2023-11-30T23:12:47.137707+0000","last_active":"2023-11-30T23:27:41.561460+0000","last_peered":"2023-11-30T23:27:41.561460+0000","last_clean":"2023-11-30T23:27:41.561460+0000","last_became_active":"2023-11-30T23:12:47.137406+0000","last_became_peered":"2023-11-30T23:12:47.137406+0000","last_unstale":"2023-11-30T23:27:41.561460+0000","last_undegraded":"2023-11-30T23:27:41.561460+0000","last_fullsized":"2023-11-30T23:27:41.561460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1686,"log_dups_size":0,"ondisk_log_size":1686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:46:29.663762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":1761,"num_write_kb":9276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"48'3472","reported_seq":2878,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.403247+0000","last_change":"2023-11-30T23:27:40.571283+0000","last_active":"2023-11-30T23:27:48.403247+0000","last_peered":"2023-11-30T23:27:48.403247+0000","last_clean":"2023-11-30T23:27:48.403247+0000","last_became_active":"2023-11-30T23:12:47.506447+0000","last_became_peered":"2023-11-30T23:12:47.506447+0000","last_unstale":"2023-11-30T23:27:48.403247+0000","last_undegraded":"2023-11-30T23:27:48.403247+0000","last_fullsized":"2023-11-30T23:27:48.403247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3472,"log_dups_size":0,"ondisk_log_size":3472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037907362999999999,"stat_sum":{"num_bytes":4105,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1170,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"41'1548","reported_seq":1594,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.765208+0000","last_change":"2023-11-30T23:12:47.142532+0000","last_active":"2023-11-30T23:27:40.765208+0000","last_peered":"2023-11-30T23:27:40.765208+0000","last_clean":"2023-11-30T23:27:40.765208+0000","last_became_active":"2023-11-30T23:12:47.142135+0000","last_became_peered":"2023-11-30T23:12:47.142135+0000","last_unstale":"2023-11-30T23:27:40.765208+0000","last_undegraded":"2023-11-30T23:27:40.765208+0000","last_fullsized":"2023-11-30T23:27:40.765208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1548,"log_dups_size":0,"ondisk_log_size":1548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:56:53.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":1654,"num_write_kb":9390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"48'3431","reported_seq":2809,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.831154+0000","last_change":"2023-11-30T23:27:40.779072+0000","last_active":"2023-11-30T23:27:48.831154+0000","last_peered":"2023-11-30T23:27:48.831154+0000","last_clean":"2023-11-30T23:27:48.831154+0000","last_became_active":"2023-11-30T23:12:47.513966+0000","last_became_peered":"2023-11-30T23:12:47.513966+0000","last_unstale":"2023-11-30T23:27:48.831154+0000","last_undegraded":"2023-11-30T23:27:48.831154+0000","last_fullsized":"2023-11-30T23:27:48.831154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3431,"log_dups_size":0,"ondisk_log_size":3431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:05:02.220181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003646318,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"41'2295","reported_seq":2342,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.884910+0000","last_change":"2023-11-30T23:12:47.140898+0000","last_active":"2023-11-30T23:27:48.884910+0000","last_peered":"2023-11-30T23:27:48.884910+0000","last_clean":"2023-11-30T23:27:48.884910+0000","last_became_active":"2023-11-30T23:12:47.140565+0000","last_became_peered":"2023-11-30T23:12:47.140565+0000","last_unstale":"2023-11-30T23:27:48.884910+0000","last_undegraded":"2023-11-30T23:27:48.884910+0000","last_fullsized":"2023-11-30T23:27:48.884910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2295,"log_dups_size":0,"ondisk_log_size":2295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":2336,"num_write_kb":17365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'3595","reported_seq":2943,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.540849+0000","last_change":"2023-11-30T23:27:40.526518+0000","last_active":"2023-11-30T23:27:48.540849+0000","last_peered":"2023-11-30T23:27:48.540849+0000","last_clean":"2023-11-30T23:27:48.540849+0000","last_became_active":"2023-11-30T23:12:47.501315+0000","last_became_peered":"2023-11-30T23:12:47.501315+0000","last_unstale":"2023-11-30T23:27:48.540849+0000","last_undegraded":"2023-11-30T23:27:48.540849+0000","last_fullsized":"2023-11-30T23:27:48.540849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:39:13.244979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026736012999999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"44'2871","reported_seq":2918,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.884428+0000","last_change":"2023-11-30T23:12:47.140328+0000","last_active":"2023-11-30T23:27:48.884428+0000","last_peered":"2023-11-30T23:27:48.884428+0000","last_clean":"2023-11-30T23:27:48.884428+0000","last_became_active":"2023-11-30T23:12:47.140037+0000","last_became_peered":"2023-11-30T23:12:47.140037+0000","last_unstale":"2023-11-30T23:27:48.884428+0000","last_undegraded":"2023-11-30T23:27:48.884428+0000","last_fullsized":"2023-11-30T23:27:48.884428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":2935,"num_write_kb":26081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"48'3359","reported_seq":2773,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.541621+0000","last_change":"2023-11-30T23:27:40.530235+0000","last_active":"2023-11-30T23:27:48.541621+0000","last_peered":"2023-11-30T23:27:48.541621+0000","last_clean":"2023-11-30T23:27:48.541621+0000","last_became_active":"2023-11-30T23:12:47.507181+0000","last_became_peered":"2023-11-30T23:12:47.507181+0000","last_unstale":"2023-11-30T23:27:48.541621+0000","last_undegraded":"2023-11-30T23:27:48.541621+0000","last_fullsized":"2023-11-30T23:27:48.541621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:16:38.750857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030024714000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"41'4584","reported_seq":4630,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.771066+0000","last_change":"2023-11-30T23:12:47.142027+0000","last_active":"2023-11-30T23:27:40.771066+0000","last_peered":"2023-11-30T23:27:40.771066+0000","last_clean":"2023-11-30T23:27:40.771066+0000","last_became_active":"2023-11-30T23:12:47.141664+0000","last_became_peered":"2023-11-30T23:12:47.141664+0000","last_unstale":"2023-11-30T23:27:40.771066+0000","last_undegraded":"2023-11-30T23:27:40.771066+0000","last_fullsized":"2023-11-30T23:27:40.771066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4584,"log_dups_size":0,"ondisk_log_size":4584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:14:21.074180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4647,"num_write_kb":30581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"48'3589","reported_seq":2931,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.409682+0000","last_change":"2023-11-30T23:27:40.782695+0000","last_active":"2023-11-30T23:27:48.409682+0000","last_peered":"2023-11-30T23:27:48.409682+0000","last_clean":"2023-11-30T23:27:48.409682+0000","last_became_active":"2023-11-30T23:12:47.516939+0000","last_became_peered":"2023-11-30T23:12:47.516939+0000","last_unstale":"2023-11-30T23:27:48.409682+0000","last_undegraded":"2023-11-30T23:27:48.409682+0000","last_fullsized":"2023-11-30T23:27:48.409682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3589,"log_dups_size":0,"ondisk_log_size":3589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:42:43.823430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014334588000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"48'3872","reported_seq":3223,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.070030+0000","last_change":"2023-11-30T23:27:40.517369+0000","last_active":"2023-11-30T23:27:49.070030+0000","last_peered":"2023-11-30T23:27:49.070030+0000","last_clean":"2023-11-30T23:27:49.070030+0000","last_became_active":"2023-11-30T23:12:47.521310+0000","last_became_peered":"2023-11-30T23:12:47.521310+0000","last_unstale":"2023-11-30T23:27:49.070030+0000","last_undegraded":"2023-11-30T23:27:49.070030+0000","last_fullsized":"2023-11-30T23:27:49.070030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3872,"log_dups_size":0,"ondisk_log_size":3872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:08:47.117163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015666933000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"43'622","reported_seq":668,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.914768+0000","last_change":"2023-11-30T23:12:47.143819+0000","last_active":"2023-11-30T23:27:48.914768+0000","last_peered":"2023-11-30T23:27:48.914768+0000","last_clean":"2023-11-30T23:27:48.914768+0000","last_became_active":"2023-11-30T23:12:47.143512+0000","last_became_peered":"2023-11-30T23:12:47.143512+0000","last_unstale":"2023-11-30T23:27:48.914768+0000","last_undegraded":"2023-11-30T23:27:48.914768+0000","last_fullsized":"2023-11-30T23:27:48.914768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:35:20.171512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":689,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"48'3820","reported_seq":3129,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.069834+0000","last_change":"2023-11-30T23:27:40.520201+0000","last_active":"2023-11-30T23:27:49.069834+0000","last_peered":"2023-11-30T23:27:49.069834+0000","last_clean":"2023-11-30T23:27:49.069834+0000","last_became_active":"2023-11-30T23:12:47.520322+0000","last_became_peered":"2023-11-30T23:12:47.520322+0000","last_unstale":"2023-11-30T23:27:49.069834+0000","last_undegraded":"2023-11-30T23:27:49.069834+0000","last_fullsized":"2023-11-30T23:27:49.069834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3820,"log_dups_size":0,"ondisk_log_size":3820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018218595000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"41'4570","reported_seq":4616,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.915228+0000","last_change":"2023-11-30T23:12:47.142276+0000","last_active":"2023-11-30T23:27:48.915228+0000","last_peered":"2023-11-30T23:27:48.915228+0000","last_clean":"2023-11-30T23:27:48.915228+0000","last_became_active":"2023-11-30T23:12:47.141965+0000","last_became_peered":"2023-11-30T23:12:47.141965+0000","last_unstale":"2023-11-30T23:27:48.915228+0000","last_undegraded":"2023-11-30T23:27:48.915228+0000","last_fullsized":"2023-11-30T23:27:48.915228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4570,"log_dups_size":0,"ondisk_log_size":4570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-01T23:25:28.154593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4627,"num_write_kb":34948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"48'3352","reported_seq":2794,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.403303+0000","last_change":"2023-11-30T23:27:40.554745+0000","last_active":"2023-11-30T23:27:48.403303+0000","last_peered":"2023-11-30T23:27:48.403303+0000","last_clean":"2023-11-30T23:27:48.403303+0000","last_became_active":"2023-11-30T23:12:47.522002+0000","last_became_peered":"2023-11-30T23:12:47.522002+0000","last_unstale":"2023-11-30T23:27:48.403303+0000","last_undegraded":"2023-11-30T23:27:48.403303+0000","last_fullsized":"2023-11-30T23:27:48.403303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3352,"log_dups_size":0,"ondisk_log_size":3352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025109995999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1079,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"43'4068","reported_seq":4115,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:40.500923+0000","last_change":"2023-11-30T23:12:47.139186+0000","last_active":"2023-11-30T23:27:40.500923+0000","last_peered":"2023-11-30T23:27:40.500923+0000","last_clean":"2023-11-30T23:27:40.500923+0000","last_became_active":"2023-11-30T23:12:47.138275+0000","last_became_peered":"2023-11-30T23:12:47.138275+0000","last_unstale":"2023-11-30T23:27:40.500923+0000","last_undegraded":"2023-11-30T23:27:40.500923+0000","last_fullsized":"2023-11-30T23:27:40.500923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4068,"log_dups_size":0,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:58:25.168678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":4121,"num_write_kb":30658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"48'3346","reported_seq":2748,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.542666+0000","last_change":"2023-11-30T23:27:40.538163+0000","last_active":"2023-11-30T23:27:48.542666+0000","last_peered":"2023-11-30T23:27:48.542666+0000","last_clean":"2023-11-30T23:27:48.542666+0000","last_became_active":"2023-11-30T23:12:47.508718+0000","last_became_peered":"2023-11-30T23:12:47.508718+0000","last_unstale":"2023-11-30T23:27:48.542666+0000","last_undegraded":"2023-11-30T23:27:48.542666+0000","last_fullsized":"2023-11-30T23:27:48.542666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3346,"log_dups_size":0,"ondisk_log_size":3346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:09:16.430653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037282159000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"43'790","reported_seq":838,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.389387+0000","last_change":"2023-11-30T23:12:47.141150+0000","last_active":"2023-11-30T23:27:48.389387+0000","last_peered":"2023-11-30T23:27:48.389387+0000","last_clean":"2023-11-30T23:27:48.389387+0000","last_became_active":"2023-11-30T23:12:47.140891+0000","last_became_peered":"2023-11-30T23:12:47.140891+0000","last_unstale":"2023-11-30T23:27:48.389387+0000","last_undegraded":"2023-11-30T23:27:48.389387+0000","last_fullsized":"2023-11-30T23:27:48.389387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":847,"num_write_kb":12818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":74679,"num_write_kb":40592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228857,"ondisk_log_size":228857,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":275279537,"num_objects":614,"num_object_clones":0,"num_object_copies":1228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":614,"num_whiteouts":0,"num_read":1037,"num_read_kb":3420,"num_write":81074,"num_write_kb":625818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":540,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":550617088,"data_stored":550559074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78635,"ondisk_log_size":78635,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575034,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438952,"kb_used_data":70816,"kb_used_omap":0,"kb_used_meta":368128,"kb_avail":93932888,"statfs":{"total":96636764160,"available":96187277312,"internally_reserved":0,"allocated":72515584,"data_stored":72178287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":376963072},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69499999999999995,"15min":0.70399999999999996},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.1639999999999999,"5min":0.84699999999999998,"15min":0.78900000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":6.9429999999999996,"5min":6.9429999999999996,"15min":6.9429999999999996},"last":0.91300000000000003}]},{"osd":1,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.81699999999999995,"15min":0.81399999999999995},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":7.0540000000000003,"5min":7.0540000000000003,"15min":7.0540000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.751},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.84799999999999998}]},{"osd":2,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.84699999999999998,"15min":0.83099999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":5.54,"5min":5.54,"15min":5.54},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":5.5880000000000001,"5min":5.5880000000000001,"15min":5.5880000000000001},"last":0.80900000000000005}]},{"osd":3,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":0.94999999999999996,"15min":0.90100000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":4.6440000000000001,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.022,"5min":0.95999999999999996,"15min":0.96299999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":4.6589999999999998,"5min":4.6589999999999998,"15min":4.6589999999999998},"last":1.0800000000000001}]},{"osd":4,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.68799999999999994,"15min":0.77500000000000002},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.314},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3759999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.81100000000000005,"15min":0.88100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.97799999999999998}]},{"osd":5,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.79200000000000004,"15min":0.875},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.6719999999999999,"5min":1.7110000000000001,"15min":1.7210000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.81599999999999995,"15min":0.88500000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6379999999999999,"5min":1.796,"15min":1.796},"last":1.206}]},{"osd":6,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.86599999999999999,"15min":0.94499999999999995},"min":{"1min":0.38300000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.694,"5min":1.694,"15min":2.9670000000000001},"last":1.296},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.92300000000000004,"15min":0.97899999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":0.77400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575034,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":346000,"kb_used_data":90184,"kb_used_omap":0,"kb_used_meta":255808,"kb_avail":94025840,"statfs":{"total":96636764160,"available":96282460160,"internally_reserved":0,"allocated":92348416,"data_stored":92029658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":261947392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70199999999999996,"15min":0.73199999999999998},"min":{"1min":0.27100000000000002,"5min":0.23999999999999999,"15min":0.221},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.5640000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.77000000000000002,"15min":0.78400000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":3.4670000000000001,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.83699999999999997}]},{"osd":1,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.83199999999999996,"15min":0.86299999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":2.2210000000000001,"5min":5.851,"15min":12.172000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.33300000000000002},"max":{"1min":3.4420000000000002,"5min":3.4420000000000002,"15min":5.6980000000000004},"last":0.93000000000000005}]},{"osd":2,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.1800000000000002,"5min":2.327,"15min":2.327},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83999999999999997,"15min":0.86399999999999999},"min":{"1min":0.35999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.774},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.873,"15min":0.873},"min":{"1min":0.434,"5min":0.434,"15min":0.38900000000000001},"max":{"1min":3.4889999999999999,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.871,"15min":0.86799999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":2.2029999999999998,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.96999999999999997}]},{"osd":4,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.83799999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.081,"5min":2.081,"15min":2.6429999999999998},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.878,"15min":0.88900000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35299999999999998},"max":{"1min":3.371,"5min":3.371,"15min":3.371},"last":0.95499999999999996}]},{"osd":5,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.83899999999999997,"15min":0.84899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.1549999999999998,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.105},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.91000000000000003,"15min":0.97599999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":2.194,"5min":2.2400000000000002,"15min":2.7040000000000002},"last":1.0189999999999999}]},{"osd":7,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.101,"15min":1.0509999999999999},"min":{"1min":0.45700000000000002,"5min":0.45600000000000002,"15min":0.42499999999999999},"max":{"1min":3.4169999999999998,"5min":11.220000000000001,"15min":11.220000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.0940000000000001,"15min":1.1399999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.2370000000000001,"5min":12.874000000000001,"15min":30.405999999999999},"last":1.27}]}]},{"osd":5,"up_from":13,"seq":55834575034,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":384292,"kb_used_data":86620,"kb_used_omap":0,"kb_used_meta":297664,"kb_avail":93987548,"statfs":{"total":96636764160,"available":96243249152,"internally_reserved":0,"allocated":88698880,"data_stored":88364629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304807936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.64200000000000002,"15min":0.70799999999999996},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.91200000000000003,"5min":1.1990000000000001,"15min":1.2330000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.72599999999999998,"15min":0.76500000000000001},"min":{"1min":0.39700000000000002,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":3.5489999999999999,"5min":3.5489999999999999,"15min":4.508},"last":0.81999999999999995}]},{"osd":1,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.77800000000000002,"15min":0.84499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96699999999999997,"5min":2.9740000000000002,"15min":6.9320000000000004},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.78000000000000003,"15min":0.88400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.94399999999999995,"5min":1.661,"15min":6.8780000000000001},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.76300000000000001,"15min":0.80400000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.26700000000000002},"max":{"1min":1.04,"5min":1.7130000000000001,"15min":1.9690000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.77500000000000002,"15min":0.85099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0569999999999999,"5min":3.1379999999999999,"15min":4.6230000000000002},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.81799999999999995,"15min":0.85299999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.345,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.82899999999999996,"15min":0.93200000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.997,"5min":3.0030000000000001,"15min":6.7400000000000002},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.71399999999999997,"15min":0.80900000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.309},"max":{"1min":0.878,"5min":1.456,"15min":1.4930000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.83099999999999996,"15min":0.86299999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.5820000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.97699999999999998}]},{"osd":6,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.84699999999999998,"15min":0.89000000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.3520000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.623},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.86499999999999999,"15min":0.93500000000000005},"min":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.8160000000000001,"5min":3.073,"15min":3.073},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Nov 30 23:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.89500000000000002,"15min":0.94599999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.012,"5min":2.895,"15min":2.895},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.92800000000000005,"15min":0.98199999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.6559999999999999,"5min":3.484,"15min":3.484},"last":1.0149999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575033,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":349344,"kb_used_data":65624,"kb_used_omap":0,"kb_used_meta":283712,"kb_avail":94022496,"statfs":{"total":96636764160,"available":96279035904,"internally_reserved":0,"allocated":67198976,"data_stored":66871634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":290521088},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":0.81100000000000005,"15min":0.751},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":12.91,"5min":12.91,"15min":12.91},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.345,"5min":0.83299999999999996,"15min":0.77300000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":12.962,"5min":12.962,"15min":12.962},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.25600000000000001},"max":{"1min":4.8090000000000002,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.79900000000000004,"15min":0.78000000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":6.7839999999999998,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":1.0489999999999999}]},{"osd":2,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":0.83299999999999996,"15min":0.80900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":9.0229999999999997,"5min":9.0229999999999997,"15min":9.0229999999999997},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.143,"5min":0.92500000000000004,"15min":0.90500000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.33600000000000002},"max":{"1min":8.9990000000000006,"5min":8.9990000000000006,"15min":8.9990000000000006},"last":0.92300000000000004}]},{"osd":3,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.86899999999999999,"15min":0.85399999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":5.0209999999999999,"5min":5.0209999999999999,"15min":5.0209999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80800000000000005,"15min":0.82799999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":2.9489999999999998,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":4.71,"5min":1.593,"15min":1.087},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":81.837000000000003,"5min":81.837000000000003,"15min":81.837000000000003},"last":0.60499999999999998},{"interface":"front","average":{"1min":4.8460000000000001,"5min":1.6930000000000001,"15min":1.179},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":81.751999999999995,"5min":81.751999999999995,"15min":81.751999999999995},"last":0.94699999999999995}]},{"osd":6,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":4.6379999999999999,"5min":1.5740000000000001,"15min":1.0920000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":79.655000000000001,"5min":79.655000000000001,"15min":79.655000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":4.7789999999999999,"5min":1.6830000000000001,"15min":1.2070000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":80.540000000000006,"5min":80.540000000000006,"15min":80.540000000000006},"last":1.0229999999999999}]},{"osd":7,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":4.8399999999999999,"5min":1.7190000000000001,"15min":1.206},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":80.486000000000004,"5min":80.486000000000004,"15min":80.486000000000004},"last":1.179},{"interface":"front","average":{"1min":5.0449999999999999,"5min":1.7150000000000001,"15min":1.2030000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":81.875,"5min":81.875,"15min":81.875},"last":1.0920000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575034,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370932,"kb_used_data":61036,"kb_used_omap":0,"kb_used_meta":309888,"kb_avail":94000908,"statfs":{"total":96636764160,"available":96256929792,"internally_reserved":0,"allocated":62500864,"data_stored":62176772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":317325312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":2.6589999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.26900000000000002,"5min":0.24299999999999999,"15min":0.23999999999999999},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.4750000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.125,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.74299999999999999,"15min":0.77100000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0960000000000001,"5min":1.256,"15min":4.8150000000000004},"last":0.72499999999999998}]},{"osd":2,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.77200000000000002,"15min":0.76900000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.28000000000000003},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.82899999999999996,"15min":0.84399999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.1259999999999999,"5min":1.3580000000000001,"15min":4.8719999999999999},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.88500000000000001,"15min":0.89300000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.31},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":2.536},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.099,"5min":0.96199999999999997,"15min":0.95999999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.378},"max":{"1min":4.6820000000000004,"5min":4.6820000000000004,"15min":4.6820000000000004},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.0580000000000001,"15min":1.0189999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.42099999999999999},"max":{"1min":8.8010000000000002,"5min":8.8010000000000002,"15min":8.8010000000000002},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.98799999999999999,"15min":1.04},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1499999999999999,"5min":1.8500000000000001,"15min":4.9909999999999997},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.0429999999999999,"15min":1.022},"min":{"1min":0.52700000000000002,"5min":0.52100000000000002,"15min":0.378},"max":{"1min":3.6699999999999999,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.88700000000000001,"5min":1.024,"15min":1.0660000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.45500000000000002},"max":{"1min":1.1870000000000001,"5min":2.3530000000000002,"15min":4.4379999999999997},"last":0.89900000000000002}]},{"osd":7,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.038,"15min":1.085},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2629999999999999,"5min":1.4910000000000001,"15min":5.0369999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.056,"15min":1.073},"min":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.214,"5min":2.214,"15min":2.5609999999999999},"last":1.0169999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224108,"kb_used_data":40548,"kb_used_omap":0,"kb_used_meta":183552,"kb_avail":94147732,"statfs":{"total":96636764160,"available":96407277568,"internally_reserved":0,"allocated":41521152,"data_stored":41200500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":187957248},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.72599999999999998,"5min":1.0629999999999999,"15min":1.413},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.65100000000000002,"15min":0.67400000000000004},"min":{"1min":0.222,"5min":0.222,"15min":0.17999999999999999},"max":{"1min":1.044,"5min":1.2110000000000001,"15min":1.4470000000000001},"last":0.82099999999999995}]},{"osd":1,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.79100000000000004,"15min":0.73299999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":8.3480000000000008,"5min":8.3480000000000008,"15min":8.3480000000000008},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.74199999999999999,"15min":0.76100000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.224},"max":{"1min":1.0329999999999999,"5min":1.1850000000000001,"15min":11.457000000000001},"last":0.90700000000000003}]},{"osd":3,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.79200000000000004,"15min":0.73299999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.4569999999999999,"5min":3.4569999999999999,"15min":3.4569999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.86199999999999999,"15min":0.84099999999999997},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.4319999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.85699999999999998,"15min":0.88100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28299999999999997},"max":{"1min":1.151,"5min":1.5029999999999999,"15min":1.522},"last":1.054},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.88,"15min":0.87},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.4540000000000002,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":1.0109999999999999,"15min":0.999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.88100000000000001,"5min":1.0009999999999999,"15min":0.998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0089999999999999,"15min":0.96599999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":4.9420000000000002,"5min":4.9420000000000002,"15min":4.9420000000000002},"last":0.754},{"interface":"front","average":{"1min":0.85099999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.369,"5min":3.0030000000000001,"15min":3.0030000000000001},"last":1.006}]},{"osd":7,"last update":"Thu Nov 30 23:27:03 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":1.0569999999999999,"15min":1.0549999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.498,"5min":1.498,"15min":1.762},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.179,"5min":1.0920000000000001,"15min":1.0469999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.4750000000000001,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.69199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396560,"kb_used_data":86600,"kb_used_omap":0,"kb_used_meta":309952,"kb_avail":93975280,"statfs":{"total":96636764160,"available":96230686720,"internally_reserved":0,"allocated":88678400,"data_stored":88352518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":317390848},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.183},"max":{"1min":2.7850000000000001,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.67000000000000004,"15min":0.65900000000000003},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.91700000000000004,"5min":1.222,"15min":1.222},"last":0.747}]},{"osd":2,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66100000000000003,"15min":0.67300000000000004},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23000000000000001},"max":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.71399999999999997,"15min":0.72299999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.20699999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.622}]},{"osd":3,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29099999999999998},"max":{"1min":0.96799999999999997,"5min":1.3720000000000001,"15min":1.431},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.78500000000000003,"15min":0.76100000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.498,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.85499999999999998,"15min":0.88100000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.85699999999999998,"15min":0.88800000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.077,"5min":1.482,"15min":1.6919999999999999},"last":0.93500000000000005}]},{"osd":5,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.84199999999999997,"15min":0.84999999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.5389999999999999,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.97299999999999998,"15min":0.99099999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.8879999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":1.212}]},{"osd":6,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.93500000000000005,"15min":0.93300000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.6000000000000001,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":1},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.012,"15min":1.026},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.9209999999999998,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":1.085}]},{"osd":7,"last update":"Thu Nov 30 23:26:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.998,"15min":1.0069999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":1.1259999999999999,"5min":2.7549999999999999,"15min":2.7549999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.997,"15min":1.004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.5720000000000001,"5min":3.2280000000000002,"15min":3.2280000000000002},"last":1.1220000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575034,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243824,"kb_used_data":42152,"kb_used_omap":0,"kb_used_meta":201664,"kb_avail":94128016,"statfs":{"total":96636764160,"available":96387088384,"internally_reserved":0,"allocated":43163648,"data_stored":42816095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":206503936},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.624,"15min":0.61099999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.20999999999999999},"max":{"1min":0.88,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65100000000000002,"15min":0.66200000000000003},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.311,"5min":0.311,"15min":0.23699999999999999},"max":{"1min":1.046,"5min":1.8919999999999999,"15min":2.3479999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.76900000000000002,"15min":0.77300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.70599999999999996,"15min":0.71699999999999997},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.387,"5min":1.387,"15min":4.3170000000000002},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.85899999999999999,"15min":0.82699999999999996},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.99099999999999999,"5min":1.925,"15min":2.395},"last":0.879}]},{"osd":4,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.90800000000000003,"15min":0.89700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.113},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.86899999999999999,"15min":0.89700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":2.0640000000000001},"last":1.1839999999999999}]},{"osd":5,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.90200000000000002,"15min":0.91500000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.24,"5min":1.5629999999999999,"15min":1.871},"last":1.129},{"interface":"front","average":{"1min":0.80500000000000005,"5min":1.054,"15min":1.0680000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.9350000000000001,"5min":3.165,"15min":6.0119999999999996},"last":0.998}]},{"osd":6,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":1.089,"15min":1.0720000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.0800000000000001,"5min":2.0840000000000001,"15min":2.5209999999999999},"last":1.341},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.032,"15min":1.032},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.159}]},{"osd":7,"last update":"Thu Nov 30 23:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.254,"5min":2.254,"15min":8.3490000000000002},"last":1.3049999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.0129999999999999,"15min":1.038},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":6.1529999999999996},"last":1.0980000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41955328,"data_stored":41943678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":88088576,"data_stored":88080689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40919040,"data_stored":40918503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61898752,"data_stored":61890695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":66600960,"data_stored":66587530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":88084480,"data_stored":88080474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":91762688,"data_stored":91753755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":28760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":24621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":28708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":32788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":36947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":28695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":36961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T23:27:52.129 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.129 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.129 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.130 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.130 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.130 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.130 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.130 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.131 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.131 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.131 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.131 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.131 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.131 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.132 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.132 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.132 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.132 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.132 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.132 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.132 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.133 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.133 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.133 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.133 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.133 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.133 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.133 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.134 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.134 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.134 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.134 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.134 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.134 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.135 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.135 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.135 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.135 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.135 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.135 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.136 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.136 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.136 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.136 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.136 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.136 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.136 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.137 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.137 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.137 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.137 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.137 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.137 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.137 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.138 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.138 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.138 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.138 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.138 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.138 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.138 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.139 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.139 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.139 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.139 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-30T23:12:34.652815+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.139 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.139 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.140 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.140 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.140 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.140 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.140 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.140 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.140 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.141 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.141 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.141 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.141 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.141 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.141 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.142 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.142 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.142 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.142 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.142 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.142 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.142 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.143 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.143 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.143 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.143 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.143 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.143 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.143 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.144 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.144 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.144 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:27:52.144 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-30T23:28:12.145 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T23:28:12.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26d0da3700 1 Processor -- start 2023-11-30T23:28:12.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26d0da3700 1 -- start start 2023-11-30T23:28:12.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26d0da3700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f26cc0b2fa0 0x7f26cc142b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:12.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26d0da3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f26cc0b15d0 0x7f26cc13fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:12.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26d0da3700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc06e990 con 0x7f26cc1403b0 2023-11-30T23:28:12.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26d0da3700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc1407e0 con 0x7f26cc0b15d0 2023-11-30T23:28:12.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26d0da3700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc0b1120 con 0x7f26cc0b2fa0 2023-11-30T23:28:12.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26caffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f26cc0b15d0 0x7f26cc13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:12.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26caffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f26cc0b15d0 0x7f26cc13fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58494/0 (socket says 172.21.15.73:58494) 2023-11-30T23:28:12.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26caffd700 1 -- 172.21.15.73:0/3584549329 learned_addr learned my addr 172.21.15.73:0/3584549329 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:28:12.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26caffd700 1 -- 172.21.15.73:0/3584549329 >> v2:172.21.15.156:3300/0 conn(0x7f26cc0b2fa0 msgr2=0x7f26cc142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:28:12.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26cb7fe700 1 --2- 172.21.15.73:0/3584549329 >> v2:172.21.15.156:3300/0 conn(0x7f26cc0b2fa0 0x7f26cc142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:12.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26caffd700 1 --2- 172.21.15.73:0/3584549329 >> v2:172.21.15.156:3300/0 conn(0x7f26cc0b2fa0 0x7f26cc142b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:12.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26caffd700 1 -- 172.21.15.73:0/3584549329 >> v1:172.21.15.156:6789/0 conn(0x7f26cc1403b0 legacy=0x7f26cc1460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:28:12.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26caffd700 1 -- 172.21.15.73:0/3584549329 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc0b1a80 con 0x7f26cc0b15d0 2023-11-30T23:28:12.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26cb7fe700 1 --2- 172.21.15.73:0/3584549329 >> v2:172.21.15.156:3300/0 conn(0x7f26cc0b2fa0 0x7f26cc142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-30T23:28:12.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26caffd700 1 --2- 172.21.15.73:0/3584549329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26cc0b15d0 0x7f26cc13fe70 secure :-1 s=READY pgs=4262 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0b2160 tx=0x7f26bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc294c9006209fd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:12.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26ca7fc700 1 -- 172.21.15.73:0/3584549329 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00e070 con 0x7f26cc0b15d0 2023-11-30T23:28:12.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26ca7fc700 1 -- 172.21.15.73:0/3584549329 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc00b950 con 0x7f26cc0b15d0 2023-11-30T23:28:12.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.265+0000 7f26ca7fc700 1 -- 172.21.15.73:0/3584549329 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00bd00 con 0x7f26cc0b15d0 2023-11-30T23:28:12.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26d0da3700 1 -- 172.21.15.73:0/3584549329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26cc0b15d0 msgr2=0x7f26cc13fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:12.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26d0da3700 1 --2- 172.21.15.73:0/3584549329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26cc0b15d0 0x7f26cc13fe70 secure :-1 s=READY pgs=4262 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0b2160 tx=0x7f26bc00b330 comp rx=0 tx=0).stop 2023-11-30T23:28:12.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26d0da3700 1 -- 172.21.15.73:0/3584549329 shutdown_connections 2023-11-30T23:28:12.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26d0da3700 1 --2- 172.21.15.73:0/3584549329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26cc0b15d0 0x7f26cc13fe70 unknown :-1 s=CLOSED pgs=4262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:12.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26d0da3700 1 --2- 172.21.15.73:0/3584549329 >> v2:172.21.15.156:3300/0 conn(0x7f26cc0b2fa0 0x7f26cc142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:12.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26d0da3700 1 -- 172.21.15.73:0/3584549329 >> 172.21.15.73:0/3584549329 conn(0x7f26cc0b45a0 msgr2=0x7f26cc0b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:12.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26d0da3700 1 -- 172.21.15.73:0/3584549329 shutdown_connections 2023-11-30T23:28:12.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26d0da3700 1 -- 172.21.15.73:0/3584549329 wait complete. 2023-11-30T23:28:12.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26d0da3700 1 Processor -- start 2023-11-30T23:28:12.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26d0da3700 1 -- start start 2023-11-30T23:28:12.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26d0da3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26cc0b15d0 0x7f26cc13d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:12.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26d0da3700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26cc0b2fa0 0x7f26cc06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:12.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26d0da3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26cc1403b0 0x7f26cc150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:12.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26d0da3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc13dcf0 con 0x7f26cc0b15d0 2023-11-30T23:28:12.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26d0da3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0715a0 con 0x7f26cc1403b0 2023-11-30T23:28:12.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26d0da3700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc150030 con 0x7f26cc0b2fa0 2023-11-30T23:28:12.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26cb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26cc0b15d0 0x7f26cc13d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:12.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26cb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26cc0b15d0 0x7f26cc13d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58504/0 (socket says 172.21.15.73:58504) 2023-11-30T23:28:12.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26cb7fe700 1 -- 172.21.15.73:0/3426892773 learned_addr learned my addr 172.21.15.73:0/3426892773 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:28:12.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26caffd700 1 --2- 172.21.15.73:0/3426892773 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26cc0b2fa0 0x7f26cc06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:12.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.269+0000 7f26cbfff700 1 --2- 172.21.15.73:0/3426892773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26cc1403b0 0x7f26cc150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:12.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.273+0000 7f26cb7fe700 1 -- 172.21.15.73:0/3426892773 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26cc0b2fa0 msgr2=0x7f26cc06eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:12.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.273+0000 7f26cb7fe700 1 --2- 172.21.15.73:0/3426892773 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26cc0b2fa0 0x7f26cc06eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:12.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.273+0000 7f26cb7fe700 1 -- 172.21.15.73:0/3426892773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26cc1403b0 msgr2=0x7f26cc150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:12.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.273+0000 7f26cb7fe700 1 --2- 172.21.15.73:0/3426892773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26cc1403b0 0x7f26cc150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:12.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.273+0000 7f26cb7fe700 1 -- 172.21.15.73:0/3426892773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc009b30 con 0x7f26cc0b15d0 2023-11-30T23:28:12.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.273+0000 7f26cb7fe700 1 --2- 172.21.15.73:0/3426892773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26cc0b15d0 0x7f26cc13d7b0 secure :-1 s=READY pgs=4263 cs=0 l=1 rev1=1 crypto rx=0x7f26c000c770 tx=0x7f26c000ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:12.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.273+0000 7f26b3fff700 1 -- 172.21.15.73:0/3426892773 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c0011800 con 0x7f26cc0b15d0 2023-11-30T23:28:12.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.273+0000 7f26b3fff700 1 -- 172.21.15.73:0/3426892773 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c0011960 con 0x7f26cc0b15d0 2023-11-30T23:28:12.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.273+0000 7f26d0da3700 1 -- 172.21.15.73:0/3426892773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26cc0708c0 con 0x7f26cc0b15d0 2023-11-30T23:28:12.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.273+0000 7f26b3fff700 1 -- 172.21.15.73:0/3426892773 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c0011d10 con 0x7f26cc0b15d0 2023-11-30T23:28:12.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.273+0000 7f26d0da3700 1 -- 172.21.15.73:0/3426892773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc071e90 con 0x7f26cc0b15d0 2023-11-30T23:28:12.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.273+0000 7f26d0da3700 1 -- 172.21.15.73:0/3426892773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26cc072080 con 0x7f26cc0b15d0 2023-11-30T23:28:12.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.273+0000 7f26b3fff700 1 -- 172.21.15.73:0/3426892773 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f26c0018360 con 0x7f26cc0b15d0 2023-11-30T23:28:12.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.277+0000 7f26b3fff700 1 --2- 172.21.15.73:0/3426892773 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f26b8065ad0 0x7f26b8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:12.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.277+0000 7f26b3fff700 1 -- 172.21.15.73:0/3426892773 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f26c00830f0 con 0x7f26cc0b15d0 2023-11-30T23:28:12.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.277+0000 7f26caffd700 1 --2- 172.21.15.73:0/3426892773 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f26b8065ad0 0x7f26b8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:12.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.277+0000 7f26caffd700 1 --2- 172.21.15.73:0/3426892773 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f26b8065ad0 0x7f26b8067f90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00b370 tx=0x7f26bc009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:12.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.281+0000 7f26b3fff700 1 -- 172.21.15.73:0/3426892773 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f26c0050a30 con 0x7f26cc0b15d0 2023-11-30T23:28:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.449+0000 7f26d0da3700 1 -- 172.21.15.73:0/3426892773 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26cc1337b0 con 0x7f26b8065ad0 2023-11-30T23:28:12.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.461+0000 7f26b3fff700 1 -- 172.21.15.73:0/3426892773 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290157 (secure 0 0 0) 0x7f26cc1337b0 con 0x7f26b8065ad0 2023-11-30T23:28:12.472 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:28:12.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.469+0000 7f26d0da3700 1 -- 172.21.15.73:0/3426892773 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f26b8065ad0 msgr2=0x7f26b8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:12.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.469+0000 7f26d0da3700 1 --2- 172.21.15.73:0/3426892773 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f26b8065ad0 0x7f26b8067f90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00b370 tx=0x7f26bc009000 comp rx=0 tx=0).stop 2023-11-30T23:28:12.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.469+0000 7f26d0da3700 1 -- 172.21.15.73:0/3426892773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26cc0b15d0 msgr2=0x7f26cc13d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:12.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.469+0000 7f26d0da3700 1 --2- 172.21.15.73:0/3426892773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26cc0b15d0 0x7f26cc13d7b0 secure :-1 s=READY pgs=4263 cs=0 l=1 rev1=1 crypto rx=0x7f26c000c770 tx=0x7f26c000ca80 comp rx=0 tx=0).stop 2023-11-30T23:28:12.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.469+0000 7f26d0da3700 1 -- 172.21.15.73:0/3426892773 shutdown_connections 2023-11-30T23:28:12.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.469+0000 7f26d0da3700 1 --2- 172.21.15.73:0/3426892773 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f26b8065ad0 0x7f26b8067f90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:12.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.469+0000 7f26d0da3700 1 --2- 172.21.15.73:0/3426892773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26cc1403b0 0x7f26cc150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:12.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.469+0000 7f26d0da3700 1 --2- 172.21.15.73:0/3426892773 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f26cc0b2fa0 0x7f26cc06eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:12.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.469+0000 7f26d0da3700 1 --2- 172.21.15.73:0/3426892773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26cc0b15d0 0x7f26cc13d7b0 unknown :-1 s=CLOSED pgs=4263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:12.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.469+0000 7f26d0da3700 1 -- 172.21.15.73:0/3426892773 >> 172.21.15.73:0/3426892773 conn(0x7f26cc0b45a0 msgr2=0x7f26cc13f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:12.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.469+0000 7f26d0da3700 1 -- 172.21.15.73:0/3426892773 shutdown_connections 2023-11-30T23:28:12.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:12.469+0000 7f26d0da3700 1 -- 172.21.15.73:0/3426892773 wait complete. 2023-11-30T23:28:12.479 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-11-30T23:28:12.487 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":511,"stamp":"2023-11-30T23:28:10.680237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":275997093,"num_objects":743,"num_object_clones":28,"num_object_copies":1486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":743,"num_whiteouts":15,"num_read":1184,"num_read_kb":3541,"num_write":155912,"num_write_kb":668826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":540,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2705360,"num_omap_keys":5366,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":308100,"ondisk_log_size":308100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2737688,"kb_used_data":543640,"kb_used_omap":0,"kb_used_meta":2193984,"kb_avail":752237032,"statfs":{"total":773094113280,"available":770290720768,"internally_reserved":0,"allocated":556687360,"data_stored":554020498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2246639616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1937040,"num_omap_keys":3840,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004508"},"pg_stats":[{"pgid":"3.3f","version":"48'3481","reported_seq":2878,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.915807+0000","last_change":"2023-11-30T23:27:40.777020+0000","last_active":"2023-11-30T23:27:48.915807+0000","last_peered":"2023-11-30T23:27:48.915807+0000","last_clean":"2023-11-30T23:27:48.915807+0000","last_became_active":"2023-11-30T23:12:47.512980+0000","last_became_peered":"2023-11-30T23:12:47.512980+0000","last_unstale":"2023-11-30T23:27:48.915807+0000","last_undegraded":"2023-11-30T23:27:48.915807+0000","last_fullsized":"2023-11-30T23:27:48.915807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0061607720000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1134,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"48'3347","reported_seq":2776,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.885177+0000","last_change":"2023-11-30T23:27:40.483369+0000","last_active":"2023-11-30T23:27:48.885177+0000","last_peered":"2023-11-30T23:27:48.885177+0000","last_clean":"2023-11-30T23:27:48.885177+0000","last_became_active":"2023-11-30T23:12:47.508771+0000","last_became_peered":"2023-11-30T23:12:47.508771+0000","last_unstale":"2023-11-30T23:27:48.885177+0000","last_undegraded":"2023-11-30T23:27:48.885177+0000","last_fullsized":"2023-11-30T23:27:48.885177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3347,"log_dups_size":0,"ondisk_log_size":3347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055178039999999998,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1093,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"49'3514","reported_seq":2928,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:01.610476+0000","last_change":"2023-11-30T23:28:01.610618+0000","last_active":"2023-11-30T23:28:01.610476+0000","last_peered":"2023-11-30T23:28:01.610476+0000","last_clean":"2023-11-30T23:28:01.610476+0000","last_became_active":"2023-11-30T23:12:47.507829+0000","last_became_peered":"2023-11-30T23:12:47.507829+0000","last_unstale":"2023-11-30T23:28:01.610476+0000","last_undegraded":"2023-11-30T23:28:01.610476+0000","last_fullsized":"2023-11-30T23:28:01.610476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3514","last_scrub_stamp":"2023-11-30T23:28:01.610451+0000","last_deep_scrub":"49'3514","last_deep_scrub_stamp":"2023-11-30T23:28:01.610451+0000","last_clean_scrub_stamp":"2023-11-30T23:28:01.610451+0000","objects_scrubbed":1,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:18:44.631441+0000","scrub_duration":0.030646911999999998,"objects_trimmed":0,"snaptrim_duration":0.031269901000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"48'3599","reported_seq":2964,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.069668+0000","last_change":"2023-11-30T23:27:40.523535+0000","last_active":"2023-11-30T23:27:49.069668+0000","last_peered":"2023-11-30T23:27:49.069668+0000","last_clean":"2023-11-30T23:27:49.069668+0000","last_became_active":"2023-11-30T23:12:47.522208+0000","last_became_peered":"2023-11-30T23:12:47.522208+0000","last_unstale":"2023-11-30T23:27:49.069668+0000","last_undegraded":"2023-11-30T23:27:49.069668+0000","last_fullsized":"2023-11-30T23:27:49.069668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3599,"log_dups_size":0,"ondisk_log_size":3599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020703408,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"48'3346","reported_seq":2727,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.884673+0000","last_change":"2023-11-30T23:27:40.475732+0000","last_active":"2023-11-30T23:27:48.884673+0000","last_peered":"2023-11-30T23:27:48.884673+0000","last_clean":"2023-11-30T23:27:48.884673+0000","last_became_active":"2023-11-30T23:13:30.302763+0000","last_became_peered":"2023-11-30T23:13:30.302763+0000","last_unstale":"2023-11-30T23:27:48.884673+0000","last_undegraded":"2023-11-30T23:27:48.884673+0000","last_fullsized":"2023-11-30T23:27:48.884673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3346,"log_dups_size":0,"ondisk_log_size":3346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047963988999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"48'3402","reported_seq":2819,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.073218+0000","last_change":"2023-11-30T23:27:40.521728+0000","last_active":"2023-11-30T23:27:49.073218+0000","last_peered":"2023-11-30T23:27:49.073218+0000","last_clean":"2023-11-30T23:27:49.073218+0000","last_became_active":"2023-11-30T23:12:47.513491+0000","last_became_peered":"2023-11-30T23:12:47.513491+0000","last_unstale":"2023-11-30T23:27:49.073218+0000","last_undegraded":"2023-11-30T23:27:49.073218+0000","last_fullsized":"2023-11-30T23:27:49.073218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019296939999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"48'3534","reported_seq":2944,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.080660+0000","last_change":"2023-11-30T23:27:40.773622+0000","last_active":"2023-11-30T23:27:49.080660+0000","last_peered":"2023-11-30T23:27:49.080660+0000","last_clean":"2023-11-30T23:27:49.080660+0000","last_became_active":"2023-11-30T23:12:47.507747+0000","last_became_peered":"2023-11-30T23:12:47.507747+0000","last_unstale":"2023-11-30T23:27:49.080660+0000","last_undegraded":"2023-11-30T23:27:49.080660+0000","last_fullsized":"2023-11-30T23:27:49.080660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3534,"log_dups_size":0,"ondisk_log_size":3534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0077627249999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"48'3400","reported_seq":2788,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.081007+0000","last_change":"2023-11-30T23:27:40.523065+0000","last_active":"2023-11-30T23:27:49.081007+0000","last_peered":"2023-11-30T23:27:49.081007+0000","last_clean":"2023-11-30T23:27:49.081007+0000","last_became_active":"2023-11-30T23:12:47.523430+0000","last_became_peered":"2023-11-30T23:12:47.523430+0000","last_unstale":"2023-11-30T23:27:49.081007+0000","last_undegraded":"2023-11-30T23:27:49.081007+0000","last_fullsized":"2023-11-30T23:27:49.081007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3400,"log_dups_size":0,"ondisk_log_size":3400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023650336000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"48'3724","reported_seq":3062,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.916014+0000","last_change":"2023-11-30T23:27:40.778901+0000","last_active":"2023-11-30T23:27:48.916014+0000","last_peered":"2023-11-30T23:27:48.916014+0000","last_clean":"2023-11-30T23:27:48.916014+0000","last_became_active":"2023-11-30T23:12:47.521393+0000","last_became_peered":"2023-11-30T23:12:47.521393+0000","last_unstale":"2023-11-30T23:27:48.916014+0000","last_undegraded":"2023-11-30T23:27:48.916014+0000","last_fullsized":"2023-11-30T23:27:48.916014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3724,"log_dups_size":0,"ondisk_log_size":3724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078674580000000008,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1228,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"48'3647","reported_seq":3116,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.410477+0000","last_change":"2023-11-30T23:27:40.786256+0000","last_active":"2023-11-30T23:27:48.410477+0000","last_peered":"2023-11-30T23:27:48.410477+0000","last_clean":"2023-11-30T23:27:48.410477+0000","last_became_active":"2023-11-30T23:12:47.522618+0000","last_became_peered":"2023-11-30T23:12:47.522618+0000","last_unstale":"2023-11-30T23:27:48.410477+0000","last_undegraded":"2023-11-30T23:27:48.410477+0000","last_fullsized":"2023-11-30T23:27:48.410477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3647,"log_dups_size":0,"ondisk_log_size":3647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016421781999999999,"stat_sum":{"num_bytes":4110,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":1106,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"48'3243","reported_seq":2733,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.409881+0000","last_change":"2023-11-30T23:27:40.786282+0000","last_active":"2023-11-30T23:27:48.409881+0000","last_peered":"2023-11-30T23:27:48.409881+0000","last_clean":"2023-11-30T23:27:48.409881+0000","last_became_active":"2023-11-30T23:13:30.304972+0000","last_became_peered":"2023-11-30T23:13:30.304972+0000","last_unstale":"2023-11-30T23:27:48.409881+0000","last_undegraded":"2023-11-30T23:27:48.409881+0000","last_fullsized":"2023-11-30T23:27:48.409881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3243,"log_dups_size":0,"ondisk_log_size":3243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016353854000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"48'3479","reported_seq":2867,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:08.819998+0000","last_change":"2023-11-30T23:28:08.820160+0000","last_active":"2023-11-30T23:28:08.819998+0000","last_peered":"2023-11-30T23:28:08.819998+0000","last_clean":"2023-11-30T23:28:08.819998+0000","last_became_active":"2023-11-30T23:12:47.513401+0000","last_became_peered":"2023-11-30T23:12:47.513401+0000","last_unstale":"2023-11-30T23:28:08.819998+0000","last_undegraded":"2023-11-30T23:28:08.819998+0000","last_fullsized":"2023-11-30T23:28:08.819998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3479","last_scrub_stamp":"2023-11-30T23:28:08.819951+0000","last_deep_scrub":"48'3479","last_deep_scrub_stamp":"2023-11-30T23:28:08.819951+0000","last_clean_scrub_stamp":"2023-11-30T23:28:08.819951+0000","objects_scrubbed":2,"log_size":3479,"log_dups_size":0,"ondisk_log_size":3479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:49:05.516384+0000","scrub_duration":0.03499451,"objects_trimmed":0,"snaptrim_duration":0.011359997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"48'3375","reported_seq":2827,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.541726+0000","last_change":"2023-11-30T23:27:40.524064+0000","last_active":"2023-11-30T23:27:48.541726+0000","last_peered":"2023-11-30T23:27:48.541726+0000","last_clean":"2023-11-30T23:27:48.541726+0000","last_became_active":"2023-11-30T23:12:47.513714+0000","last_became_peered":"2023-11-30T23:12:47.513714+0000","last_unstale":"2023-11-30T23:27:48.541726+0000","last_undegraded":"2023-11-30T23:27:48.541726+0000","last_fullsized":"2023-11-30T23:27:48.541726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3375,"log_dups_size":0,"ondisk_log_size":3375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024370613999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1066,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"48'3643","reported_seq":3003,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.402376+0000","last_change":"2023-11-30T23:27:40.553372+0000","last_active":"2023-11-30T23:27:48.402376+0000","last_peered":"2023-11-30T23:27:48.402376+0000","last_clean":"2023-11-30T23:27:48.402376+0000","last_became_active":"2023-11-30T23:12:47.506967+0000","last_became_peered":"2023-11-30T23:12:47.506967+0000","last_unstale":"2023-11-30T23:27:48.402376+0000","last_undegraded":"2023-11-30T23:27:48.402376+0000","last_fullsized":"2023-11-30T23:27:48.402376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3643,"log_dups_size":0,"ondisk_log_size":3643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025050587999999999,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"48'3636","reported_seq":2969,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.884503+0000","last_change":"2023-11-30T23:27:40.490577+0000","last_active":"2023-11-30T23:27:48.884503+0000","last_peered":"2023-11-30T23:27:48.884503+0000","last_clean":"2023-11-30T23:27:48.884503+0000","last_became_active":"2023-11-30T23:12:47.513018+0000","last_became_peered":"2023-11-30T23:12:47.513018+0000","last_unstale":"2023-11-30T23:27:48.884503+0000","last_undegraded":"2023-11-30T23:27:48.884503+0000","last_fullsized":"2023-11-30T23:27:48.884503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3636,"log_dups_size":0,"ondisk_log_size":3636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059143527000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1251,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"48'3670","reported_seq":3020,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.068674+0000","last_change":"2023-11-30T23:27:40.518027+0000","last_active":"2023-11-30T23:27:49.068674+0000","last_peered":"2023-11-30T23:27:49.068674+0000","last_clean":"2023-11-30T23:27:49.068674+0000","last_became_active":"2023-11-30T23:12:47.520518+0000","last_became_peered":"2023-11-30T23:12:47.520518+0000","last_unstale":"2023-11-30T23:27:49.068674+0000","last_undegraded":"2023-11-30T23:27:49.068674+0000","last_fullsized":"2023-11-30T23:27:49.068674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3670,"log_dups_size":0,"ondisk_log_size":3670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016206259000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"48'3892","reported_seq":3189,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.071360+0000","last_change":"2023-11-30T23:27:40.522656+0000","last_active":"2023-11-30T23:27:49.071360+0000","last_peered":"2023-11-30T23:27:49.071360+0000","last_clean":"2023-11-30T23:27:49.071360+0000","last_became_active":"2023-11-30T23:12:47.516382+0000","last_became_peered":"2023-11-30T23:12:47.516382+0000","last_unstale":"2023-11-30T23:27:49.071360+0000","last_undegraded":"2023-11-30T23:27:49.071360+0000","last_fullsized":"2023-11-30T23:27:49.071360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020102808999999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"49'3337","reported_seq":2829,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:05.189002+0000","last_change":"2023-11-30T23:28:05.189174+0000","last_active":"2023-11-30T23:28:05.189002+0000","last_peered":"2023-11-30T23:28:05.189002+0000","last_clean":"2023-11-30T23:28:05.189002+0000","last_became_active":"2023-11-30T23:12:47.509340+0000","last_became_peered":"2023-11-30T23:12:47.509340+0000","last_unstale":"2023-11-30T23:28:05.189002+0000","last_undegraded":"2023-11-30T23:28:05.189002+0000","last_fullsized":"2023-11-30T23:28:05.189002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3337","last_scrub_stamp":"2023-11-30T23:28:05.188973+0000","last_deep_scrub":"49'3337","last_deep_scrub_stamp":"2023-11-30T23:28:05.188973+0000","last_clean_scrub_stamp":"2023-11-30T23:28:05.188973+0000","objects_scrubbed":1,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:49:01.885406+0000","scrub_duration":0.034767988,"objects_trimmed":0,"snaptrim_duration":0.0085862969999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1061,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"49'3632","reported_seq":3015,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:55.924699+0000","last_change":"2023-11-30T23:27:55.924811+0000","last_active":"2023-11-30T23:27:55.924699+0000","last_peered":"2023-11-30T23:27:55.924699+0000","last_clean":"2023-11-30T23:27:55.924699+0000","last_became_active":"2023-11-30T23:12:47.506733+0000","last_became_peered":"2023-11-30T23:12:47.506733+0000","last_unstale":"2023-11-30T23:27:55.924699+0000","last_undegraded":"2023-11-30T23:27:55.924699+0000","last_fullsized":"2023-11-30T23:27:55.924699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3632","last_scrub_stamp":"2023-11-30T23:27:55.924680+0000","last_deep_scrub":"49'3632","last_deep_scrub_stamp":"2023-11-30T23:27:55.924680+0000","last_clean_scrub_stamp":"2023-11-30T23:27:55.924680+0000","objects_scrubbed":2,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:01.410077+0000","scrub_duration":0.042987108000000003,"objects_trimmed":0,"snaptrim_duration":0.010198370999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"48'3600","reported_seq":2961,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.409868+0000","last_change":"2023-11-30T23:27:40.784471+0000","last_active":"2023-11-30T23:27:48.409868+0000","last_peered":"2023-11-30T23:27:48.409868+0000","last_clean":"2023-11-30T23:27:48.409868+0000","last_became_active":"2023-11-30T23:12:47.518819+0000","last_became_peered":"2023-11-30T23:12:47.518819+0000","last_unstale":"2023-11-30T23:27:48.409868+0000","last_undegraded":"2023-11-30T23:27:48.409868+0000","last_fullsized":"2023-11-30T23:27:48.409868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014700833,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"48'3683","reported_seq":3066,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.402410+0000","last_change":"2023-11-30T23:27:40.567066+0000","last_active":"2023-11-30T23:27:48.402410+0000","last_peered":"2023-11-30T23:27:48.402410+0000","last_clean":"2023-11-30T23:27:48.402410+0000","last_became_active":"2023-11-30T23:12:47.514223+0000","last_became_peered":"2023-11-30T23:12:47.514223+0000","last_unstale":"2023-11-30T23:27:48.402410+0000","last_undegraded":"2023-11-30T23:27:48.402410+0000","last_fullsized":"2023-11-30T23:27:48.402410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3683,"log_dups_size":0,"ondisk_log_size":3683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036942162000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"48'4029","reported_seq":3325,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.069348+0000","last_change":"2023-11-30T23:27:40.526135+0000","last_active":"2023-11-30T23:27:49.069348+0000","last_peered":"2023-11-30T23:27:49.069348+0000","last_clean":"2023-11-30T23:27:49.069348+0000","last_became_active":"2023-11-30T23:12:47.520228+0000","last_became_peered":"2023-11-30T23:12:47.520228+0000","last_unstale":"2023-11-30T23:27:49.069348+0000","last_undegraded":"2023-11-30T23:27:49.069348+0000","last_fullsized":"2023-11-30T23:27:49.069348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":4029,"log_dups_size":0,"ondisk_log_size":4029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023056817,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1244,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"48'3705","reported_seq":3082,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.540726+0000","last_change":"2023-11-30T23:27:40.526288+0000","last_active":"2023-11-30T23:27:48.540726+0000","last_peered":"2023-11-30T23:27:48.540726+0000","last_clean":"2023-11-30T23:27:48.540726+0000","last_became_active":"2023-11-30T23:12:47.515247+0000","last_became_peered":"2023-11-30T23:12:47.515247+0000","last_unstale":"2023-11-30T23:27:48.540726+0000","last_undegraded":"2023-11-30T23:27:48.540726+0000","last_fullsized":"2023-11-30T23:27:48.540726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3705,"log_dups_size":0,"ondisk_log_size":3705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026511877,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"48'3602","reported_seq":2957,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:50.764176+0000","last_change":"2023-11-30T23:27:40.526691+0000","last_active":"2023-11-30T23:27:50.764176+0000","last_peered":"2023-11-30T23:27:50.764176+0000","last_clean":"2023-11-30T23:27:50.764176+0000","last_became_active":"2023-11-30T23:12:47.511097+0000","last_became_peered":"2023-11-30T23:12:47.511097+0000","last_unstale":"2023-11-30T23:27:50.764176+0000","last_undegraded":"2023-11-30T23:27:50.764176+0000","last_fullsized":"2023-11-30T23:27:50.764176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023833039,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"48'3199","reported_seq":2630,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.809419+0000","last_change":"2023-11-30T23:27:40.532323+0000","last_active":"2023-11-30T23:27:49.809419+0000","last_peered":"2023-11-30T23:27:49.809419+0000","last_clean":"2023-11-30T23:27:49.809419+0000","last_became_active":"2023-11-30T23:12:47.510404+0000","last_became_peered":"2023-11-30T23:12:47.510404+0000","last_unstale":"2023-11-30T23:27:49.809419+0000","last_undegraded":"2023-11-30T23:27:49.809419+0000","last_fullsized":"2023-11-30T23:27:49.809419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3199,"log_dups_size":0,"ondisk_log_size":3199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031984205000000002,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"48'3855","reported_seq":3189,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:51.274518+0000","last_change":"2023-11-30T23:27:40.788046+0000","last_active":"2023-11-30T23:27:51.274518+0000","last_peered":"2023-11-30T23:27:51.274518+0000","last_clean":"2023-11-30T23:27:51.274518+0000","last_became_active":"2023-11-30T23:12:47.516539+0000","last_became_peered":"2023-11-30T23:12:47.516539+0000","last_unstale":"2023-11-30T23:27:51.274518+0000","last_undegraded":"2023-11-30T23:27:51.274518+0000","last_fullsized":"2023-11-30T23:27:51.274518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3855,"log_dups_size":0,"ondisk_log_size":3855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018080019999999999,"stat_sum":{"num_bytes":4105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"48'3361","reported_seq":2777,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.885224+0000","last_change":"2023-11-30T23:27:40.486640+0000","last_active":"2023-11-30T23:27:48.885224+0000","last_peered":"2023-11-30T23:27:48.885224+0000","last_clean":"2023-11-30T23:27:48.885224+0000","last_became_active":"2023-11-30T23:12:47.506284+0000","last_became_peered":"2023-11-30T23:12:47.506284+0000","last_unstale":"2023-11-30T23:27:48.885224+0000","last_undegraded":"2023-11-30T23:27:48.885224+0000","last_fullsized":"2023-11-30T23:27:48.885224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3361,"log_dups_size":0,"ondisk_log_size":3361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058342590999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"48'3356","reported_seq":2749,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.809199+0000","last_change":"2023-11-30T23:27:40.535487+0000","last_active":"2023-11-30T23:27:49.809199+0000","last_peered":"2023-11-30T23:27:49.809199+0000","last_clean":"2023-11-30T23:27:49.809199+0000","last_became_active":"2023-11-30T23:12:47.511800+0000","last_became_peered":"2023-11-30T23:12:47.511800+0000","last_unstale":"2023-11-30T23:27:49.809199+0000","last_undegraded":"2023-11-30T23:27:49.809199+0000","last_fullsized":"2023-11-30T23:27:49.809199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3356,"log_dups_size":0,"ondisk_log_size":3356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034899355,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1130,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"48'3593","reported_seq":3003,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.402628+0000","last_change":"2023-11-30T23:27:40.562740+0000","last_active":"2023-11-30T23:27:48.402628+0000","last_peered":"2023-11-30T23:27:48.402628+0000","last_clean":"2023-11-30T23:27:48.402628+0000","last_became_active":"2023-11-30T23:12:47.512978+0000","last_became_peered":"2023-11-30T23:12:47.512978+0000","last_unstale":"2023-11-30T23:27:48.402628+0000","last_undegraded":"2023-11-30T23:27:48.402628+0000","last_fullsized":"2023-11-30T23:27:48.402628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3593,"log_dups_size":0,"ondisk_log_size":3593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032442869999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1122,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"48'3350","reported_seq":2781,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.069679+0000","last_change":"2023-11-30T23:27:40.524098+0000","last_active":"2023-11-30T23:27:49.069679+0000","last_peered":"2023-11-30T23:27:49.069679+0000","last_clean":"2023-11-30T23:27:49.069679+0000","last_became_active":"2023-11-30T23:12:47.511699+0000","last_became_peered":"2023-11-30T23:12:47.511699+0000","last_unstale":"2023-11-30T23:27:49.069679+0000","last_undegraded":"2023-11-30T23:27:49.069679+0000","last_fullsized":"2023-11-30T23:27:49.069679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3350,"log_dups_size":0,"ondisk_log_size":3350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021133078,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"49'4048","reported_seq":3311,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:02.179925+0000","last_change":"2023-11-30T23:28:02.180100+0000","last_active":"2023-11-30T23:28:02.179925+0000","last_peered":"2023-11-30T23:28:02.179925+0000","last_clean":"2023-11-30T23:28:02.179925+0000","last_became_active":"2023-11-30T23:12:47.521604+0000","last_became_peered":"2023-11-30T23:12:47.521604+0000","last_unstale":"2023-11-30T23:28:02.179925+0000","last_undegraded":"2023-11-30T23:28:02.179925+0000","last_fullsized":"2023-11-30T23:28:02.179925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4048","last_scrub_stamp":"2023-11-30T23:28:02.179890+0000","last_deep_scrub":"49'4048","last_deep_scrub_stamp":"2023-11-30T23:28:02.179890+0000","last_clean_scrub_stamp":"2023-11-30T23:28:02.179890+0000","objects_scrubbed":5,"log_size":4048,"log_dups_size":0,"ondisk_log_size":4048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:07.665287+0000","scrub_duration":0.046875120999999999,"objects_trimmed":0,"snaptrim_duration":0.0081020610000000007,"stat_sum":{"num_bytes":4121,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1336,"num_write_kb":721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"48'3908","reported_seq":3232,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.409653+0000","last_change":"2023-11-30T23:27:40.784516+0000","last_active":"2023-11-30T23:27:48.409653+0000","last_peered":"2023-11-30T23:27:48.409653+0000","last_clean":"2023-11-30T23:27:48.409653+0000","last_became_active":"2023-11-30T23:12:47.517283+0000","last_became_peered":"2023-11-30T23:12:47.517283+0000","last_unstale":"2023-11-30T23:27:48.409653+0000","last_undegraded":"2023-11-30T23:27:48.409653+0000","last_fullsized":"2023-11-30T23:27:48.409653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3908,"log_dups_size":0,"ondisk_log_size":3908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016665117,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"49'3481","reported_seq":2892,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:56.890441+0000","last_change":"2023-11-30T23:27:56.890633+0000","last_active":"2023-11-30T23:27:56.890441+0000","last_peered":"2023-11-30T23:27:56.890441+0000","last_clean":"2023-11-30T23:27:56.890441+0000","last_became_active":"2023-11-30T23:12:47.508725+0000","last_became_peered":"2023-11-30T23:12:47.508725+0000","last_unstale":"2023-11-30T23:27:56.890441+0000","last_undegraded":"2023-11-30T23:27:56.890441+0000","last_fullsized":"2023-11-30T23:27:56.890441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3481","last_scrub_stamp":"2023-11-30T23:27:56.890382+0000","last_deep_scrub":"49'3481","last_deep_scrub_stamp":"2023-11-30T23:27:56.890382+0000","last_clean_scrub_stamp":"2023-11-30T23:27:56.890382+0000","objects_scrubbed":1,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:10:21.913904+0000","scrub_duration":0.039608870999999997,"objects_trimmed":0,"snaptrim_duration":0.010267352,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1134,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"49'4002","reported_seq":4060,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:57.811764+0000","last_change":"2023-11-30T23:27:57.811924+0000","last_active":"2023-11-30T23:27:57.811764+0000","last_peered":"2023-11-30T23:27:57.811764+0000","last_clean":"2023-11-30T23:27:57.811764+0000","last_became_active":"2023-11-30T23:12:47.138768+0000","last_became_peered":"2023-11-30T23:12:47.138768+0000","last_unstale":"2023-11-30T23:27:57.811764+0000","last_undegraded":"2023-11-30T23:27:57.811764+0000","last_fullsized":"2023-11-30T23:27:57.811764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4002","last_scrub_stamp":"2023-11-30T23:27:57.811738+0000","last_deep_scrub":"49'4002","last_deep_scrub_stamp":"2023-11-30T23:27:57.811738+0000","last_clean_scrub_stamp":"2023-11-30T23:27:57.811738+0000","objects_scrubbed":21,"log_size":4002,"log_dups_size":0,"ondisk_log_size":4002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:18:40.832728+0000","scrub_duration":0.092190944999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":4054,"num_write_kb":19067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":131298,"num_omap_keys":261,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"49'3596","reported_seq":3003,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:08.660864+0000","last_change":"2023-11-30T23:28:08.660979+0000","last_active":"2023-11-30T23:28:08.660864+0000","last_peered":"2023-11-30T23:28:08.660864+0000","last_clean":"2023-11-30T23:28:08.660864+0000","last_became_active":"2023-11-30T23:12:47.516214+0000","last_became_peered":"2023-11-30T23:12:47.516214+0000","last_unstale":"2023-11-30T23:28:08.660864+0000","last_undegraded":"2023-11-30T23:28:08.660864+0000","last_fullsized":"2023-11-30T23:28:08.660864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3596","last_scrub_stamp":"2023-11-30T23:28:08.660841+0000","last_deep_scrub":"49'3596","last_deep_scrub_stamp":"2023-11-30T23:28:08.660841+0000","last_clean_scrub_stamp":"2023-11-30T23:28:08.660841+0000","objects_scrubbed":1,"log_size":3596,"log_dups_size":0,"ondisk_log_size":3596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:49:05.357274+0000","scrub_duration":0.026849743999999998,"objects_trimmed":0,"snaptrim_duration":0.037604525,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"49'4566","reported_seq":4624,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:56.588030+0000","last_change":"2023-11-30T23:27:56.588227+0000","last_active":"2023-11-30T23:27:56.588030+0000","last_peered":"2023-11-30T23:27:56.588030+0000","last_clean":"2023-11-30T23:27:56.588030+0000","last_became_active":"2023-11-30T23:12:47.129771+0000","last_became_peered":"2023-11-30T23:12:47.129771+0000","last_unstale":"2023-11-30T23:27:56.588030+0000","last_undegraded":"2023-11-30T23:27:56.588030+0000","last_fullsized":"2023-11-30T23:27:56.588030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4566","last_scrub_stamp":"2023-11-30T23:27:56.588004+0000","last_deep_scrub":"49'4566","last_deep_scrub_stamp":"2023-11-30T23:27:56.588004+0000","last_clean_scrub_stamp":"2023-11-30T23:27:56.588004+0000","objects_scrubbed":20,"log_size":4566,"log_dups_size":0,"ondisk_log_size":4566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:18:39.608994+0000","scrub_duration":0.072522685000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7867003,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":4621,"num_write_kb":33841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":132064,"num_omap_keys":262,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"49'869","reported_seq":927,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:52.760047+0000","last_change":"2023-11-30T23:27:52.760196+0000","last_active":"2023-11-30T23:27:52.760047+0000","last_peered":"2023-11-30T23:27:52.760047+0000","last_clean":"2023-11-30T23:27:52.760047+0000","last_became_active":"2023-11-30T23:12:47.133440+0000","last_became_peered":"2023-11-30T23:12:47.133440+0000","last_unstale":"2023-11-30T23:27:52.760047+0000","last_undegraded":"2023-11-30T23:27:52.760047+0000","last_fullsized":"2023-11-30T23:27:52.760047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'869","last_scrub_stamp":"2023-11-30T23:27:52.760025+0000","last_deep_scrub":"49'869","last_deep_scrub_stamp":"2023-11-30T23:27:52.760025+0000","last_clean_scrub_stamp":"2023-11-30T23:27:52.760025+0000","objects_scrubbed":18,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:03:41.368698+0000","scrub_duration":0.042867220999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":928,"num_write_kb":12986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":117912,"num_omap_keys":234,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"48'3961","reported_seq":3216,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.540594+0000","last_change":"2023-11-30T23:27:40.521787+0000","last_active":"2023-11-30T23:27:48.540594+0000","last_peered":"2023-11-30T23:27:48.540594+0000","last_clean":"2023-11-30T23:27:48.540594+0000","last_became_active":"2023-11-30T23:12:47.507617+0000","last_became_peered":"2023-11-30T23:12:47.507617+0000","last_unstale":"2023-11-30T23:27:48.540594+0000","last_undegraded":"2023-11-30T23:27:48.540594+0000","last_fullsized":"2023-11-30T23:27:48.540594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3961,"log_dups_size":0,"ondisk_log_size":3961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022313091,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1298,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"49'3818","reported_seq":3876,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:55.344789+0000","last_change":"2023-11-30T23:27:55.344927+0000","last_active":"2023-11-30T23:27:55.344789+0000","last_peered":"2023-11-30T23:27:55.344789+0000","last_clean":"2023-11-30T23:27:55.344789+0000","last_became_active":"2023-11-30T23:12:47.132351+0000","last_became_peered":"2023-11-30T23:12:47.132351+0000","last_unstale":"2023-11-30T23:27:55.344789+0000","last_undegraded":"2023-11-30T23:27:55.344789+0000","last_fullsized":"2023-11-30T23:27:55.344789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3818","last_scrub_stamp":"2023-11-30T23:27:55.344768+0000","last_deep_scrub":"49'3818","last_deep_scrub_stamp":"2023-11-30T23:27:55.344768+0000","last_clean_scrub_stamp":"2023-11-30T23:27:55.344768+0000","objects_scrubbed":15,"log_size":3818,"log_dups_size":0,"ondisk_log_size":3818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:00.830165+0000","scrub_duration":0.063752615999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":3859,"num_write_kb":38490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66804,"num_omap_keys":133,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"48'3665","reported_seq":3065,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.884979+0000","last_change":"2023-11-30T23:27:40.479741+0000","last_active":"2023-11-30T23:27:48.884979+0000","last_peered":"2023-11-30T23:27:48.884979+0000","last_clean":"2023-11-30T23:27:48.884979+0000","last_became_active":"2023-11-30T23:12:47.506082+0000","last_became_peered":"2023-11-30T23:12:47.506082+0000","last_unstale":"2023-11-30T23:27:48.884979+0000","last_undegraded":"2023-11-30T23:27:48.884979+0000","last_fullsized":"2023-11-30T23:27:48.884979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052118631999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"49'1115","reported_seq":1173,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:08.692273+0000","last_change":"2023-11-30T23:28:08.692475+0000","last_active":"2023-11-30T23:28:08.692273+0000","last_peered":"2023-11-30T23:28:08.692273+0000","last_clean":"2023-11-30T23:28:08.692273+0000","last_became_active":"2023-11-30T23:12:47.139400+0000","last_became_peered":"2023-11-30T23:12:47.139400+0000","last_unstale":"2023-11-30T23:28:08.692273+0000","last_undegraded":"2023-11-30T23:28:08.692273+0000","last_fullsized":"2023-11-30T23:28:08.692273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1115","last_scrub_stamp":"2023-11-30T23:28:08.692238+0000","last_deep_scrub":"49'1115","last_deep_scrub_stamp":"2023-11-30T23:28:08.692238+0000","last_clean_scrub_stamp":"2023-11-30T23:28:08.692238+0000","objects_scrubbed":19,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:55:21.581303+0000","scrub_duration":0.084637698999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":1152,"num_write_kb":13161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":93798,"num_omap_keys":186,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"48'3679","reported_seq":3047,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.340771+0000","last_change":"2023-11-30T23:27:40.435297+0000","last_active":"2023-11-30T23:27:49.340771+0000","last_peered":"2023-11-30T23:27:49.340771+0000","last_clean":"2023-11-30T23:27:49.340771+0000","last_became_active":"2023-11-30T23:13:30.596915+0000","last_became_peered":"2023-11-30T23:13:30.596915+0000","last_unstale":"2023-11-30T23:27:49.340771+0000","last_undegraded":"2023-11-30T23:27:49.340771+0000","last_fullsized":"2023-11-30T23:27:49.340771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3679,"log_dups_size":0,"ondisk_log_size":3679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066900809999999996,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"49'1893","reported_seq":1951,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:04.386249+0000","last_change":"2023-11-30T23:28:04.386438+0000","last_active":"2023-11-30T23:28:04.386249+0000","last_peered":"2023-11-30T23:28:04.386249+0000","last_clean":"2023-11-30T23:28:04.386249+0000","last_became_active":"2023-11-30T23:12:47.139047+0000","last_became_peered":"2023-11-30T23:12:47.139047+0000","last_unstale":"2023-11-30T23:28:04.386249+0000","last_undegraded":"2023-11-30T23:28:04.386249+0000","last_fullsized":"2023-11-30T23:28:04.386249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1893","last_scrub_stamp":"2023-11-30T23:28:04.386222+0000","last_deep_scrub":"49'1893","last_deep_scrub_stamp":"2023-11-30T23:28:04.386222+0000","last_clean_scrub_stamp":"2023-11-30T23:28:04.386222+0000","objects_scrubbed":21,"log_size":1893,"log_dups_size":0,"ondisk_log_size":1893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:18:40.034102+0000","scrub_duration":0.058105267000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":1932,"num_write_kb":25642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":128094,"num_omap_keys":254,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"48'3570","reported_seq":2954,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.403572+0000","last_change":"2023-11-30T23:27:40.558523+0000","last_active":"2023-11-30T23:27:48.403572+0000","last_peered":"2023-11-30T23:27:48.403572+0000","last_clean":"2023-11-30T23:27:48.403572+0000","last_became_active":"2023-11-30T23:12:47.522711+0000","last_became_peered":"2023-11-30T23:12:47.522711+0000","last_unstale":"2023-11-30T23:27:48.403572+0000","last_undegraded":"2023-11-30T23:27:48.403572+0000","last_fullsized":"2023-11-30T23:27:48.403572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.028725985999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"48'3057","reported_seq":3104,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.884601+0000","last_change":"2023-11-30T23:12:47.140794+0000","last_active":"2023-11-30T23:27:48.884601+0000","last_peered":"2023-11-30T23:27:48.884601+0000","last_clean":"2023-11-30T23:27:48.884601+0000","last_became_active":"2023-11-30T23:12:47.140531+0000","last_became_peered":"2023-11-30T23:12:47.140531+0000","last_unstale":"2023-11-30T23:27:48.884601+0000","last_undegraded":"2023-11-30T23:27:48.884601+0000","last_fullsized":"2023-11-30T23:27:48.884601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":3057,"log_dups_size":0,"ondisk_log_size":3057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":3128,"num_write_kb":22065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'3775","reported_seq":3149,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:06.784637+0000","last_change":"2023-11-30T23:28:06.784753+0000","last_active":"2023-11-30T23:28:06.784637+0000","last_peered":"2023-11-30T23:28:06.784637+0000","last_clean":"2023-11-30T23:28:06.784637+0000","last_became_active":"2023-11-30T23:12:47.513983+0000","last_became_peered":"2023-11-30T23:12:47.513983+0000","last_unstale":"2023-11-30T23:28:06.784637+0000","last_undegraded":"2023-11-30T23:28:06.784637+0000","last_fullsized":"2023-11-30T23:28:06.784637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3775","last_scrub_stamp":"2023-11-30T23:28:06.784616+0000","last_deep_scrub":"49'3775","last_deep_scrub_stamp":"2023-11-30T23:28:06.784616+0000","last_clean_scrub_stamp":"2023-11-30T23:28:06.784616+0000","objects_scrubbed":5,"log_size":3775,"log_dups_size":0,"ondisk_log_size":3775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:12.270013+0000","scrub_duration":0.041895794,"objects_trimmed":0,"snaptrim_duration":0.010376995,"stat_sum":{"num_bytes":9,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1166,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"49'3864","reported_seq":3922,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:03.570741+0000","last_change":"2023-11-30T23:28:03.570940+0000","last_active":"2023-11-30T23:28:03.570741+0000","last_peered":"2023-11-30T23:28:03.570741+0000","last_clean":"2023-11-30T23:28:03.570741+0000","last_became_active":"2023-11-30T23:12:47.139799+0000","last_became_peered":"2023-11-30T23:12:47.139799+0000","last_unstale":"2023-11-30T23:28:03.570741+0000","last_undegraded":"2023-11-30T23:28:03.570741+0000","last_fullsized":"2023-11-30T23:28:03.570741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3864","last_scrub_stamp":"2023-11-30T23:28:03.570709+0000","last_deep_scrub":"49'3864","last_deep_scrub_stamp":"2023-11-30T23:28:03.570709+0000","last_clean_scrub_stamp":"2023-11-30T23:28:03.570709+0000","objects_scrubbed":20,"log_size":3864,"log_dups_size":0,"ondisk_log_size":3864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:49:00.267142+0000","scrub_duration":0.086803594999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":3911,"num_write_kb":30389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99239,"num_omap_keys":195,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"48'3523","reported_seq":2903,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.914920+0000","last_change":"2023-11-30T23:27:40.772832+0000","last_active":"2023-11-30T23:27:48.914920+0000","last_peered":"2023-11-30T23:27:48.914920+0000","last_clean":"2023-11-30T23:27:48.914920+0000","last_became_active":"2023-11-30T23:12:47.503333+0000","last_became_peered":"2023-11-30T23:12:47.503333+0000","last_unstale":"2023-11-30T23:27:48.914920+0000","last_undegraded":"2023-11-30T23:27:48.914920+0000","last_fullsized":"2023-11-30T23:27:48.914920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3523,"log_dups_size":0,"ondisk_log_size":3523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070303589999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"49'1943","reported_seq":2001,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:55.603559+0000","last_change":"2023-11-30T23:27:55.603926+0000","last_active":"2023-11-30T23:27:55.603559+0000","last_peered":"2023-11-30T23:27:55.603559+0000","last_clean":"2023-11-30T23:27:55.603559+0000","last_became_active":"2023-11-30T23:12:47.136620+0000","last_became_peered":"2023-11-30T23:12:47.136620+0000","last_unstale":"2023-11-30T23:27:55.603559+0000","last_undegraded":"2023-11-30T23:27:55.603559+0000","last_fullsized":"2023-11-30T23:27:55.603559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1943","last_scrub_stamp":"2023-11-30T23:27:55.603484+0000","last_deep_scrub":"49'1943","last_deep_scrub_stamp":"2023-11-30T23:27:55.603484+0000","last_clean_scrub_stamp":"2023-11-30T23:27:55.603484+0000","objects_scrubbed":23,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:01:50.595690+0000","scrub_duration":0.066985327999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":2012,"num_write_kb":17264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":138602,"num_omap_keys":275,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"49'3608","reported_seq":2994,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:06.722647+0000","last_change":"2023-11-30T23:28:06.722813+0000","last_active":"2023-11-30T23:28:06.722647+0000","last_peered":"2023-11-30T23:28:06.722647+0000","last_clean":"2023-11-30T23:28:06.722647+0000","last_became_active":"2023-11-30T23:12:47.503294+0000","last_became_peered":"2023-11-30T23:12:47.503294+0000","last_unstale":"2023-11-30T23:28:06.722647+0000","last_undegraded":"2023-11-30T23:28:06.722647+0000","last_fullsized":"2023-11-30T23:28:06.722647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3608","last_scrub_stamp":"2023-11-30T23:28:06.722625+0000","last_deep_scrub":"49'3608","last_deep_scrub_stamp":"2023-11-30T23:28:06.722625+0000","last_clean_scrub_stamp":"2023-11-30T23:28:06.722625+0000","objects_scrubbed":5,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:12.208022+0000","scrub_duration":0.049361031,"objects_trimmed":0,"snaptrim_duration":0.028538382000000001,"stat_sum":{"num_bytes":8235,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1203,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"44'82","reported_seq":129,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.069682+0000","last_change":"2023-11-30T23:12:47.140575+0000","last_active":"2023-11-30T23:27:49.069682+0000","last_peered":"2023-11-30T23:27:49.069682+0000","last_clean":"2023-11-30T23:27:49.069682+0000","last_became_active":"2023-11-30T23:12:47.140125+0000","last_became_peered":"2023-11-30T23:12:47.140125+0000","last_unstale":"2023-11-30T23:27:49.069682+0000","last_undegraded":"2023-11-30T23:27:49.069682+0000","last_fullsized":"2023-11-30T23:27:49.069682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":140,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"48'3957","reported_seq":3288,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.914391+0000","last_change":"2023-11-30T23:27:40.777472+0000","last_active":"2023-11-30T23:27:48.914391+0000","last_peered":"2023-11-30T23:27:48.914391+0000","last_clean":"2023-11-30T23:27:48.914391+0000","last_became_active":"2023-11-30T23:12:47.515427+0000","last_became_peered":"2023-11-30T23:12:47.515427+0000","last_unstale":"2023-11-30T23:27:48.914391+0000","last_undegraded":"2023-11-30T23:27:48.914391+0000","last_fullsized":"2023-11-30T23:27:48.914391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3957,"log_dups_size":0,"ondisk_log_size":3957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066010289999999996,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"49'1127","reported_seq":1185,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:01.508789+0000","last_change":"2023-11-30T23:28:01.508982+0000","last_active":"2023-11-30T23:28:01.508789+0000","last_peered":"2023-11-30T23:28:01.508789+0000","last_clean":"2023-11-30T23:28:01.508789+0000","last_became_active":"2023-11-30T23:12:47.129180+0000","last_became_peered":"2023-11-30T23:12:47.129180+0000","last_unstale":"2023-11-30T23:28:01.508789+0000","last_undegraded":"2023-11-30T23:28:01.508789+0000","last_fullsized":"2023-11-30T23:28:01.508789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1127","last_scrub_stamp":"2023-11-30T23:28:01.508755+0000","last_deep_scrub":"49'1127","last_deep_scrub_stamp":"2023-11-30T23:28:01.508755+0000","last_clean_scrub_stamp":"2023-11-30T23:28:01.508755+0000","objects_scrubbed":10,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:06.994151+0000","scrub_duration":0.041205466000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":1162,"num_write_kb":9042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":54342,"num_omap_keys":108,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"48'3496","reported_seq":2888,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.409635+0000","last_change":"2023-11-30T23:27:40.782626+0000","last_active":"2023-11-30T23:27:48.409635+0000","last_peered":"2023-11-30T23:27:48.409635+0000","last_clean":"2023-11-30T23:27:48.409635+0000","last_became_active":"2023-11-30T23:12:47.516980+0000","last_became_peered":"2023-11-30T23:12:47.516980+0000","last_unstale":"2023-11-30T23:27:48.409635+0000","last_undegraded":"2023-11-30T23:27:48.409635+0000","last_fullsized":"2023-11-30T23:27:48.409635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3496,"log_dups_size":0,"ondisk_log_size":3496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014912678,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"49'1321","reported_seq":1379,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:53.092041+0000","last_change":"2023-11-30T23:27:53.092378+0000","last_active":"2023-11-30T23:27:53.092041+0000","last_peered":"2023-11-30T23:27:53.092041+0000","last_clean":"2023-11-30T23:27:53.092041+0000","last_became_active":"2023-11-30T23:12:47.129349+0000","last_became_peered":"2023-11-30T23:12:47.129349+0000","last_unstale":"2023-11-30T23:27:53.092041+0000","last_undegraded":"2023-11-30T23:27:53.092041+0000","last_fullsized":"2023-11-30T23:27:53.092041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1321","last_scrub_stamp":"2023-11-30T23:27:53.091986+0000","last_deep_scrub":"49'1321","last_deep_scrub_stamp":"2023-11-30T23:27:53.091986+0000","last_clean_scrub_stamp":"2023-11-30T23:27:53.091986+0000","objects_scrubbed":21,"log_size":1321,"log_dups_size":0,"ondisk_log_size":1321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:10:18.115508+0000","scrub_duration":0.045828347999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":1371,"num_write_kb":13381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":104070,"num_omap_keys":207,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"48'3743","reported_seq":3066,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.913983+0000","last_change":"2023-11-30T23:27:40.775036+0000","last_active":"2023-11-30T23:27:48.913983+0000","last_peered":"2023-11-30T23:27:48.913983+0000","last_clean":"2023-11-30T23:27:48.913983+0000","last_became_active":"2023-11-30T23:12:47.514140+0000","last_became_peered":"2023-11-30T23:12:47.514140+0000","last_unstale":"2023-11-30T23:27:48.913983+0000","last_undegraded":"2023-11-30T23:27:48.913983+0000","last_fullsized":"2023-11-30T23:27:48.913983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3743,"log_dups_size":0,"ondisk_log_size":3743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0087768900000000007,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1241,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"49'1122","reported_seq":1180,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:54.893373+0000","last_change":"2023-11-30T23:27:54.893545+0000","last_active":"2023-11-30T23:27:54.893373+0000","last_peered":"2023-11-30T23:27:54.893373+0000","last_clean":"2023-11-30T23:27:54.893373+0000","last_became_active":"2023-11-30T23:12:47.136631+0000","last_became_peered":"2023-11-30T23:12:47.136631+0000","last_unstale":"2023-11-30T23:27:54.893373+0000","last_undegraded":"2023-11-30T23:27:54.893373+0000","last_fullsized":"2023-11-30T23:27:54.893373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1122","last_scrub_stamp":"2023-11-30T23:27:54.893334+0000","last_deep_scrub":"49'1122","last_deep_scrub_stamp":"2023-11-30T23:27:54.893334+0000","last_clean_scrub_stamp":"2023-11-30T23:27:54.893334+0000","objects_scrubbed":24,"log_size":1122,"log_dups_size":0,"ondisk_log_size":1122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:52:55.445683+0000","scrub_duration":0.067445020999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":1176,"num_write_kb":13385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":144754,"num_omap_keys":287,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"48'3434","reported_seq":2837,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.914851+0000","last_change":"2023-11-30T23:27:40.773928+0000","last_active":"2023-11-30T23:27:48.914851+0000","last_peered":"2023-11-30T23:27:48.914851+0000","last_clean":"2023-11-30T23:27:48.914851+0000","last_became_active":"2023-11-30T23:12:47.514053+0000","last_became_peered":"2023-11-30T23:12:47.514053+0000","last_unstale":"2023-11-30T23:27:48.914851+0000","last_undegraded":"2023-11-30T23:27:48.914851+0000","last_fullsized":"2023-11-30T23:27:48.914851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0080231629999999998,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"49'2054","reported_seq":2112,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:51.134718+0000","last_change":"2023-11-30T23:27:51.134903+0000","last_active":"2023-11-30T23:27:51.134718+0000","last_peered":"2023-11-30T23:27:51.134718+0000","last_clean":"2023-11-30T23:27:51.134718+0000","last_became_active":"2023-11-30T23:12:47.137695+0000","last_became_peered":"2023-11-30T23:12:47.137695+0000","last_unstale":"2023-11-30T23:27:51.134718+0000","last_undegraded":"2023-11-30T23:27:51.134718+0000","last_fullsized":"2023-11-30T23:27:51.134718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'2054","last_scrub_stamp":"2023-11-30T23:27:51.134674+0000","last_deep_scrub":"49'2054","last_deep_scrub_stamp":"2023-11-30T23:27:51.134674+0000","last_clean_scrub_stamp":"2023-11-30T23:27:51.134674+0000","objects_scrubbed":19,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:52:51.687024+0000","scrub_duration":0.047092548999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":2104,"num_write_kb":13092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":111684,"num_omap_keys":222,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"48'3567","reported_seq":2931,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.915981+0000","last_change":"2023-11-30T23:27:40.778859+0000","last_active":"2023-11-30T23:27:48.915981+0000","last_peered":"2023-11-30T23:27:48.915981+0000","last_clean":"2023-11-30T23:27:48.915981+0000","last_became_active":"2023-11-30T23:12:47.514822+0000","last_became_peered":"2023-11-30T23:12:47.514822+0000","last_unstale":"2023-11-30T23:27:48.915981+0000","last_undegraded":"2023-11-30T23:27:48.915981+0000","last_fullsized":"2023-11-30T23:27:48.915981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3567,"log_dups_size":0,"ondisk_log_size":3567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076646960000000004,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"49'4620","reported_seq":4680,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:55.010629+0000","last_change":"2023-11-30T23:27:55.010759+0000","last_active":"2023-11-30T23:27:55.010629+0000","last_peered":"2023-11-30T23:27:55.010629+0000","last_clean":"2023-11-30T23:27:55.010629+0000","last_became_active":"2023-11-30T23:12:47.128682+0000","last_became_peered":"2023-11-30T23:12:47.128682+0000","last_unstale":"2023-11-30T23:27:55.010629+0000","last_undegraded":"2023-11-30T23:27:55.010629+0000","last_fullsized":"2023-11-30T23:27:55.010629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4620","last_scrub_stamp":"2023-11-30T23:27:55.010606+0000","last_deep_scrub":"49'4620","last_deep_scrub_stamp":"2023-11-30T23:27:55.010606+0000","last_clean_scrub_stamp":"2023-11-30T23:27:55.010606+0000","objects_scrubbed":25,"log_size":4620,"log_dups_size":0,"ondisk_log_size":4620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:18:38.031596+0000","scrub_duration":0.1011722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583127,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":4657,"num_write_kb":26783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":151374,"num_omap_keys":301,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"48'3659","reported_seq":2967,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.070207+0000","last_change":"2023-11-30T23:27:40.521110+0000","last_active":"2023-11-30T23:27:49.070207+0000","last_peered":"2023-11-30T23:27:49.070207+0000","last_clean":"2023-11-30T23:27:49.070207+0000","last_became_active":"2023-11-30T23:12:47.516317+0000","last_became_peered":"2023-11-30T23:12:47.516317+0000","last_unstale":"2023-11-30T23:27:49.070207+0000","last_undegraded":"2023-11-30T23:27:49.070207+0000","last_fullsized":"2023-11-30T23:27:49.070207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3659,"log_dups_size":0,"ondisk_log_size":3659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018738761999999999,"stat_sum":{"num_bytes":16384,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1262,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"49'4380","reported_seq":4438,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:58.156912+0000","last_change":"2023-11-30T23:27:58.157082+0000","last_active":"2023-11-30T23:27:58.156912+0000","last_peered":"2023-11-30T23:27:58.156912+0000","last_clean":"2023-11-30T23:27:58.156912+0000","last_became_active":"2023-11-30T23:12:47.140400+0000","last_became_peered":"2023-11-30T23:12:47.140400+0000","last_unstale":"2023-11-30T23:27:58.156912+0000","last_undegraded":"2023-11-30T23:27:58.156912+0000","last_fullsized":"2023-11-30T23:27:58.156912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4380","last_scrub_stamp":"2023-11-30T23:27:58.156885+0000","last_deep_scrub":"49'4380","last_deep_scrub_stamp":"2023-11-30T23:27:58.156885+0000","last_clean_scrub_stamp":"2023-11-30T23:27:58.156885+0000","objects_scrubbed":18,"log_size":4380,"log_dups_size":0,"ondisk_log_size":4380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:18:41.177875+0000","scrub_duration":0.083489562000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4418,"num_write_kb":27644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73070,"num_omap_keys":145,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"48'3509","reported_seq":2936,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.914926+0000","last_change":"2023-11-30T23:27:40.776512+0000","last_active":"2023-11-30T23:27:48.914926+0000","last_peered":"2023-11-30T23:27:48.914926+0000","last_clean":"2023-11-30T23:27:48.914926+0000","last_became_active":"2023-11-30T23:12:47.521481+0000","last_became_peered":"2023-11-30T23:12:47.521481+0000","last_unstale":"2023-11-30T23:27:48.914926+0000","last_undegraded":"2023-11-30T23:27:48.914926+0000","last_fullsized":"2023-11-30T23:27:48.914926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3509,"log_dups_size":0,"ondisk_log_size":3509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010302225,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1071,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"49'119","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:58.842711+0000","last_change":"2023-11-30T23:27:58.842999+0000","last_active":"2023-11-30T23:27:58.842711+0000","last_peered":"2023-11-30T23:27:58.842711+0000","last_clean":"2023-11-30T23:27:58.842711+0000","last_became_active":"2023-11-30T23:12:36.556455+0000","last_became_peered":"2023-11-30T23:12:36.556455+0000","last_unstale":"2023-11-30T23:27:58.842711+0000","last_undegraded":"2023-11-30T23:27:58.842711+0000","last_fullsized":"2023-11-30T23:27:58.842711+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'119","last_scrub_stamp":"2023-11-30T23:27:58.842660+0000","last_deep_scrub":"49'119","last_deep_scrub_stamp":"2023-11-30T23:27:58.842660+0000","last_clean_scrub_stamp":"2023-11-30T23:27:58.842660+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:48:55.539093+0000","scrub_duration":0.013295479000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"48'933","reported_seq":981,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.069456+0000","last_change":"2023-11-30T23:12:47.132985+0000","last_active":"2023-11-30T23:27:49.069456+0000","last_peered":"2023-11-30T23:27:49.069456+0000","last_clean":"2023-11-30T23:27:49.069456+0000","last_became_active":"2023-11-30T23:12:47.132365+0000","last_became_peered":"2023-11-30T23:12:47.132365+0000","last_unstale":"2023-11-30T23:27:49.069456+0000","last_undegraded":"2023-11-30T23:27:49.069456+0000","last_fullsized":"2023-11-30T23:27:49.069456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":1011,"num_write_kb":13216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"48'3463","reported_seq":2901,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.541242+0000","last_change":"2023-11-30T23:27:40.529546+0000","last_active":"2023-11-30T23:27:48.541242+0000","last_peered":"2023-11-30T23:27:48.541242+0000","last_clean":"2023-11-30T23:27:48.541242+0000","last_became_active":"2023-11-30T23:12:47.508677+0000","last_became_peered":"2023-11-30T23:12:47.508677+0000","last_unstale":"2023-11-30T23:27:48.541242+0000","last_undegraded":"2023-11-30T23:27:48.541242+0000","last_fullsized":"2023-11-30T23:27:48.541242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3463,"log_dups_size":0,"ondisk_log_size":3463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029660272000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1097,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"49'3532","reported_seq":3591,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:03.939565+0000","last_change":"2023-11-30T23:28:03.939708+0000","last_active":"2023-11-30T23:28:03.939565+0000","last_peered":"2023-11-30T23:28:03.939565+0000","last_clean":"2023-11-30T23:28:03.939565+0000","last_became_active":"2023-11-30T23:12:47.148547+0000","last_became_peered":"2023-11-30T23:12:47.148547+0000","last_unstale":"2023-11-30T23:28:03.939565+0000","last_undegraded":"2023-11-30T23:28:03.939565+0000","last_fullsized":"2023-11-30T23:28:03.939565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3532","last_scrub_stamp":"2023-11-30T23:28:03.939542+0000","last_deep_scrub":"49'3532","last_deep_scrub_stamp":"2023-11-30T23:28:03.939542+0000","last_clean_scrub_stamp":"2023-11-30T23:28:03.939542+0000","objects_scrubbed":20,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:18:39.587422+0000","scrub_duration":0.077305334000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":3602,"num_write_kb":26128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":119298,"num_omap_keys":237,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"48'3481","reported_seq":2877,"reported_epoch":49,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-30T23:27:48.402494+0000","last_change":"2023-11-30T23:27:56.567585+0000","last_active":"2023-11-30T23:27:48.402494+0000","last_peered":"2023-11-30T23:27:48.402494+0000","last_clean":"2023-11-30T23:27:48.402494+0000","last_became_active":"2023-11-30T23:12:47.515553+0000","last_became_peered":"2023-11-30T23:12:47.515553+0000","last_unstale":"2023-11-30T23:27:48.402494+0000","last_undegraded":"2023-11-30T23:27:48.402494+0000","last_fullsized":"2023-11-30T23:27:48.402494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021186228000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1162,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"49'2714","reported_seq":3288,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:52.126094+0000","last_change":"2023-11-30T23:27:52.126287+0000","last_active":"2023-11-30T23:27:52.126094+0000","last_peered":"2023-11-30T23:27:52.126094+0000","last_clean":"2023-11-30T23:27:52.126094+0000","last_became_active":"2023-11-30T23:12:47.135746+0000","last_became_peered":"2023-11-30T23:12:47.135746+0000","last_unstale":"2023-11-30T23:27:52.126094+0000","last_undegraded":"2023-11-30T23:27:52.126094+0000","last_fullsized":"2023-11-30T23:27:52.126094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'2714","last_scrub_stamp":"2023-11-30T23:27:52.126064+0000","last_deep_scrub":"49'2714","last_deep_scrub_stamp":"2023-11-30T23:27:52.126064+0000","last_clean_scrub_stamp":"2023-11-30T23:27:52.126064+0000","objects_scrubbed":20,"log_size":2714,"log_dups_size":0,"ondisk_log_size":2714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:01:47.118270+0000","scrub_duration":0.050486340999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3169767,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":530,"num_read_kb":3420,"num_write":2759,"num_write_kb":16501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":122836,"num_omap_keys":244,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"48'3593","reported_seq":2964,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.885287+0000","last_change":"2023-11-30T23:27:40.472409+0000","last_active":"2023-11-30T23:27:48.885287+0000","last_peered":"2023-11-30T23:27:48.885287+0000","last_clean":"2023-11-30T23:27:48.885287+0000","last_became_active":"2023-11-30T23:12:47.510024+0000","last_became_peered":"2023-11-30T23:12:47.510024+0000","last_unstale":"2023-11-30T23:27:48.885287+0000","last_undegraded":"2023-11-30T23:27:48.885287+0000","last_fullsized":"2023-11-30T23:27:48.885287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3593,"log_dups_size":0,"ondisk_log_size":3593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045211289000000002,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"49'4604","reported_seq":4663,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:08.371552+0000","last_change":"2023-11-30T23:28:08.371721+0000","last_active":"2023-11-30T23:28:08.371552+0000","last_peered":"2023-11-30T23:28:08.371552+0000","last_clean":"2023-11-30T23:28:08.371552+0000","last_became_active":"2023-11-30T23:12:47.141115+0000","last_became_peered":"2023-11-30T23:12:47.141115+0000","last_unstale":"2023-11-30T23:28:08.371552+0000","last_undegraded":"2023-11-30T23:28:08.371552+0000","last_fullsized":"2023-11-30T23:28:08.371552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4604","last_scrub_stamp":"2023-11-30T23:28:08.371526+0000","last_deep_scrub":"49'4604","last_deep_scrub_stamp":"2023-11-30T23:28:08.371526+0000","last_clean_scrub_stamp":"2023-11-30T23:28:08.371526+0000","objects_scrubbed":22,"log_size":4604,"log_dups_size":0,"ondisk_log_size":4604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:56:24.253918+0000","scrub_duration":0.097972583000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":4625,"num_write_kb":30671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":111760,"num_omap_keys":222,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"48'3767","reported_seq":3109,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:55.873932+0000","last_change":"2023-11-30T23:27:55.874045+0000","last_active":"2023-11-30T23:27:55.873932+0000","last_peered":"2023-11-30T23:27:55.873932+0000","last_clean":"2023-11-30T23:27:55.873932+0000","last_became_active":"2023-11-30T23:12:47.514572+0000","last_became_peered":"2023-11-30T23:12:47.514572+0000","last_unstale":"2023-11-30T23:27:55.873932+0000","last_undegraded":"2023-11-30T23:27:55.873932+0000","last_fullsized":"2023-11-30T23:27:55.873932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3767","last_scrub_stamp":"2023-11-30T23:27:55.873914+0000","last_deep_scrub":"48'3767","last_deep_scrub_stamp":"2023-11-30T23:27:55.873914+0000","last_clean_scrub_stamp":"2023-11-30T23:27:55.873914+0000","objects_scrubbed":0,"log_size":3767,"log_dups_size":0,"ondisk_log_size":3767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:01:50.866119+0000","scrub_duration":0.037263154,"objects_trimmed":0,"snaptrim_duration":0.010674993000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"49'168","reported_seq":227,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:02.037975+0000","last_change":"2023-11-30T23:28:02.038132+0000","last_active":"2023-11-30T23:28:02.037975+0000","last_peered":"2023-11-30T23:28:02.037975+0000","last_clean":"2023-11-30T23:28:02.037975+0000","last_became_active":"2023-11-30T23:12:47.141411+0000","last_became_peered":"2023-11-30T23:12:47.141411+0000","last_unstale":"2023-11-30T23:28:02.037975+0000","last_undegraded":"2023-11-30T23:28:02.037975+0000","last_fullsized":"2023-11-30T23:28:02.037975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'168","last_scrub_stamp":"2023-11-30T23:28:02.037952+0000","last_deep_scrub":"49'168","last_deep_scrub_stamp":"2023-11-30T23:28:02.037952+0000","last_clean_scrub_stamp":"2023-11-30T23:28:02.037952+0000","objects_scrubbed":15,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:48:58.734385+0000","scrub_duration":0.042734723000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":238,"num_write_kb":8770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":93108,"num_omap_keys":185,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"48'3575","reported_seq":2932,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.070332+0000","last_change":"2023-11-30T23:27:40.519690+0000","last_active":"2023-11-30T23:27:49.070332+0000","last_peered":"2023-11-30T23:27:49.070332+0000","last_clean":"2023-11-30T23:27:49.070332+0000","last_became_active":"2023-11-30T23:13:30.305367+0000","last_became_peered":"2023-11-30T23:13:30.305367+0000","last_unstale":"2023-11-30T23:27:49.070332+0000","last_undegraded":"2023-11-30T23:27:49.070332+0000","last_fullsized":"2023-11-30T23:27:49.070332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3575,"log_dups_size":0,"ondisk_log_size":3575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017828157000000001,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"49'2067","reported_seq":2126,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:07.980476+0000","last_change":"2023-11-30T23:28:07.980660+0000","last_active":"2023-11-30T23:28:07.980476+0000","last_peered":"2023-11-30T23:28:07.980476+0000","last_clean":"2023-11-30T23:28:07.980476+0000","last_became_active":"2023-11-30T23:12:47.143061+0000","last_became_peered":"2023-11-30T23:12:47.143061+0000","last_unstale":"2023-11-30T23:28:07.980476+0000","last_undegraded":"2023-11-30T23:28:07.980476+0000","last_fullsized":"2023-11-30T23:28:07.980476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'2067","last_scrub_stamp":"2023-11-30T23:28:07.980446+0000","last_deep_scrub":"49'2067","last_deep_scrub_stamp":"2023-11-30T23:28:07.980446+0000","last_clean_scrub_stamp":"2023-11-30T23:28:07.980446+0000","objects_scrubbed":11,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:56:23.862838+0000","scrub_duration":0.039739874000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":2145,"num_write_kb":21845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":71684,"num_omap_keys":142,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"48'3505","reported_seq":2897,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.885165+0000","last_change":"2023-11-30T23:27:40.468495+0000","last_active":"2023-11-30T23:27:48.885165+0000","last_peered":"2023-11-30T23:27:48.885165+0000","last_clean":"2023-11-30T23:27:48.885165+0000","last_became_active":"2023-11-30T23:12:47.501516+0000","last_became_peered":"2023-11-30T23:12:47.501516+0000","last_unstale":"2023-11-30T23:27:48.885165+0000","last_undegraded":"2023-11-30T23:27:48.885165+0000","last_fullsized":"2023-11-30T23:27:48.885165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040930987000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"49'2130","reported_seq":2189,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:59.120106+0000","last_change":"2023-11-30T23:27:59.120106+0000","last_active":"2023-11-30T23:27:59.120106+0000","last_peered":"2023-11-30T23:27:59.120106+0000","last_clean":"2023-11-30T23:27:59.120106+0000","last_became_active":"2023-11-30T23:12:47.134776+0000","last_became_peered":"2023-11-30T23:12:47.134776+0000","last_unstale":"2023-11-30T23:27:59.120106+0000","last_undegraded":"2023-11-30T23:27:59.120106+0000","last_fullsized":"2023-11-30T23:27:59.120106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'2130","last_scrub_stamp":"2023-11-30T23:27:59.119884+0000","last_deep_scrub":"49'2130","last_deep_scrub_stamp":"2023-11-30T23:27:59.119884+0000","last_clean_scrub_stamp":"2023-11-30T23:27:59.119884+0000","objects_scrubbed":23,"log_size":2130,"log_dups_size":0,"ondisk_log_size":2130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:04.605281+0000","scrub_duration":0.153358732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":2452,"num_write_kb":16294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":130911,"num_omap_keys":260,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"49'3246","reported_seq":2673,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:04.785742+0000","last_change":"2023-11-30T23:28:04.785911+0000","last_active":"2023-11-30T23:28:04.785742+0000","last_peered":"2023-11-30T23:28:04.785742+0000","last_clean":"2023-11-30T23:28:04.785742+0000","last_became_active":"2023-11-30T23:12:47.498631+0000","last_became_peered":"2023-11-30T23:12:47.498631+0000","last_unstale":"2023-11-30T23:28:04.785742+0000","last_undegraded":"2023-11-30T23:28:04.785742+0000","last_fullsized":"2023-11-30T23:28:04.785742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3246","last_scrub_stamp":"2023-11-30T23:28:04.785710+0000","last_deep_scrub":"49'3246","last_deep_scrub_stamp":"2023-11-30T23:28:04.785710+0000","last_clean_scrub_stamp":"2023-11-30T23:28:04.785710+0000","objects_scrubbed":1,"log_size":3246,"log_dups_size":0,"ondisk_log_size":3246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:49:01.482143+0000","scrub_duration":0.043044225999999998,"objects_trimmed":0,"snaptrim_duration":0.033287613000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1095,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"49'1702","reported_seq":1761,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:51.521544+0000","last_change":"2023-11-30T23:27:51.521544+0000","last_active":"2023-11-30T23:27:51.521544+0000","last_peered":"2023-11-30T23:27:51.521544+0000","last_clean":"2023-11-30T23:27:51.521544+0000","last_became_active":"2023-11-30T23:12:47.137406+0000","last_became_peered":"2023-11-30T23:12:47.137406+0000","last_unstale":"2023-11-30T23:27:51.521544+0000","last_undegraded":"2023-11-30T23:27:51.521544+0000","last_fullsized":"2023-11-30T23:27:51.521544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1702","last_scrub_stamp":"2023-11-30T23:27:51.521408+0000","last_deep_scrub":"49'1702","last_deep_scrub_stamp":"2023-11-30T23:27:51.521408+0000","last_clean_scrub_stamp":"2023-11-30T23:27:51.521408+0000","objects_scrubbed":16,"log_size":1702,"log_dups_size":0,"ondisk_log_size":1702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:10:16.544929+0000","scrub_duration":0.038042897999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":1761,"num_write_kb":9276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":90070,"num_omap_keys":179,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"48'3472","reported_seq":2879,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.403292+0000","last_change":"2023-11-30T23:27:40.571283+0000","last_active":"2023-11-30T23:27:48.403292+0000","last_peered":"2023-11-30T23:27:48.403292+0000","last_clean":"2023-11-30T23:27:48.403292+0000","last_became_active":"2023-11-30T23:12:47.506447+0000","last_became_peered":"2023-11-30T23:12:47.506447+0000","last_unstale":"2023-11-30T23:27:48.403292+0000","last_undegraded":"2023-11-30T23:27:48.403292+0000","last_fullsized":"2023-11-30T23:27:48.403292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3472,"log_dups_size":0,"ondisk_log_size":3472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037907362999999999,"stat_sum":{"num_bytes":4105,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1170,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"41'1548","reported_seq":1596,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:51.774663+0000","last_change":"2023-11-30T23:12:47.142532+0000","last_active":"2023-11-30T23:27:51.774663+0000","last_peered":"2023-11-30T23:27:51.774663+0000","last_clean":"2023-11-30T23:27:51.774663+0000","last_became_active":"2023-11-30T23:12:47.142135+0000","last_became_peered":"2023-11-30T23:12:47.142135+0000","last_unstale":"2023-11-30T23:27:51.774663+0000","last_undegraded":"2023-11-30T23:27:51.774663+0000","last_fullsized":"2023-11-30T23:27:51.774663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":1548,"log_dups_size":0,"ondisk_log_size":1548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":1654,"num_write_kb":9390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"49'3432","reported_seq":2823,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:01.796529+0000","last_change":"2023-11-30T23:28:01.796633+0000","last_active":"2023-11-30T23:28:01.796529+0000","last_peered":"2023-11-30T23:28:01.796529+0000","last_clean":"2023-11-30T23:28:01.796529+0000","last_became_active":"2023-11-30T23:12:47.513966+0000","last_became_peered":"2023-11-30T23:12:47.513966+0000","last_unstale":"2023-11-30T23:28:01.796529+0000","last_undegraded":"2023-11-30T23:28:01.796529+0000","last_fullsized":"2023-11-30T23:28:01.796529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3432","last_scrub_stamp":"2023-11-30T23:28:01.796504+0000","last_deep_scrub":"49'3432","last_deep_scrub_stamp":"2023-11-30T23:28:01.796504+0000","last_clean_scrub_stamp":"2023-11-30T23:28:01.796504+0000","objects_scrubbed":1,"log_size":3432,"log_dups_size":0,"ondisk_log_size":3432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:18:44.817494+0000","scrub_duration":0.040597133000000001,"objects_trimmed":0,"snaptrim_duration":0.003646318,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"49'2309","reported_seq":2368,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.983621+0000","last_change":"2023-11-30T23:27:49.983621+0000","last_active":"2023-11-30T23:27:49.983621+0000","last_peered":"2023-11-30T23:27:49.983621+0000","last_clean":"2023-11-30T23:27:49.983621+0000","last_became_active":"2023-11-30T23:12:47.140565+0000","last_became_peered":"2023-11-30T23:12:47.140565+0000","last_unstale":"2023-11-30T23:27:49.983621+0000","last_undegraded":"2023-11-30T23:27:49.983621+0000","last_fullsized":"2023-11-30T23:27:49.983621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'2309","last_scrub_stamp":"2023-11-30T23:27:49.983450+0000","last_deep_scrub":"49'2309","last_deep_scrub_stamp":"2023-11-30T23:27:49.983450+0000","last_clean_scrub_stamp":"2023-11-30T23:27:49.983450+0000","objects_scrubbed":14,"log_size":2309,"log_dups_size":0,"ondisk_log_size":2309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:03:38.592123+0000","scrub_duration":0.051593888999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":2336,"num_write_kb":17365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":84032,"num_omap_keys":167,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'3595","reported_seq":2945,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.809100+0000","last_change":"2023-11-30T23:27:40.526518+0000","last_active":"2023-11-30T23:27:49.809100+0000","last_peered":"2023-11-30T23:27:49.809100+0000","last_clean":"2023-11-30T23:27:49.809100+0000","last_became_active":"2023-11-30T23:12:47.501315+0000","last_became_peered":"2023-11-30T23:12:47.501315+0000","last_unstale":"2023-11-30T23:27:49.809100+0000","last_undegraded":"2023-11-30T23:27:49.809100+0000","last_fullsized":"2023-11-30T23:27:49.809100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026736012999999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"49'2886","reported_seq":2945,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:07.112372+0000","last_change":"2023-11-30T23:28:07.112567+0000","last_active":"2023-11-30T23:28:07.112372+0000","last_peered":"2023-11-30T23:28:07.112372+0000","last_clean":"2023-11-30T23:28:07.112372+0000","last_became_active":"2023-11-30T23:12:47.140037+0000","last_became_peered":"2023-11-30T23:12:47.140037+0000","last_unstale":"2023-11-30T23:28:07.112372+0000","last_undegraded":"2023-11-30T23:28:07.112372+0000","last_fullsized":"2023-11-30T23:28:07.112372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'2886","last_scrub_stamp":"2023-11-30T23:28:07.112328+0000","last_deep_scrub":"49'2886","last_deep_scrub_stamp":"2023-11-30T23:28:07.112328+0000","last_clean_scrub_stamp":"2023-11-30T23:28:07.112328+0000","objects_scrubbed":15,"log_size":2886,"log_dups_size":0,"ondisk_log_size":2886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:18:42.760209+0000","scrub_duration":0.079742007000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":2935,"num_write_kb":26081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":70994,"num_omap_keys":141,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"48'3359","reported_seq":2774,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.541724+0000","last_change":"2023-11-30T23:27:40.530235+0000","last_active":"2023-11-30T23:27:48.541724+0000","last_peered":"2023-11-30T23:27:48.541724+0000","last_clean":"2023-11-30T23:27:48.541724+0000","last_became_active":"2023-11-30T23:12:47.507181+0000","last_became_peered":"2023-11-30T23:12:47.507181+0000","last_unstale":"2023-11-30T23:27:48.541724+0000","last_undegraded":"2023-11-30T23:27:48.541724+0000","last_fullsized":"2023-11-30T23:27:48.541724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030024714000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"41'4584","reported_seq":4631,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.914430+0000","last_change":"2023-11-30T23:12:47.142027+0000","last_active":"2023-11-30T23:27:48.914430+0000","last_peered":"2023-11-30T23:27:48.914430+0000","last_clean":"2023-11-30T23:27:48.914430+0000","last_became_active":"2023-11-30T23:12:47.141664+0000","last_became_peered":"2023-11-30T23:12:47.141664+0000","last_unstale":"2023-11-30T23:27:48.914430+0000","last_undegraded":"2023-11-30T23:27:48.914430+0000","last_fullsized":"2023-11-30T23:27:48.914430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4584,"log_dups_size":0,"ondisk_log_size":4584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4647,"num_write_kb":30581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"48'3589","reported_seq":2933,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:51.274344+0000","last_change":"2023-11-30T23:27:40.782695+0000","last_active":"2023-11-30T23:27:51.274344+0000","last_peered":"2023-11-30T23:27:51.274344+0000","last_clean":"2023-11-30T23:27:51.274344+0000","last_became_active":"2023-11-30T23:12:47.516939+0000","last_became_peered":"2023-11-30T23:12:47.516939+0000","last_unstale":"2023-11-30T23:27:51.274344+0000","last_undegraded":"2023-11-30T23:27:51.274344+0000","last_fullsized":"2023-11-30T23:27:51.274344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3589,"log_dups_size":0,"ondisk_log_size":3589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014334588000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"48'3872","reported_seq":3224,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.073356+0000","last_change":"2023-11-30T23:27:40.517369+0000","last_active":"2023-11-30T23:27:49.073356+0000","last_peered":"2023-11-30T23:27:49.073356+0000","last_clean":"2023-11-30T23:27:49.073356+0000","last_became_active":"2023-11-30T23:12:47.521310+0000","last_became_peered":"2023-11-30T23:12:47.521310+0000","last_unstale":"2023-11-30T23:27:49.073356+0000","last_undegraded":"2023-11-30T23:27:49.073356+0000","last_fullsized":"2023-11-30T23:27:49.073356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3872,"log_dups_size":0,"ondisk_log_size":3872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015666933000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"43'622","reported_seq":669,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.080696+0000","last_change":"2023-11-30T23:12:47.143819+0000","last_active":"2023-11-30T23:27:49.080696+0000","last_peered":"2023-11-30T23:27:49.080696+0000","last_clean":"2023-11-30T23:27:49.080696+0000","last_became_active":"2023-11-30T23:12:47.143512+0000","last_became_peered":"2023-11-30T23:12:47.143512+0000","last_unstale":"2023-11-30T23:27:49.080696+0000","last_undegraded":"2023-11-30T23:27:49.080696+0000","last_fullsized":"2023-11-30T23:27:49.080696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":689,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"48'3820","reported_seq":3130,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.073315+0000","last_change":"2023-11-30T23:27:40.520201+0000","last_active":"2023-11-30T23:27:49.073315+0000","last_peered":"2023-11-30T23:27:49.073315+0000","last_clean":"2023-11-30T23:27:49.073315+0000","last_became_active":"2023-11-30T23:12:47.520322+0000","last_became_peered":"2023-11-30T23:12:47.520322+0000","last_unstale":"2023-11-30T23:27:49.073315+0000","last_undegraded":"2023-11-30T23:27:49.073315+0000","last_fullsized":"2023-11-30T23:27:49.073315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3820,"log_dups_size":0,"ondisk_log_size":3820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018218595000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"41'4570","reported_seq":4617,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.080716+0000","last_change":"2023-11-30T23:12:47.142276+0000","last_active":"2023-11-30T23:27:49.080716+0000","last_peered":"2023-11-30T23:27:49.080716+0000","last_clean":"2023-11-30T23:27:49.080716+0000","last_became_active":"2023-11-30T23:12:47.141965+0000","last_became_peered":"2023-11-30T23:12:47.141965+0000","last_unstale":"2023-11-30T23:27:49.080716+0000","last_undegraded":"2023-11-30T23:27:49.080716+0000","last_fullsized":"2023-11-30T23:27:49.080716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:46.087493+0000","last_clean_scrub_stamp":"2023-11-30T23:12:46.087493+0000","objects_scrubbed":0,"log_size":4570,"log_dups_size":0,"ondisk_log_size":4570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4627,"num_write_kb":34948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"48'3352","reported_seq":2794,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.403303+0000","last_change":"2023-11-30T23:27:40.554745+0000","last_active":"2023-11-30T23:27:48.403303+0000","last_peered":"2023-11-30T23:27:48.403303+0000","last_clean":"2023-11-30T23:27:48.403303+0000","last_became_active":"2023-11-30T23:12:47.522002+0000","last_became_peered":"2023-11-30T23:12:47.522002+0000","last_unstale":"2023-11-30T23:27:48.403303+0000","last_undegraded":"2023-11-30T23:27:48.403303+0000","last_fullsized":"2023-11-30T23:27:48.403303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3352,"log_dups_size":0,"ondisk_log_size":3352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025109995999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1079,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"49'4091","reported_seq":4150,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:51.788815+0000","last_change":"2023-11-30T23:27:51.789032+0000","last_active":"2023-11-30T23:27:51.788815+0000","last_peered":"2023-11-30T23:27:51.788815+0000","last_clean":"2023-11-30T23:27:51.788815+0000","last_became_active":"2023-11-30T23:12:47.138275+0000","last_became_peered":"2023-11-30T23:12:47.138275+0000","last_unstale":"2023-11-30T23:27:51.788815+0000","last_undegraded":"2023-11-30T23:27:51.788815+0000","last_fullsized":"2023-11-30T23:27:51.788815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4091","last_scrub_stamp":"2023-11-30T23:27:51.788769+0000","last_deep_scrub":"49'4091","last_deep_scrub_stamp":"2023-11-30T23:27:51.788769+0000","last_clean_scrub_stamp":"2023-11-30T23:27:51.788769+0000","objects_scrubbed":23,"log_size":4091,"log_dups_size":0,"ondisk_log_size":4091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:01:46.780974+0000","scrub_duration":0.097030336999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":4121,"num_write_kb":30658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":137716,"num_omap_keys":273,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"49'3347","reported_seq":2761,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:01.772486+0000","last_change":"2023-11-30T23:28:01.772617+0000","last_active":"2023-11-30T23:28:01.772486+0000","last_peered":"2023-11-30T23:28:01.772486+0000","last_clean":"2023-11-30T23:28:01.772486+0000","last_became_active":"2023-11-30T23:12:47.508718+0000","last_became_peered":"2023-11-30T23:12:47.508718+0000","last_unstale":"2023-11-30T23:28:01.772486+0000","last_undegraded":"2023-11-30T23:28:01.772486+0000","last_fullsized":"2023-11-30T23:28:01.772486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3347","last_scrub_stamp":"2023-11-30T23:28:01.772467+0000","last_deep_scrub":"49'3347","last_deep_scrub_stamp":"2023-11-30T23:28:01.772467+0000","last_clean_scrub_stamp":"2023-11-30T23:28:01.772467+0000","objects_scrubbed":1,"log_size":3347,"log_dups_size":0,"ondisk_log_size":3347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:07.257864+0000","scrub_duration":0.049927862000000003,"objects_trimmed":0,"snaptrim_duration":0.037282159000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"49'807","reported_seq":866,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:54.540611+0000","last_change":"2023-11-30T23:27:54.540737+0000","last_active":"2023-11-30T23:27:54.540611+0000","last_peered":"2023-11-30T23:27:54.540611+0000","last_clean":"2023-11-30T23:27:54.540611+0000","last_became_active":"2023-11-30T23:12:47.140891+0000","last_became_peered":"2023-11-30T23:12:47.140891+0000","last_unstale":"2023-11-30T23:27:54.540611+0000","last_undegraded":"2023-11-30T23:27:54.540611+0000","last_fullsized":"2023-11-30T23:27:54.540611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'807","last_scrub_stamp":"2023-11-30T23:27:54.540586+0000","last_deep_scrub":"49'807","last_deep_scrub_stamp":"2023-11-30T23:27:54.540586+0000","last_clean_scrub_stamp":"2023-11-30T23:27:54.540586+0000","objects_scrubbed":17,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:52:55.092935+0000","scrub_duration":0.051767756999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":847,"num_write_kb":12818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":125846,"num_omap_keys":246,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":74679,"num_write_kb":40592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228881,"ondisk_log_size":228881,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":275279537,"num_objects":614,"num_object_clones":0,"num_object_copies":1228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":614,"num_whiteouts":0,"num_read":1037,"num_read_kb":3420,"num_write":81074,"num_write_kb":625818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":540,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2705360,"num_omap_keys":5366,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":550617088,"data_stored":550559074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79100,"ondisk_log_size":79100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":422580,"kb_used_data":70828,"kb_used_omap":0,"kb_used_meta":351744,"kb_avail":93949260,"statfs":{"total":96636764160,"available":96204042240,"internally_reserved":0,"allocated":72527872,"data_stored":72184368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":360185856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69499999999999995,"15min":0.70399999999999996},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.748},{"interface":"front","average":{"1min":1.1639999999999999,"5min":0.84699999999999998,"15min":0.78900000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":6.9429999999999996,"5min":6.9429999999999996,"15min":6.9429999999999996},"last":0.94599999999999995}]},{"osd":1,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.81699999999999995,"15min":0.81399999999999995},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":7.0540000000000003,"5min":7.0540000000000003,"15min":7.0540000000000003},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.751},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.873}]},{"osd":2,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.84699999999999998,"15min":0.83099999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":5.54,"5min":5.54,"15min":5.54},"last":0.999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":5.5880000000000001,"5min":5.5880000000000001,"15min":5.5880000000000001},"last":0.82099999999999995}]},{"osd":3,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":0.94999999999999996,"15min":0.90100000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.41499999999999998},"max":{"1min":4.6440000000000001,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":1.115},{"interface":"front","average":{"1min":1.022,"5min":0.95999999999999996,"15min":0.96299999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":4.6589999999999998,"5min":4.6589999999999998,"15min":4.6589999999999998},"last":1.046}]},{"osd":4,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.68799999999999994,"15min":0.77500000000000002},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.314},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3759999999999999},"last":1.069},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.81100000000000005,"15min":0.88100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.175}]},{"osd":5,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.79200000000000004,"15min":0.875},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.6719999999999999,"5min":1.7110000000000001,"15min":1.7210000000000001},"last":1.097},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.81599999999999995,"15min":0.88500000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6379999999999999,"5min":1.796,"15min":1.796},"last":1.1990000000000001}]},{"osd":6,"last update":"Thu Nov 30 23:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.86599999999999999,"15min":0.94499999999999995},"min":{"1min":0.38300000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.694,"5min":1.694,"15min":2.9670000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.92300000000000004,"15min":0.97899999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.226}]}]},{"osd":6,"up_from":13,"seq":55834575038,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":346012,"kb_used_data":90196,"kb_used_omap":0,"kb_used_meta":255808,"kb_avail":94025828,"statfs":{"total":96636764160,"available":96282447872,"internally_reserved":0,"allocated":92360704,"data_stored":92035739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":261947392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70199999999999996,"15min":0.73199999999999998},"min":{"1min":0.27100000000000002,"5min":0.23999999999999999,"15min":0.221},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.5640000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.77000000000000002,"15min":0.78400000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":3.4670000000000001,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":1.0289999999999999}]},{"osd":1,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.83199999999999996,"15min":0.86299999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":2.2210000000000001,"5min":5.851,"15min":12.172000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.33300000000000002},"max":{"1min":3.4420000000000002,"5min":3.4420000000000002,"15min":5.6980000000000004},"last":1.0900000000000001}]},{"osd":2,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.1800000000000002,"5min":2.327,"15min":2.327},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83999999999999997,"15min":0.86399999999999999},"min":{"1min":0.35999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.774},"last":1.1970000000000001}]},{"osd":3,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.873,"15min":0.873},"min":{"1min":0.434,"5min":0.434,"15min":0.38900000000000001},"max":{"1min":3.4889999999999999,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.871,"15min":0.86799999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":2.2029999999999998,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.94399999999999995}]},{"osd":4,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.83799999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.081,"5min":2.081,"15min":2.6429999999999998},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.878,"15min":0.88900000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35299999999999998},"max":{"1min":3.371,"5min":3.371,"15min":3.371},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.83899999999999997,"15min":0.84899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.1549999999999998,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.91000000000000003,"15min":0.97599999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":2.194,"5min":2.2400000000000002,"15min":2.7040000000000002},"last":1.2729999999999999}]},{"osd":7,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.101,"15min":1.0509999999999999},"min":{"1min":0.45700000000000002,"5min":0.45600000000000002,"15min":0.42499999999999999},"max":{"1min":3.4169999999999998,"5min":11.220000000000001,"15min":11.220000000000001},"last":1.155},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.0940000000000001,"15min":1.1399999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.2370000000000001,"5min":12.874000000000001,"15min":30.405999999999999},"last":1.173}]}]},{"osd":5,"up_from":13,"seq":55834575038,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":384304,"kb_used_data":86632,"kb_used_omap":0,"kb_used_meta":297664,"kb_avail":93987536,"statfs":{"total":96636764160,"available":96243236864,"internally_reserved":0,"allocated":88711168,"data_stored":88370710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304807936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":2.4260000000000002,"5min":0.98999999999999999,"15min":0.81599999999999995},"min":{"1min":0.55800000000000005,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":28.123000000000001,"5min":28.123000000000001,"15min":28.123000000000001},"last":1.125},{"interface":"front","average":{"1min":2.2080000000000002,"5min":1.0309999999999999,"15min":0.84299999999999997},"min":{"1min":0.56699999999999995,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":24.707000000000001,"5min":24.707000000000001,"15min":24.707000000000001},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":2.1230000000000002,"5min":1.0449999999999999,"15min":0.90300000000000002},"min":{"1min":0.47499999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":22.565999999999999,"5min":22.565999999999999,"15min":22.565999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":2.1560000000000001,"5min":1.0449999999999999,"15min":0.94399999999999995},"min":{"1min":0.68899999999999995,"5min":0.313,"15min":0.313},"max":{"1min":22.395,"5min":22.395,"15min":22.395},"last":1.046}]},{"osd":2,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":2.7519999999999998,"5min":1.1419999999999999,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.311,"15min":0.26700000000000002},"max":{"1min":33.149000000000001,"5min":33.149000000000001,"15min":33.149000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":2.101,"5min":1.036,"15min":0.91600000000000004},"min":{"1min":0.61099999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":22.699000000000002,"5min":22.699000000000002,"15min":22.699000000000002},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":2.1360000000000001,"5min":1.081,"15min":0.93300000000000005},"min":{"1min":0.629,"5min":0.314,"15min":0.314},"max":{"1min":22.943000000000001,"5min":22.943000000000001,"15min":22.943000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":2.4500000000000002,"5min":1.1419999999999999,"15min":1.0109999999999999},"min":{"1min":0.59399999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":27.643999999999998,"5min":27.643999999999998,"15min":27.643999999999998},"last":1.0089999999999999}]},{"osd":4,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.70099999999999996,"15min":0.80100000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.335,"5min":1.456,"15min":1.4930000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81899999999999995,"15min":0.85499999999999998},"min":{"1min":0.44600000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.3029999999999999,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.84599999999999997}]},{"osd":6,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":0.88700000000000001,"15min":0.90400000000000003},"min":{"1min":0.622,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":5.3719999999999999,"5min":5.3719999999999999,"15min":5.3719999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.996,"5min":0.86399999999999999,"15min":0.93200000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.9370000000000001,"5min":3.073,"15min":3.073},"last":1.1759999999999999}]},{"osd":7,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.89100000000000001,"15min":0.94199999999999995},"min":{"1min":0.41999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.4970000000000001,"5min":2.895,"15min":2.895},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.282,"5min":0.97499999999999998,"15min":0.995},"min":{"1min":0.52600000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":5.4139999999999997,"5min":5.4139999999999997,"15min":5.4139999999999997},"last":1.1950000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":349356,"kb_used_data":65636,"kb_used_omap":0,"kb_used_meta":283712,"kb_avail":94022484,"statfs":{"total":96636764160,"available":96279023616,"internally_reserved":0,"allocated":67211264,"data_stored":66877715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":290521088},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":0.81100000000000005,"15min":0.751},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":12.91,"5min":12.91,"15min":12.91},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.345,"5min":0.83299999999999996,"15min":0.77300000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":12.962,"5min":12.962,"15min":12.962},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.25600000000000001},"max":{"1min":4.8090000000000002,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":1.236},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.79900000000000004,"15min":0.78000000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":6.7839999999999998,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":0.92700000000000005}]},{"osd":2,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":0.83299999999999996,"15min":0.80900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":9.0229999999999997,"5min":9.0229999999999997,"15min":9.0229999999999997},"last":1.018},{"interface":"front","average":{"1min":1.143,"5min":0.92500000000000004,"15min":0.90500000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.33600000000000002},"max":{"1min":8.9990000000000006,"5min":8.9990000000000006,"15min":8.9990000000000006},"last":1.1359999999999999}]},{"osd":3,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.86899999999999999,"15min":0.85399999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":5.0209999999999999,"5min":5.0209999999999999,"15min":5.0209999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80800000000000005,"15min":0.82799999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":2.9489999999999998,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":0.873}]},{"osd":5,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":4.71,"5min":1.593,"15min":1.087},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":81.837000000000003,"5min":81.837000000000003,"15min":81.837000000000003},"last":0.97499999999999998},{"interface":"front","average":{"1min":4.8460000000000001,"5min":1.6930000000000001,"15min":1.179},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":81.751999999999995,"5min":81.751999999999995,"15min":81.751999999999995},"last":1.1859999999999999}]},{"osd":6,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":4.6379999999999999,"5min":1.5740000000000001,"15min":1.0920000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":79.655000000000001,"5min":79.655000000000001,"15min":79.655000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":4.7789999999999999,"5min":1.6830000000000001,"15min":1.2070000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":80.540000000000006,"5min":80.540000000000006,"15min":80.540000000000006},"last":1.3080000000000001}]},{"osd":7,"last update":"Thu Nov 30 23:27:11 2023","interfaces":[{"interface":"back","average":{"1min":4.8399999999999999,"5min":1.7190000000000001,"15min":1.206},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":80.486000000000004,"5min":80.486000000000004,"15min":80.486000000000004},"last":1.282},{"interface":"front","average":{"1min":5.0449999999999999,"5min":1.7150000000000001,"15min":1.2030000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":81.875,"5min":81.875,"15min":81.875},"last":1.0840000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575038,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370932,"kb_used_data":61036,"kb_used_omap":0,"kb_used_meta":309888,"kb_avail":94000908,"statfs":{"total":96636764160,"available":96256929792,"internally_reserved":0,"allocated":62500864,"data_stored":62176772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":317325312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":2.6589999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.26900000000000002,"5min":0.24299999999999999,"15min":0.23999999999999999},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.4750000000000001},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.125,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.74299999999999999,"15min":0.77100000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0960000000000001,"5min":1.256,"15min":4.8150000000000004},"last":0.89700000000000002}]},{"osd":2,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.77200000000000002,"15min":0.76900000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.28000000000000003},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.82899999999999996,"15min":0.84399999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.1259999999999999,"5min":1.3580000000000001,"15min":4.8719999999999999},"last":0.96499999999999997}]},{"osd":4,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.88500000000000001,"15min":0.89300000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.31},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":2.536},"last":0.874},{"interface":"front","average":{"1min":1.099,"5min":0.96199999999999997,"15min":0.95999999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.378},"max":{"1min":4.6820000000000004,"5min":4.6820000000000004,"15min":4.6820000000000004},"last":1.093}]},{"osd":5,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.0580000000000001,"15min":1.0189999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.42099999999999999},"max":{"1min":8.8010000000000002,"5min":8.8010000000000002,"15min":8.8010000000000002},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.98799999999999999,"15min":1.04},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1499999999999999,"5min":1.8500000000000001,"15min":4.9909999999999997},"last":1.0589999999999999}]},{"osd":6,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.0429999999999999,"15min":1.022},"min":{"1min":0.52700000000000002,"5min":0.52100000000000002,"15min":0.378},"max":{"1min":3.6699999999999999,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":1.024,"15min":1.0660000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.45500000000000002},"max":{"1min":1.1870000000000001,"5min":2.3530000000000002,"15min":4.4379999999999997},"last":1.2769999999999999}]},{"osd":7,"last update":"Thu Nov 30 23:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.038,"15min":1.085},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2629999999999999,"5min":1.4910000000000001,"15min":5.0369999999999999},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.056,"15min":1.073},"min":{"1min":0.47999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.214,"5min":2.214,"15min":2.5609999999999999},"last":1.206}]}]},{"osd":2,"up_from":13,"seq":55834575039,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224108,"kb_used_data":40548,"kb_used_omap":0,"kb_used_meta":183552,"kb_avail":94147732,"statfs":{"total":96636764160,"available":96407277568,"internally_reserved":0,"allocated":41521152,"data_stored":41200500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":187957248},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.432,"5min":0.216,"15min":0.216},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.41699999999999998,"5min":0.222,"15min":0.17999999999999999},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":0.97999999999999998,"15min":0.80300000000000005},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":18.102,"5min":18.102,"15min":18.102},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.749,"15min":0.77400000000000002},"min":{"1min":0.32200000000000001,"5min":0.27500000000000002,"15min":0.224},"max":{"1min":1.899,"5min":1.899,"15min":11.457000000000001},"last":1.0449999999999999}]},{"osd":3,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":2.198,"5min":1.087,"15min":0.83699999999999997},"min":{"1min":0.35799999999999998,"5min":0.224,"15min":0.224},"max":{"1min":29.039000000000001,"5min":29.039000000000001,"15min":29.039000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.876,"15min":0.85799999999999998},"min":{"1min":0.54400000000000004,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.85799999999999998,"15min":0.88300000000000001},"min":{"1min":0.44,"5min":0.30599999999999999,"15min":0.28299999999999997},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.278},{"interface":"front","average":{"1min":1,"5min":0.89500000000000002,"15min":0.879},"min":{"1min":0.59399999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.7160000000000002,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.89800000000000002}]},{"osd":5,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.997,"15min":1.0009999999999999},"min":{"1min":0.60899999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.829,"5min":2.323,"15min":2.323},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.401,"5min":1.073,"15min":1.024},"min":{"1min":0.47699999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":9.6150000000000002,"5min":9.6150000000000002,"15min":9.6150000000000002},"last":1.137}]},{"osd":6,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.02,"15min":0.97599999999999998},"min":{"1min":0.45700000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":3.7549999999999999,"5min":4.9420000000000002,"15min":4.9420000000000002},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.7270000000000001,"5min":1.1879999999999999,"15min":1.1080000000000001},"min":{"1min":0.65700000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":13.433,"5min":13.433,"15min":13.433},"last":1.085}]},{"osd":7,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.0649999999999999,"15min":1.0669999999999999},"min":{"1min":0.623,"5min":0.376,"15min":0.376},"max":{"1min":3.9399999999999999,"5min":3.9399999999999999,"15min":3.9399999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.1020000000000001,"15min":1.054},"min":{"1min":0.58399999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.782,"5min":3.782,"15min":3.782},"last":0.98299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575039,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396572,"kb_used_data":86612,"kb_used_omap":0,"kb_used_meta":309952,"kb_avail":93975268,"statfs":{"total":96636764160,"available":96230674432,"internally_reserved":0,"allocated":88690688,"data_stored":88358599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":317390848},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63600000000000001,"15min":0.60299999999999998},"min":{"1min":0.28499999999999998,"5min":0.24299999999999999,"15min":0.183},"max":{"1min":0.99399999999999999,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.67900000000000005,"15min":0.66500000000000004},"min":{"1min":0.28000000000000003,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.58999999999999997}]},{"osd":2,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.175,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.745,"15min":0.72599999999999998},"min":{"1min":0.316,"5min":0.26000000000000001,"15min":0.20699999999999999},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.0349999999999999}]},{"osd":3,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77400000000000002,"15min":0.79400000000000004},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.222,"5min":1.222,"15min":1.431},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.76800000000000002,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.137,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.91600000000000004}]},{"osd":4,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.86899999999999999,"15min":0.877},"min":{"1min":0.58099999999999996,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.538,"5min":3.476,"15min":3.476},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.85899999999999999,"15min":0.879},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.6919999999999999},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83399999999999996,"15min":0.84299999999999997},"min":{"1min":0.38800000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.2809999999999999,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.161,"5min":1.0129999999999999,"15min":0.995},"min":{"1min":0.53400000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":0.89500000000000002}]},{"osd":6,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.91700000000000004,"15min":0.92500000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.351,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.016,"15min":1.018},"min":{"1min":0.68300000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.496,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":1.071}]},{"osd":7,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.98499999999999999,"15min":0.999},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":1.4019999999999999,"5min":2.7549999999999999,"15min":2.7549999999999999},"last":1.087},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.98799999999999999,"15min":0.997},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.5980000000000001,"5min":3.2280000000000002,"15min":3.2280000000000002},"last":1.1060000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575038,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243824,"kb_used_data":42152,"kb_used_omap":0,"kb_used_meta":201664,"kb_avail":94128016,"statfs":{"total":96636764160,"available":96387088384,"internally_reserved":0,"allocated":43163648,"data_stored":42816095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":206503936},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63800000000000001,"15min":0.61499999999999999},"min":{"1min":0.32500000000000001,"5min":0.26800000000000002,"15min":0.20999999999999999},"max":{"1min":1.048,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.67700000000000005,"15min":0.66600000000000004},"min":{"1min":0.36499999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.486,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":1.798,"5min":0.94899999999999995,"15min":0.81599999999999995},"min":{"1min":0.38400000000000001,"5min":0.311,"15min":0.23699999999999999},"max":{"1min":16.774999999999999,"5min":16.774999999999999,"15min":16.774999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.798,"5min":0.97399999999999998,"15min":0.84099999999999997},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":16.652999999999999,"5min":16.652999999999999,"15min":16.652999999999999},"last":0.94999999999999996}]},{"osd":3,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69899999999999995,"15min":0.71599999999999997},"min":{"1min":0.378,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.85599999999999998,"5min":1.387,"15min":4.3170000000000002},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85099999999999998,"15min":0.83199999999999996},"min":{"1min":0.439,"5min":0.254,"15min":0.254},"max":{"1min":1.036,"5min":1.925,"15min":2.395},"last":0.72299999999999998}]},{"osd":4,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90500000000000003,"15min":0.88500000000000001},"min":{"1min":0.36899999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.3180000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":0.92600000000000005,"15min":0.90600000000000003},"min":{"1min":0.40699999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":5.5720000000000001,"5min":5.5720000000000001,"15min":5.5720000000000001},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":2.1190000000000002,"5min":1.131,"15min":0.98799999999999999},"min":{"1min":0.59899999999999998,"5min":0.315,"15min":0.315},"max":{"1min":19.577999999999999,"5min":19.577999999999999,"15min":19.577999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":4.3890000000000002,"5min":1.724,"15min":1.2869999999999999},"min":{"1min":0.54500000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":52.176000000000002,"5min":52.176000000000002,"15min":52.176000000000002},"last":1.085}]},{"osd":6,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.0720000000000001,"15min":1.0649999999999999},"min":{"1min":0.68300000000000005,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.341,"5min":2.0840000000000001,"15min":2.5209999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.026,"15min":1.018},"min":{"1min":0.45700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.2529999999999999,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.1160000000000001}]},{"osd":7,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.0720000000000001,"15min":1.083},"min":{"1min":0.49399999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.395,"5min":2.254,"15min":8.3490000000000002},"last":1.175},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0049999999999999,"15min":1.0309999999999999},"min":{"1min":0.57999999999999996,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2170000000000001,"5min":1.9059999999999999,"15min":6.1529999999999996},"last":1.214}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41955328,"data_stored":41943678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":88088576,"data_stored":88080689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40919040,"data_stored":40918503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61898752,"data_stored":61890695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":66600960,"data_stored":66587530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":88084480,"data_stored":88080474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":91762688,"data_stored":91753755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":28760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":24621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":28708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":32788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":36947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":28695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":36961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T23:28:12.493 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.494 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.494 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.494 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.494 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.494 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.494 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.495 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.495 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.495 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.496 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.496 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.496 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.496 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.496 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.496 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.497 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.497 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.497 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.497 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.497 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.497 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.498 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.501 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.502 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.502 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.502 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.503 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.503 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.503 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.504 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.504 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.504 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.504 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.504 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.504 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.505 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.505 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.505 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.505 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.505 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.505 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.506 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.506 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.506 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.506 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.506 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.507 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.507 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.507 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.507 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.507 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.507 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.508 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.508 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.508 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.508 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-11-30T23:12:46.087493+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.508 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:12.508 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-30T23:28:29.238 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:28:29.241 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:28:32.509 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T23:28:32.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f5885b85700 1 Processor -- start 2023-11-30T23:28:32.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f5885b85700 1 -- start start 2023-11-30T23:28:32.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f5885b85700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58800b4f60 0x7f5880070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:32.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f5885b85700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f588006a640 0x7f588006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:32.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f5885b85700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f588014e1e0 0x7f588014e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:32.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f5885b85700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5880071400 con 0x7f588014e1e0 2023-11-30T23:28:32.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f5885b85700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588014eb70 con 0x7f588006a640 2023-11-30T23:28:32.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f5885b85700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5880071640 con 0x7f58800b4f60 2023-11-30T23:28:32.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f5885384700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f588014e1e0 0x7f588014e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:32.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f5885384700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f588014e1e0 0x7f588014e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42326/0 (socket says 172.21.15.73:42326) 2023-11-30T23:28:32.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f5885384700 1 -- 172.21.15.73:0/494513973 learned_addr learned my addr 172.21.15.73:0/494513973 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:28:32.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f5884b83700 1 --2- 172.21.15.73:0/494513973 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58800b4f60 0x7f5880070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:32.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f587ffff700 1 --2- 172.21.15.73:0/494513973 >> v2:172.21.15.156:3300/0 conn(0x7f588006a640 0x7f588006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:32.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f5885384700 1 -- 172.21.15.73:0/494513973 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58800b4f60 msgr2=0x7f5880070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:28:32.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f5885384700 1 --2- 172.21.15.73:0/494513973 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58800b4f60 0x7f5880070ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:32.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f5885384700 1 -- 172.21.15.73:0/494513973 >> v2:172.21.15.156:3300/0 conn(0x7f588006a640 msgr2=0x7f588006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:28:32.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f5885384700 1 --2- 172.21.15.73:0/494513973 >> v2:172.21.15.156:3300/0 conn(0x7f588006a640 0x7f588006f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:32.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f5885384700 1 -- 172.21.15.73:0/494513973 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5880071920 con 0x7f588014e1e0 2023-11-30T23:28:32.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f587ffff700 1 --2- 172.21.15.73:0/494513973 >> v2:172.21.15.156:3300/0 conn(0x7f588006a640 0x7f588006f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:28:32.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f5885384700 1 --2- 172.21.15.73:0/494513973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f588014e1e0 0x7f588014e630 secure :-1 s=READY pgs=4264 cs=0 l=1 rev1=1 crypto rx=0x7f5880073c00 tx=0x7f5878009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ec59877e249bf8 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:32.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f587f7fe700 1 -- 172.21.15.73:0/494513973 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878011830 con 0x7f588014e1e0 2023-11-30T23:28:32.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f587f7fe700 1 -- 172.21.15.73:0/494513973 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5878011990 con 0x7f588014e1e0 2023-11-30T23:28:32.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.633+0000 7f587f7fe700 1 -- 172.21.15.73:0/494513973 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878011d20 con 0x7f588014e1e0 2023-11-30T23:28:32.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885b85700 1 -- 172.21.15.73:0/494513973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f588014e1e0 msgr2=0x7f588014e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:32.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885b85700 1 --2- 172.21.15.73:0/494513973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f588014e1e0 0x7f588014e630 secure :-1 s=READY pgs=4264 cs=0 l=1 rev1=1 crypto rx=0x7f5880073c00 tx=0x7f5878009bf0 comp rx=0 tx=0).stop 2023-11-30T23:28:32.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885b85700 1 -- 172.21.15.73:0/494513973 shutdown_connections 2023-11-30T23:28:32.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885b85700 1 --2- 172.21.15.73:0/494513973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f588014e1e0 0x7f588014e630 unknown :-1 s=CLOSED pgs=4264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:32.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885b85700 1 --2- 172.21.15.73:0/494513973 >> v2:172.21.15.156:3300/0 conn(0x7f588006a640 0x7f588006f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:32.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885b85700 1 --2- 172.21.15.73:0/494513973 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f58800b4f60 0x7f5880070ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:32.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885b85700 1 -- 172.21.15.73:0/494513973 >> 172.21.15.73:0/494513973 conn(0x7f588006b290 msgr2=0x7f588006b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:32.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885b85700 1 -- 172.21.15.73:0/494513973 shutdown_connections 2023-11-30T23:28:32.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885b85700 1 -- 172.21.15.73:0/494513973 wait complete. 2023-11-30T23:28:32.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885b85700 1 Processor -- start 2023-11-30T23:28:32.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885b85700 1 -- start start 2023-11-30T23:28:32.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885b85700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f588006a640 0x7f58800b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:32.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885b85700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58800b4f60 0x7f58800b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:32.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885b85700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f588014e1e0 0x7f5880147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:32.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885b85700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58800b0fd0 con 0x7f588014e1e0 2023-11-30T23:28:32.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885b85700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58800b2c50 con 0x7f58800b4f60 2023-11-30T23:28:32.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885b85700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5880145f20 con 0x7f588006a640 2023-11-30T23:28:32.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885384700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f588014e1e0 0x7f5880147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5884b83700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f588006a640 0x7f58800b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885384700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f588014e1e0 0x7f5880147960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42336/0 (socket says 172.21.15.73:42336) 2023-11-30T23:28:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f5885384700 1 -- 172.21.15.73:0/2979419501 learned_addr learned my addr 172.21.15.73:0/2979419501 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:28:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.637+0000 7f587ffff700 1 --2- 172.21.15.73:0/2979419501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58800b4f60 0x7f58800b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.641+0000 7f5885384700 1 -- 172.21.15.73:0/2979419501 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f588006a640 msgr2=0x7f58800b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.641+0000 7f5885384700 1 --2- 172.21.15.73:0/2979419501 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f588006a640 0x7f58800b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.641+0000 7f5885384700 1 -- 172.21.15.73:0/2979419501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58800b4f60 msgr2=0x7f58800b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.641+0000 7f5885384700 1 --2- 172.21.15.73:0/2979419501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58800b4f60 0x7f58800b1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.641+0000 7f5885384700 1 -- 172.21.15.73:0/2979419501 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5878009570 con 0x7f588014e1e0 2023-11-30T23:28:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.641+0000 7f5884b83700 1 --2- 172.21.15.73:0/2979419501 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f588006a640 0x7f58800b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:28:32.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.641+0000 7f5885384700 1 --2- 172.21.15.73:0/2979419501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f588014e1e0 0x7f5880147960 secure :-1 s=READY pgs=4265 cs=0 l=1 rev1=1 crypto rx=0x7f588006ee20 tx=0x7f5878004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:32.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.641+0000 7f587d7fa700 1 -- 172.21.15.73:0/2979419501 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878004450 con 0x7f588014e1e0 2023-11-30T23:28:32.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.641+0000 7f587d7fa700 1 -- 172.21.15.73:0/2979419501 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58780045b0 con 0x7f588014e1e0 2023-11-30T23:28:32.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.641+0000 7f5885b85700 1 -- 172.21.15.73:0/2979419501 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5880146200 con 0x7f588014e1e0 2023-11-30T23:28:32.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.641+0000 7f587d7fa700 1 -- 172.21.15.73:0/2979419501 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878003900 con 0x7f588014e1e0 2023-11-30T23:28:32.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.641+0000 7f5885b85700 1 -- 172.21.15.73:0/2979419501 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58800b1c80 con 0x7f588014e1e0 2023-11-30T23:28:32.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.641+0000 7f5885b85700 1 -- 172.21.15.73:0/2979419501 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58800b1460 con 0x7f588014e1e0 2023-11-30T23:28:32.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.641+0000 7f587d7fa700 1 -- 172.21.15.73:0/2979419501 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5878021070 con 0x7f588014e1e0 2023-11-30T23:28:32.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.641+0000 7f587d7fa700 1 --2- 172.21.15.73:0/2979419501 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f5860065ad0 0x7f5860067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:32.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.641+0000 7f587d7fa700 1 -- 172.21.15.73:0/2979419501 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f58780845e0 con 0x7f588014e1e0 2023-11-30T23:28:32.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.641+0000 7f5884b83700 1 --2- 172.21.15.73:0/2979419501 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f5860065ad0 0x7f5860067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:32.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.645+0000 7f5884b83700 1 --2- 172.21.15.73:0/2979419501 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f5860065ad0 0x7f5860067f90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5870009ec0 tx=0x7f5870009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:32.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.649+0000 7f587d7fa700 1 -- 172.21.15.73:0/2979419501 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f58800b1460 con 0x7f588014e1e0 2023-11-30T23:28:32.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.809+0000 7f5885b85700 1 -- 172.21.15.73:0/2979419501 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58800b1e10 con 0x7f5860065ad0 2023-11-30T23:28:32.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.817+0000 7f587d7fa700 1 -- 172.21.15.73:0/2979419501 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+292679 (secure 0 0 0) 0x7f5870011b40 con 0x7f5860065ad0 2023-11-30T23:28:32.822 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:28:32.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.821+0000 7f5885b85700 1 -- 172.21.15.73:0/2979419501 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f5860065ad0 msgr2=0x7f5860067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:32.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.821+0000 7f5885b85700 1 --2- 172.21.15.73:0/2979419501 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f5860065ad0 0x7f5860067f90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5870009ec0 tx=0x7f5870009240 comp rx=0 tx=0).stop 2023-11-30T23:28:32.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.821+0000 7f5885b85700 1 -- 172.21.15.73:0/2979419501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f588014e1e0 msgr2=0x7f5880147960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:32.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.821+0000 7f5885b85700 1 --2- 172.21.15.73:0/2979419501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f588014e1e0 0x7f5880147960 secure :-1 s=READY pgs=4265 cs=0 l=1 rev1=1 crypto rx=0x7f588006ee20 tx=0x7f5878004770 comp rx=0 tx=0).stop 2023-11-30T23:28:32.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.821+0000 7f5885b85700 1 -- 172.21.15.73:0/2979419501 shutdown_connections 2023-11-30T23:28:32.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.821+0000 7f5885b85700 1 --2- 172.21.15.73:0/2979419501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f588014e1e0 0x7f5880147960 unknown :-1 s=CLOSED pgs=4265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:32.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.821+0000 7f5885b85700 1 --2- 172.21.15.73:0/2979419501 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f5860065ad0 0x7f5860067f90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:32.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.821+0000 7f5885b85700 1 --2- 172.21.15.73:0/2979419501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58800b4f60 0x7f58800b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:32.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.821+0000 7f5885b85700 1 --2- 172.21.15.73:0/2979419501 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f588006a640 0x7f58800b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:32.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.821+0000 7f5885b85700 1 -- 172.21.15.73:0/2979419501 >> 172.21.15.73:0/2979419501 conn(0x7f588006b290 msgr2=0x7f58800b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:32.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.821+0000 7f5885b85700 1 -- 172.21.15.73:0/2979419501 shutdown_connections 2023-11-30T23:28:32.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:32.821+0000 7f5885b85700 1 -- 172.21.15.73:0/2979419501 wait complete. 2023-11-30T23:28:32.828 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-11-30T23:28:32.837 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2023-11-30T23:28:32.688762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":275997093,"num_objects":743,"num_object_clones":28,"num_object_copies":1486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":743,"num_whiteouts":15,"num_read":1184,"num_read_kb":3541,"num_write":155912,"num_write_kb":668826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":540,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3578267,"num_omap_keys":7100,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":308304,"ondisk_log_size":308304,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2737688,"kb_used_data":543640,"kb_used_omap":0,"kb_used_meta":2193984,"kb_avail":752237032,"statfs":{"total":773094113280,"available":770290720768,"internally_reserved":0,"allocated":556687360,"data_stored":554020498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2246639616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004630"},"pg_stats":[{"pgid":"3.3f","version":"48'3481","reported_seq":2878,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.915807+0000","last_change":"2023-11-30T23:27:40.777020+0000","last_active":"2023-11-30T23:27:48.915807+0000","last_peered":"2023-11-30T23:27:48.915807+0000","last_clean":"2023-11-30T23:27:48.915807+0000","last_became_active":"2023-11-30T23:12:47.512980+0000","last_became_peered":"2023-11-30T23:12:47.512980+0000","last_unstale":"2023-11-30T23:27:48.915807+0000","last_undegraded":"2023-11-30T23:27:48.915807+0000","last_fullsized":"2023-11-30T23:27:48.915807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0061607720000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1134,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"49'3351","reported_seq":2791,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:18.896980+0000","last_change":"2023-11-30T23:28:18.897137+0000","last_active":"2023-11-30T23:28:18.896980+0000","last_peered":"2023-11-30T23:28:18.896980+0000","last_clean":"2023-11-30T23:28:18.896980+0000","last_became_active":"2023-11-30T23:12:47.508771+0000","last_became_peered":"2023-11-30T23:12:47.508771+0000","last_unstale":"2023-11-30T23:28:18.896980+0000","last_undegraded":"2023-11-30T23:28:18.896980+0000","last_fullsized":"2023-11-30T23:28:18.896980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3351","last_scrub_stamp":"2023-11-30T23:28:18.896957+0000","last_deep_scrub":"49'3351","last_deep_scrub_stamp":"2023-11-30T23:28:18.896957+0000","last_clean_scrub_stamp":"2023-11-30T23:28:18.896957+0000","objects_scrubbed":4,"log_size":3351,"log_dups_size":0,"ondisk_log_size":3351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:02:16.995243+0000","scrub_duration":0.037289786999999998,"objects_trimmed":0,"snaptrim_duration":0.055178039999999998,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1093,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"49'3514","reported_seq":2928,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:01.610476+0000","last_change":"2023-11-30T23:28:01.610618+0000","last_active":"2023-11-30T23:28:01.610476+0000","last_peered":"2023-11-30T23:28:01.610476+0000","last_clean":"2023-11-30T23:28:01.610476+0000","last_became_active":"2023-11-30T23:12:47.507829+0000","last_became_peered":"2023-11-30T23:12:47.507829+0000","last_unstale":"2023-11-30T23:28:01.610476+0000","last_undegraded":"2023-11-30T23:28:01.610476+0000","last_fullsized":"2023-11-30T23:28:01.610476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3514","last_scrub_stamp":"2023-11-30T23:28:01.610451+0000","last_deep_scrub":"49'3514","last_deep_scrub_stamp":"2023-11-30T23:28:01.610451+0000","last_clean_scrub_stamp":"2023-11-30T23:28:01.610451+0000","objects_scrubbed":1,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:18:44.631441+0000","scrub_duration":0.030646911999999998,"objects_trimmed":0,"snaptrim_duration":0.031269901000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"48'3599","reported_seq":2964,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.069668+0000","last_change":"2023-11-30T23:27:40.523535+0000","last_active":"2023-11-30T23:27:49.069668+0000","last_peered":"2023-11-30T23:27:49.069668+0000","last_clean":"2023-11-30T23:27:49.069668+0000","last_became_active":"2023-11-30T23:12:47.522208+0000","last_became_peered":"2023-11-30T23:12:47.522208+0000","last_unstale":"2023-11-30T23:27:49.069668+0000","last_undegraded":"2023-11-30T23:27:49.069668+0000","last_fullsized":"2023-11-30T23:27:49.069668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3599,"log_dups_size":0,"ondisk_log_size":3599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020703408,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"48'3346","reported_seq":2727,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.884673+0000","last_change":"2023-11-30T23:27:40.475732+0000","last_active":"2023-11-30T23:27:48.884673+0000","last_peered":"2023-11-30T23:27:48.884673+0000","last_clean":"2023-11-30T23:27:48.884673+0000","last_became_active":"2023-11-30T23:13:30.302763+0000","last_became_peered":"2023-11-30T23:13:30.302763+0000","last_unstale":"2023-11-30T23:27:48.884673+0000","last_undegraded":"2023-11-30T23:27:48.884673+0000","last_fullsized":"2023-11-30T23:27:48.884673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3346,"log_dups_size":0,"ondisk_log_size":3346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047963988999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"48'3402","reported_seq":2819,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.073218+0000","last_change":"2023-11-30T23:27:40.521728+0000","last_active":"2023-11-30T23:27:49.073218+0000","last_peered":"2023-11-30T23:27:49.073218+0000","last_clean":"2023-11-30T23:27:49.073218+0000","last_became_active":"2023-11-30T23:12:47.513491+0000","last_became_peered":"2023-11-30T23:12:47.513491+0000","last_unstale":"2023-11-30T23:27:49.073218+0000","last_undegraded":"2023-11-30T23:27:49.073218+0000","last_fullsized":"2023-11-30T23:27:49.073218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019296939999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"48'3534","reported_seq":2944,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.080660+0000","last_change":"2023-11-30T23:27:40.773622+0000","last_active":"2023-11-30T23:27:49.080660+0000","last_peered":"2023-11-30T23:27:49.080660+0000","last_clean":"2023-11-30T23:27:49.080660+0000","last_became_active":"2023-11-30T23:12:47.507747+0000","last_became_peered":"2023-11-30T23:12:47.507747+0000","last_unstale":"2023-11-30T23:27:49.080660+0000","last_undegraded":"2023-11-30T23:27:49.080660+0000","last_fullsized":"2023-11-30T23:27:49.080660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3534,"log_dups_size":0,"ondisk_log_size":3534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0077627249999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"48'3400","reported_seq":2788,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.081007+0000","last_change":"2023-11-30T23:27:40.523065+0000","last_active":"2023-11-30T23:27:49.081007+0000","last_peered":"2023-11-30T23:27:49.081007+0000","last_clean":"2023-11-30T23:27:49.081007+0000","last_became_active":"2023-11-30T23:12:47.523430+0000","last_became_peered":"2023-11-30T23:12:47.523430+0000","last_unstale":"2023-11-30T23:27:49.081007+0000","last_undegraded":"2023-11-30T23:27:49.081007+0000","last_fullsized":"2023-11-30T23:27:49.081007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3400,"log_dups_size":0,"ondisk_log_size":3400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023650336000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"48'3724","reported_seq":3062,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.916014+0000","last_change":"2023-11-30T23:27:40.778901+0000","last_active":"2023-11-30T23:27:48.916014+0000","last_peered":"2023-11-30T23:27:48.916014+0000","last_clean":"2023-11-30T23:27:48.916014+0000","last_became_active":"2023-11-30T23:12:47.521393+0000","last_became_peered":"2023-11-30T23:12:47.521393+0000","last_unstale":"2023-11-30T23:27:48.916014+0000","last_undegraded":"2023-11-30T23:27:48.916014+0000","last_fullsized":"2023-11-30T23:27:48.916014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3724,"log_dups_size":0,"ondisk_log_size":3724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078674580000000008,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1228,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"48'3647","reported_seq":3116,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.410477+0000","last_change":"2023-11-30T23:27:40.786256+0000","last_active":"2023-11-30T23:27:48.410477+0000","last_peered":"2023-11-30T23:27:48.410477+0000","last_clean":"2023-11-30T23:27:48.410477+0000","last_became_active":"2023-11-30T23:12:47.522618+0000","last_became_peered":"2023-11-30T23:12:47.522618+0000","last_unstale":"2023-11-30T23:27:48.410477+0000","last_undegraded":"2023-11-30T23:27:48.410477+0000","last_fullsized":"2023-11-30T23:27:48.410477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3647,"log_dups_size":0,"ondisk_log_size":3647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016421781999999999,"stat_sum":{"num_bytes":4110,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":1106,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"49'3244","reported_seq":2745,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:12.562814+0000","last_change":"2023-11-30T23:28:12.563172+0000","last_active":"2023-11-30T23:28:12.562814+0000","last_peered":"2023-11-30T23:28:12.562814+0000","last_clean":"2023-11-30T23:28:12.562814+0000","last_became_active":"2023-11-30T23:13:30.304972+0000","last_became_peered":"2023-11-30T23:13:30.304972+0000","last_unstale":"2023-11-30T23:28:12.562814+0000","last_undegraded":"2023-11-30T23:28:12.562814+0000","last_fullsized":"2023-11-30T23:28:12.562814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3244","last_scrub_stamp":"2023-11-30T23:28:12.562738+0000","last_deep_scrub":"49'3244","last_deep_scrub_stamp":"2023-11-30T23:28:12.562738+0000","last_clean_scrub_stamp":"2023-11-30T23:28:12.562738+0000","objects_scrubbed":1,"log_size":3244,"log_dups_size":0,"ondisk_log_size":3244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:25:07.649855+0000","scrub_duration":0.029739873999999999,"objects_trimmed":0,"snaptrim_duration":0.016353854000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"48'3479","reported_seq":2867,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:08.819998+0000","last_change":"2023-11-30T23:28:08.820160+0000","last_active":"2023-11-30T23:28:08.819998+0000","last_peered":"2023-11-30T23:28:08.819998+0000","last_clean":"2023-11-30T23:28:08.819998+0000","last_became_active":"2023-11-30T23:12:47.513401+0000","last_became_peered":"2023-11-30T23:12:47.513401+0000","last_unstale":"2023-11-30T23:28:08.819998+0000","last_undegraded":"2023-11-30T23:28:08.819998+0000","last_fullsized":"2023-11-30T23:28:08.819998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3479","last_scrub_stamp":"2023-11-30T23:28:08.819951+0000","last_deep_scrub":"48'3479","last_deep_scrub_stamp":"2023-11-30T23:28:08.819951+0000","last_clean_scrub_stamp":"2023-11-30T23:28:08.819951+0000","objects_scrubbed":2,"log_size":3479,"log_dups_size":0,"ondisk_log_size":3479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:49:05.516384+0000","scrub_duration":0.03499451,"objects_trimmed":0,"snaptrim_duration":0.011359997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"48'3375","reported_seq":2827,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.541726+0000","last_change":"2023-11-30T23:27:40.524064+0000","last_active":"2023-11-30T23:27:48.541726+0000","last_peered":"2023-11-30T23:27:48.541726+0000","last_clean":"2023-11-30T23:27:48.541726+0000","last_became_active":"2023-11-30T23:12:47.513714+0000","last_became_peered":"2023-11-30T23:12:47.513714+0000","last_unstale":"2023-11-30T23:27:48.541726+0000","last_undegraded":"2023-11-30T23:27:48.541726+0000","last_fullsized":"2023-11-30T23:27:48.541726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3375,"log_dups_size":0,"ondisk_log_size":3375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024370613999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1066,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"49'3644","reported_seq":3015,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:17.651306+0000","last_change":"2023-11-30T23:28:17.651561+0000","last_active":"2023-11-30T23:28:17.651306+0000","last_peered":"2023-11-30T23:28:17.651306+0000","last_clean":"2023-11-30T23:28:17.651306+0000","last_became_active":"2023-11-30T23:12:47.506967+0000","last_became_peered":"2023-11-30T23:12:47.506967+0000","last_unstale":"2023-11-30T23:28:17.651306+0000","last_undegraded":"2023-11-30T23:28:17.651306+0000","last_fullsized":"2023-11-30T23:28:17.651306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3644","last_scrub_stamp":"2023-11-30T23:28:17.651240+0000","last_deep_scrub":"49'3644","last_deep_scrub_stamp":"2023-11-30T23:28:17.651240+0000","last_clean_scrub_stamp":"2023-11-30T23:28:17.651240+0000","objects_scrubbed":1,"log_size":3644,"log_dups_size":0,"ondisk_log_size":3644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:25:12.738357+0000","scrub_duration":0.036232482000000003,"objects_trimmed":0,"snaptrim_duration":0.025050587999999999,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"49'3639","reported_seq":2983,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:28.890133+0000","last_change":"2023-11-30T23:28:28.890270+0000","last_active":"2023-11-30T23:28:28.890133+0000","last_peered":"2023-11-30T23:28:28.890133+0000","last_clean":"2023-11-30T23:28:28.890133+0000","last_became_active":"2023-11-30T23:12:47.513018+0000","last_became_peered":"2023-11-30T23:12:47.513018+0000","last_unstale":"2023-11-30T23:28:28.890133+0000","last_undegraded":"2023-11-30T23:28:28.890133+0000","last_fullsized":"2023-11-30T23:28:28.890133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3639","last_scrub_stamp":"2023-11-30T23:28:28.890108+0000","last_deep_scrub":"49'3639","last_deep_scrub_stamp":"2023-11-30T23:28:28.890108+0000","last_clean_scrub_stamp":"2023-11-30T23:28:28.890108+0000","objects_scrubbed":3,"log_size":3639,"log_dups_size":0,"ondisk_log_size":3639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:06:33.031312+0000","scrub_duration":0.050216454000000001,"objects_trimmed":0,"snaptrim_duration":0.059143527000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1251,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"48'3670","reported_seq":3031,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:26.200439+0000","last_change":"2023-11-30T23:28:26.200556+0000","last_active":"2023-11-30T23:28:26.200439+0000","last_peered":"2023-11-30T23:28:26.200439+0000","last_clean":"2023-11-30T23:28:26.200439+0000","last_became_active":"2023-11-30T23:12:47.520518+0000","last_became_peered":"2023-11-30T23:12:47.520518+0000","last_unstale":"2023-11-30T23:28:26.200439+0000","last_undegraded":"2023-11-30T23:28:26.200439+0000","last_fullsized":"2023-11-30T23:28:26.200439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3670","last_scrub_stamp":"2023-11-30T23:28:26.200415+0000","last_deep_scrub":"48'3670","last_deep_scrub_stamp":"2023-11-30T23:28:26.200415+0000","last_clean_scrub_stamp":"2023-11-30T23:28:26.200415+0000","objects_scrubbed":0,"log_size":3670,"log_dups_size":0,"ondisk_log_size":3670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:06:30.341620+0000","scrub_duration":0.029244801000000001,"objects_trimmed":0,"snaptrim_duration":0.016206259000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"49'3894","reported_seq":3203,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:19.109901+0000","last_change":"2023-11-30T23:28:19.110028+0000","last_active":"2023-11-30T23:28:19.109901+0000","last_peered":"2023-11-30T23:28:19.109901+0000","last_clean":"2023-11-30T23:28:19.109901+0000","last_became_active":"2023-11-30T23:12:47.516382+0000","last_became_peered":"2023-11-30T23:12:47.516382+0000","last_unstale":"2023-11-30T23:28:19.109901+0000","last_undegraded":"2023-11-30T23:28:19.109901+0000","last_fullsized":"2023-11-30T23:28:19.109901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3894","last_scrub_stamp":"2023-11-30T23:28:19.109877+0000","last_deep_scrub":"49'3894","last_deep_scrub_stamp":"2023-11-30T23:28:19.109877+0000","last_clean_scrub_stamp":"2023-11-30T23:28:19.109877+0000","objects_scrubbed":2,"log_size":3894,"log_dups_size":0,"ondisk_log_size":3894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:17:05.624190+0000","scrub_duration":0.034182327999999998,"objects_trimmed":0,"snaptrim_duration":0.020102808999999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"49'3337","reported_seq":2829,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:05.189002+0000","last_change":"2023-11-30T23:28:05.189174+0000","last_active":"2023-11-30T23:28:05.189002+0000","last_peered":"2023-11-30T23:28:05.189002+0000","last_clean":"2023-11-30T23:28:05.189002+0000","last_became_active":"2023-11-30T23:12:47.509340+0000","last_became_peered":"2023-11-30T23:12:47.509340+0000","last_unstale":"2023-11-30T23:28:05.189002+0000","last_undegraded":"2023-11-30T23:28:05.189002+0000","last_fullsized":"2023-11-30T23:28:05.189002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3337","last_scrub_stamp":"2023-11-30T23:28:05.188973+0000","last_deep_scrub":"49'3337","last_deep_scrub_stamp":"2023-11-30T23:28:05.188973+0000","last_clean_scrub_stamp":"2023-11-30T23:28:05.188973+0000","objects_scrubbed":1,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:49:01.885406+0000","scrub_duration":0.034767988,"objects_trimmed":0,"snaptrim_duration":0.0085862969999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1061,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"49'3632","reported_seq":3015,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:55.924699+0000","last_change":"2023-11-30T23:27:55.924811+0000","last_active":"2023-11-30T23:27:55.924699+0000","last_peered":"2023-11-30T23:27:55.924699+0000","last_clean":"2023-11-30T23:27:55.924699+0000","last_became_active":"2023-11-30T23:12:47.506733+0000","last_became_peered":"2023-11-30T23:12:47.506733+0000","last_unstale":"2023-11-30T23:27:55.924699+0000","last_undegraded":"2023-11-30T23:27:55.924699+0000","last_fullsized":"2023-11-30T23:27:55.924699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3632","last_scrub_stamp":"2023-11-30T23:27:55.924680+0000","last_deep_scrub":"49'3632","last_deep_scrub_stamp":"2023-11-30T23:27:55.924680+0000","last_clean_scrub_stamp":"2023-11-30T23:27:55.924680+0000","objects_scrubbed":2,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:01.410077+0000","scrub_duration":0.042987108000000003,"objects_trimmed":0,"snaptrim_duration":0.010198370999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"49'3604","reported_seq":2976,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:21.644622+0000","last_change":"2023-11-30T23:28:21.644769+0000","last_active":"2023-11-30T23:28:21.644622+0000","last_peered":"2023-11-30T23:28:21.644622+0000","last_clean":"2023-11-30T23:28:21.644622+0000","last_became_active":"2023-11-30T23:12:47.518819+0000","last_became_peered":"2023-11-30T23:12:47.518819+0000","last_unstale":"2023-11-30T23:28:21.644622+0000","last_undegraded":"2023-11-30T23:28:21.644622+0000","last_fullsized":"2023-11-30T23:28:21.644622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3604","last_scrub_stamp":"2023-11-30T23:28:21.644595+0000","last_deep_scrub":"49'3604","last_deep_scrub_stamp":"2023-11-30T23:28:21.644595+0000","last_clean_scrub_stamp":"2023-11-30T23:28:21.644595+0000","objects_scrubbed":4,"log_size":3604,"log_dups_size":0,"ondisk_log_size":3604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:49:46.776503+0000","scrub_duration":0.044331269,"objects_trimmed":0,"snaptrim_duration":0.014700833,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"49'3685","reported_seq":3079,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:28.467237+0000","last_change":"2023-11-30T23:28:28.467501+0000","last_active":"2023-11-30T23:28:28.467237+0000","last_peered":"2023-11-30T23:28:28.467237+0000","last_clean":"2023-11-30T23:28:28.467237+0000","last_became_active":"2023-11-30T23:12:47.514223+0000","last_became_peered":"2023-11-30T23:12:47.514223+0000","last_unstale":"2023-11-30T23:28:28.467237+0000","last_undegraded":"2023-11-30T23:28:28.467237+0000","last_fullsized":"2023-11-30T23:28:28.467237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3685","last_scrub_stamp":"2023-11-30T23:28:28.467202+0000","last_deep_scrub":"49'3685","last_deep_scrub_stamp":"2023-11-30T23:28:28.467202+0000","last_clean_scrub_stamp":"2023-11-30T23:28:28.467202+0000","objects_scrubbed":2,"log_size":3685,"log_dups_size":0,"ondisk_log_size":3685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:17:14.981515+0000","scrub_duration":0.04516212,"objects_trimmed":0,"snaptrim_duration":0.036942162000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"48'4029","reported_seq":3325,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.069348+0000","last_change":"2023-11-30T23:27:40.526135+0000","last_active":"2023-11-30T23:27:49.069348+0000","last_peered":"2023-11-30T23:27:49.069348+0000","last_clean":"2023-11-30T23:27:49.069348+0000","last_became_active":"2023-11-30T23:12:47.520228+0000","last_became_peered":"2023-11-30T23:12:47.520228+0000","last_unstale":"2023-11-30T23:27:49.069348+0000","last_undegraded":"2023-11-30T23:27:49.069348+0000","last_fullsized":"2023-11-30T23:27:49.069348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":4029,"log_dups_size":0,"ondisk_log_size":4029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023056817,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1244,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"48'3705","reported_seq":3093,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:26.629103+0000","last_change":"2023-11-30T23:28:26.629215+0000","last_active":"2023-11-30T23:28:26.629103+0000","last_peered":"2023-11-30T23:28:26.629103+0000","last_clean":"2023-11-30T23:28:26.629103+0000","last_became_active":"2023-11-30T23:12:47.515247+0000","last_became_peered":"2023-11-30T23:12:47.515247+0000","last_unstale":"2023-11-30T23:28:26.629103+0000","last_undegraded":"2023-11-30T23:28:26.629103+0000","last_fullsized":"2023-11-30T23:28:26.629103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3705","last_scrub_stamp":"2023-11-30T23:28:26.629081+0000","last_deep_scrub":"48'3705","last_deep_scrub_stamp":"2023-11-30T23:28:26.629081+0000","last_clean_scrub_stamp":"2023-11-30T23:28:26.629081+0000","objects_scrubbed":0,"log_size":3705,"log_dups_size":0,"ondisk_log_size":3705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:40:05.421057+0000","scrub_duration":0.045874146999999997,"objects_trimmed":0,"snaptrim_duration":0.026511877,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"49'3605","reported_seq":2971,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:16.183882+0000","last_change":"2023-11-30T23:28:16.184116+0000","last_active":"2023-11-30T23:28:16.183882+0000","last_peered":"2023-11-30T23:28:16.183882+0000","last_clean":"2023-11-30T23:28:16.183882+0000","last_became_active":"2023-11-30T23:12:47.511097+0000","last_became_peered":"2023-11-30T23:12:47.511097+0000","last_unstale":"2023-11-30T23:28:16.183882+0000","last_undegraded":"2023-11-30T23:28:16.183882+0000","last_fullsized":"2023-11-30T23:28:16.183882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3605","last_scrub_stamp":"2023-11-30T23:28:16.183848+0000","last_deep_scrub":"49'3605","last_deep_scrub_stamp":"2023-11-30T23:28:16.183848+0000","last_clean_scrub_stamp":"2023-11-30T23:28:16.183848+0000","objects_scrubbed":3,"log_size":3605,"log_dups_size":0,"ondisk_log_size":3605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:02:14.282133+0000","scrub_duration":0.046432888999999998,"objects_trimmed":0,"snaptrim_duration":0.023833039,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"49'3201","reported_seq":2643,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:24.532544+0000","last_change":"2023-11-30T23:28:24.532699+0000","last_active":"2023-11-30T23:28:24.532544+0000","last_peered":"2023-11-30T23:28:24.532544+0000","last_clean":"2023-11-30T23:28:24.532544+0000","last_became_active":"2023-11-30T23:12:47.510404+0000","last_became_peered":"2023-11-30T23:12:47.510404+0000","last_unstale":"2023-11-30T23:28:24.532544+0000","last_undegraded":"2023-11-30T23:28:24.532544+0000","last_fullsized":"2023-11-30T23:28:24.532544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3201","last_scrub_stamp":"2023-11-30T23:28:24.532514+0000","last_deep_scrub":"49'3201","last_deep_scrub_stamp":"2023-11-30T23:28:24.532514+0000","last_clean_scrub_stamp":"2023-11-30T23:28:24.532514+0000","objects_scrubbed":2,"log_size":3201,"log_dups_size":0,"ondisk_log_size":3201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:17:11.046827+0000","scrub_duration":0.034134656999999999,"objects_trimmed":0,"snaptrim_duration":0.031984205000000002,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"49'3859","reported_seq":3204,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:25.662698+0000","last_change":"2023-11-30T23:28:25.662856+0000","last_active":"2023-11-30T23:28:25.662698+0000","last_peered":"2023-11-30T23:28:25.662698+0000","last_clean":"2023-11-30T23:28:25.662698+0000","last_became_active":"2023-11-30T23:12:47.516539+0000","last_became_peered":"2023-11-30T23:12:47.516539+0000","last_unstale":"2023-11-30T23:28:25.662698+0000","last_undegraded":"2023-11-30T23:28:25.662698+0000","last_fullsized":"2023-11-30T23:28:25.662698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3859","last_scrub_stamp":"2023-11-30T23:28:25.662672+0000","last_deep_scrub":"49'3859","last_deep_scrub_stamp":"2023-11-30T23:28:25.662672+0000","last_clean_scrub_stamp":"2023-11-30T23:28:25.662672+0000","objects_scrubbed":4,"log_size":3859,"log_dups_size":0,"ondisk_log_size":3859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:40:04.454648+0000","scrub_duration":0.045213978000000002,"objects_trimmed":0,"snaptrim_duration":0.018080019999999999,"stat_sum":{"num_bytes":4105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"48'3361","reported_seq":2788,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:17.905046+0000","last_change":"2023-11-30T23:28:17.905157+0000","last_active":"2023-11-30T23:28:17.905046+0000","last_peered":"2023-11-30T23:28:17.905046+0000","last_clean":"2023-11-30T23:28:17.905046+0000","last_became_active":"2023-11-30T23:12:47.506284+0000","last_became_peered":"2023-11-30T23:12:47.506284+0000","last_unstale":"2023-11-30T23:28:17.905046+0000","last_undegraded":"2023-11-30T23:28:17.905046+0000","last_fullsized":"2023-11-30T23:28:17.905046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3361","last_scrub_stamp":"2023-11-30T23:28:17.905024+0000","last_deep_scrub":"48'3361","last_deep_scrub_stamp":"2023-11-30T23:28:17.905024+0000","last_clean_scrub_stamp":"2023-11-30T23:28:17.905024+0000","objects_scrubbed":0,"log_size":3361,"log_dups_size":0,"ondisk_log_size":3361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:41:19.306897+0000","scrub_duration":0.031316189000000001,"objects_trimmed":0,"snaptrim_duration":0.058342590999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"48'3356","reported_seq":2760,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:21.562168+0000","last_change":"2023-11-30T23:28:21.562380+0000","last_active":"2023-11-30T23:28:21.562168+0000","last_peered":"2023-11-30T23:28:21.562168+0000","last_clean":"2023-11-30T23:28:21.562168+0000","last_became_active":"2023-11-30T23:12:47.511800+0000","last_became_peered":"2023-11-30T23:12:47.511800+0000","last_unstale":"2023-11-30T23:28:21.562168+0000","last_undegraded":"2023-11-30T23:28:21.562168+0000","last_fullsized":"2023-11-30T23:28:21.562168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3356","last_scrub_stamp":"2023-11-30T23:28:21.562145+0000","last_deep_scrub":"48'3356","last_deep_scrub_stamp":"2023-11-30T23:28:21.562145+0000","last_clean_scrub_stamp":"2023-11-30T23:28:21.562145+0000","objects_scrubbed":0,"log_size":3356,"log_dups_size":0,"ondisk_log_size":3356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:02:19.660431+0000","scrub_duration":0.035109890999999997,"objects_trimmed":0,"snaptrim_duration":0.034899355,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1130,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"49'3594","reported_seq":3015,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:15.603630+0000","last_change":"2023-11-30T23:28:15.603772+0000","last_active":"2023-11-30T23:28:15.603630+0000","last_peered":"2023-11-30T23:28:15.603630+0000","last_clean":"2023-11-30T23:28:15.603630+0000","last_became_active":"2023-11-30T23:12:47.512978+0000","last_became_peered":"2023-11-30T23:12:47.512978+0000","last_unstale":"2023-11-30T23:28:15.603630+0000","last_undegraded":"2023-11-30T23:28:15.603630+0000","last_fullsized":"2023-11-30T23:28:15.603630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3594","last_scrub_stamp":"2023-11-30T23:28:15.603609+0000","last_deep_scrub":"49'3594","last_deep_scrub_stamp":"2023-11-30T23:28:15.603609+0000","last_clean_scrub_stamp":"2023-11-30T23:28:15.603609+0000","objects_scrubbed":1,"log_size":3594,"log_dups_size":0,"ondisk_log_size":3594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:56:31.486001+0000","scrub_duration":0.036598453000000003,"objects_trimmed":0,"snaptrim_duration":0.032442869999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1122,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"48'3350","reported_seq":2781,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.069679+0000","last_change":"2023-11-30T23:27:40.524098+0000","last_active":"2023-11-30T23:27:49.069679+0000","last_peered":"2023-11-30T23:27:49.069679+0000","last_clean":"2023-11-30T23:27:49.069679+0000","last_became_active":"2023-11-30T23:12:47.511699+0000","last_became_peered":"2023-11-30T23:12:47.511699+0000","last_unstale":"2023-11-30T23:27:49.069679+0000","last_undegraded":"2023-11-30T23:27:49.069679+0000","last_fullsized":"2023-11-30T23:27:49.069679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3350,"log_dups_size":0,"ondisk_log_size":3350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021133078,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"49'4048","reported_seq":3311,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:02.179925+0000","last_change":"2023-11-30T23:28:02.180100+0000","last_active":"2023-11-30T23:28:02.179925+0000","last_peered":"2023-11-30T23:28:02.179925+0000","last_clean":"2023-11-30T23:28:02.179925+0000","last_became_active":"2023-11-30T23:12:47.521604+0000","last_became_peered":"2023-11-30T23:12:47.521604+0000","last_unstale":"2023-11-30T23:28:02.179925+0000","last_undegraded":"2023-11-30T23:28:02.179925+0000","last_fullsized":"2023-11-30T23:28:02.179925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4048","last_scrub_stamp":"2023-11-30T23:28:02.179890+0000","last_deep_scrub":"49'4048","last_deep_scrub_stamp":"2023-11-30T23:28:02.179890+0000","last_clean_scrub_stamp":"2023-11-30T23:28:02.179890+0000","objects_scrubbed":5,"log_size":4048,"log_dups_size":0,"ondisk_log_size":4048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:07.665287+0000","scrub_duration":0.046875120999999999,"objects_trimmed":0,"snaptrim_duration":0.0081020610000000007,"stat_sum":{"num_bytes":4121,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1336,"num_write_kb":721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"49'3909","reported_seq":3244,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:23.613865+0000","last_change":"2023-11-30T23:28:23.614041+0000","last_active":"2023-11-30T23:28:23.613865+0000","last_peered":"2023-11-30T23:28:23.613865+0000","last_clean":"2023-11-30T23:28:23.613865+0000","last_became_active":"2023-11-30T23:12:47.517283+0000","last_became_peered":"2023-11-30T23:12:47.517283+0000","last_unstale":"2023-11-30T23:28:23.613865+0000","last_undegraded":"2023-11-30T23:28:23.613865+0000","last_fullsized":"2023-11-30T23:28:23.613865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3909","last_scrub_stamp":"2023-11-30T23:28:23.613833+0000","last_deep_scrub":"49'3909","last_deep_scrub_stamp":"2023-11-30T23:28:23.613833+0000","last_clean_scrub_stamp":"2023-11-30T23:28:23.613833+0000","objects_scrubbed":1,"log_size":3909,"log_dups_size":0,"ondisk_log_size":3909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:17:10.128146+0000","scrub_duration":0.040663194999999999,"objects_trimmed":0,"snaptrim_duration":0.016665117,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"49'3481","reported_seq":2892,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:56.890441+0000","last_change":"2023-11-30T23:27:56.890633+0000","last_active":"2023-11-30T23:27:56.890441+0000","last_peered":"2023-11-30T23:27:56.890441+0000","last_clean":"2023-11-30T23:27:56.890441+0000","last_became_active":"2023-11-30T23:12:47.508725+0000","last_became_peered":"2023-11-30T23:12:47.508725+0000","last_unstale":"2023-11-30T23:27:56.890441+0000","last_undegraded":"2023-11-30T23:27:56.890441+0000","last_fullsized":"2023-11-30T23:27:56.890441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3481","last_scrub_stamp":"2023-11-30T23:27:56.890382+0000","last_deep_scrub":"49'3481","last_deep_scrub_stamp":"2023-11-30T23:27:56.890382+0000","last_clean_scrub_stamp":"2023-11-30T23:27:56.890382+0000","objects_scrubbed":1,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:10:21.913904+0000","scrub_duration":0.039608870999999997,"objects_trimmed":0,"snaptrim_duration":0.010267352,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1134,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"49'4002","reported_seq":4060,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:57.811764+0000","last_change":"2023-11-30T23:27:57.811924+0000","last_active":"2023-11-30T23:27:57.811764+0000","last_peered":"2023-11-30T23:27:57.811764+0000","last_clean":"2023-11-30T23:27:57.811764+0000","last_became_active":"2023-11-30T23:12:47.138768+0000","last_became_peered":"2023-11-30T23:12:47.138768+0000","last_unstale":"2023-11-30T23:27:57.811764+0000","last_undegraded":"2023-11-30T23:27:57.811764+0000","last_fullsized":"2023-11-30T23:27:57.811764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4002","last_scrub_stamp":"2023-11-30T23:27:57.811738+0000","last_deep_scrub":"49'4002","last_deep_scrub_stamp":"2023-11-30T23:27:57.811738+0000","last_clean_scrub_stamp":"2023-11-30T23:27:57.811738+0000","objects_scrubbed":21,"log_size":4002,"log_dups_size":0,"ondisk_log_size":4002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:18:40.832728+0000","scrub_duration":0.092190944999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":4054,"num_write_kb":19067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":131298,"num_omap_keys":261,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"49'3596","reported_seq":3003,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:08.660864+0000","last_change":"2023-11-30T23:28:08.660979+0000","last_active":"2023-11-30T23:28:08.660864+0000","last_peered":"2023-11-30T23:28:08.660864+0000","last_clean":"2023-11-30T23:28:08.660864+0000","last_became_active":"2023-11-30T23:12:47.516214+0000","last_became_peered":"2023-11-30T23:12:47.516214+0000","last_unstale":"2023-11-30T23:28:08.660864+0000","last_undegraded":"2023-11-30T23:28:08.660864+0000","last_fullsized":"2023-11-30T23:28:08.660864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3596","last_scrub_stamp":"2023-11-30T23:28:08.660841+0000","last_deep_scrub":"49'3596","last_deep_scrub_stamp":"2023-11-30T23:28:08.660841+0000","last_clean_scrub_stamp":"2023-11-30T23:28:08.660841+0000","objects_scrubbed":1,"log_size":3596,"log_dups_size":0,"ondisk_log_size":3596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:49:05.357274+0000","scrub_duration":0.026849743999999998,"objects_trimmed":0,"snaptrim_duration":0.037604525,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"49'4566","reported_seq":4624,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:56.588030+0000","last_change":"2023-11-30T23:27:56.588227+0000","last_active":"2023-11-30T23:27:56.588030+0000","last_peered":"2023-11-30T23:27:56.588030+0000","last_clean":"2023-11-30T23:27:56.588030+0000","last_became_active":"2023-11-30T23:12:47.129771+0000","last_became_peered":"2023-11-30T23:12:47.129771+0000","last_unstale":"2023-11-30T23:27:56.588030+0000","last_undegraded":"2023-11-30T23:27:56.588030+0000","last_fullsized":"2023-11-30T23:27:56.588030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4566","last_scrub_stamp":"2023-11-30T23:27:56.588004+0000","last_deep_scrub":"49'4566","last_deep_scrub_stamp":"2023-11-30T23:27:56.588004+0000","last_clean_scrub_stamp":"2023-11-30T23:27:56.588004+0000","objects_scrubbed":20,"log_size":4566,"log_dups_size":0,"ondisk_log_size":4566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:18:39.608994+0000","scrub_duration":0.072522685000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7867003,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":4621,"num_write_kb":33841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":132064,"num_omap_keys":262,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"49'869","reported_seq":927,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:52.760047+0000","last_change":"2023-11-30T23:27:52.760196+0000","last_active":"2023-11-30T23:27:52.760047+0000","last_peered":"2023-11-30T23:27:52.760047+0000","last_clean":"2023-11-30T23:27:52.760047+0000","last_became_active":"2023-11-30T23:12:47.133440+0000","last_became_peered":"2023-11-30T23:12:47.133440+0000","last_unstale":"2023-11-30T23:27:52.760047+0000","last_undegraded":"2023-11-30T23:27:52.760047+0000","last_fullsized":"2023-11-30T23:27:52.760047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'869","last_scrub_stamp":"2023-11-30T23:27:52.760025+0000","last_deep_scrub":"49'869","last_deep_scrub_stamp":"2023-11-30T23:27:52.760025+0000","last_clean_scrub_stamp":"2023-11-30T23:27:52.760025+0000","objects_scrubbed":18,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:03:41.368698+0000","scrub_duration":0.042867220999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":928,"num_write_kb":12986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":117912,"num_omap_keys":234,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"49'3962","reported_seq":3228,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:20.543966+0000","last_change":"2023-11-30T23:28:20.544108+0000","last_active":"2023-11-30T23:28:20.543966+0000","last_peered":"2023-11-30T23:28:20.543966+0000","last_clean":"2023-11-30T23:28:20.543966+0000","last_became_active":"2023-11-30T23:12:47.507617+0000","last_became_peered":"2023-11-30T23:12:47.507617+0000","last_unstale":"2023-11-30T23:28:20.543966+0000","last_undegraded":"2023-11-30T23:28:20.543966+0000","last_fullsized":"2023-11-30T23:28:20.543966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3962","last_scrub_stamp":"2023-11-30T23:28:20.543943+0000","last_deep_scrub":"49'3962","last_deep_scrub_stamp":"2023-11-30T23:28:20.543943+0000","last_clean_scrub_stamp":"2023-11-30T23:28:20.543943+0000","objects_scrubbed":1,"log_size":3962,"log_dups_size":0,"ondisk_log_size":3962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:41:21.945816+0000","scrub_duration":0.039558478000000001,"objects_trimmed":0,"snaptrim_duration":0.022313091,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1298,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"49'3818","reported_seq":3876,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:55.344789+0000","last_change":"2023-11-30T23:27:55.344927+0000","last_active":"2023-11-30T23:27:55.344789+0000","last_peered":"2023-11-30T23:27:55.344789+0000","last_clean":"2023-11-30T23:27:55.344789+0000","last_became_active":"2023-11-30T23:12:47.132351+0000","last_became_peered":"2023-11-30T23:12:47.132351+0000","last_unstale":"2023-11-30T23:27:55.344789+0000","last_undegraded":"2023-11-30T23:27:55.344789+0000","last_fullsized":"2023-11-30T23:27:55.344789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3818","last_scrub_stamp":"2023-11-30T23:27:55.344768+0000","last_deep_scrub":"49'3818","last_deep_scrub_stamp":"2023-11-30T23:27:55.344768+0000","last_clean_scrub_stamp":"2023-11-30T23:27:55.344768+0000","objects_scrubbed":15,"log_size":3818,"log_dups_size":0,"ondisk_log_size":3818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:00.830165+0000","scrub_duration":0.063752615999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":3859,"num_write_kb":38490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66804,"num_omap_keys":133,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"48'3665","reported_seq":3076,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:23.951004+0000","last_change":"2023-11-30T23:28:23.951117+0000","last_active":"2023-11-30T23:28:23.951004+0000","last_peered":"2023-11-30T23:28:23.951004+0000","last_clean":"2023-11-30T23:28:23.951004+0000","last_became_active":"2023-11-30T23:12:47.506082+0000","last_became_peered":"2023-11-30T23:12:47.506082+0000","last_unstale":"2023-11-30T23:28:23.951004+0000","last_undegraded":"2023-11-30T23:28:23.951004+0000","last_fullsized":"2023-11-30T23:28:23.951004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3665","last_scrub_stamp":"2023-11-30T23:28:23.950982+0000","last_deep_scrub":"48'3665","last_deep_scrub_stamp":"2023-11-30T23:28:23.950982+0000","last_clean_scrub_stamp":"2023-11-30T23:28:23.950982+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:40:02.742957+0000","scrub_duration":0.040544931999999999,"objects_trimmed":0,"snaptrim_duration":0.052118631999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"49'1115","reported_seq":1173,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:08.692273+0000","last_change":"2023-11-30T23:28:08.692475+0000","last_active":"2023-11-30T23:28:08.692273+0000","last_peered":"2023-11-30T23:28:08.692273+0000","last_clean":"2023-11-30T23:28:08.692273+0000","last_became_active":"2023-11-30T23:12:47.139400+0000","last_became_peered":"2023-11-30T23:12:47.139400+0000","last_unstale":"2023-11-30T23:28:08.692273+0000","last_undegraded":"2023-11-30T23:28:08.692273+0000","last_fullsized":"2023-11-30T23:28:08.692273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1115","last_scrub_stamp":"2023-11-30T23:28:08.692238+0000","last_deep_scrub":"49'1115","last_deep_scrub_stamp":"2023-11-30T23:28:08.692238+0000","last_clean_scrub_stamp":"2023-11-30T23:28:08.692238+0000","objects_scrubbed":19,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:55:21.581303+0000","scrub_duration":0.084637698999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":1152,"num_write_kb":13161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":93798,"num_omap_keys":186,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"49'3682","reported_seq":3061,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:10.191488+0000","last_change":"2023-11-30T23:28:10.191644+0000","last_active":"2023-11-30T23:28:10.191488+0000","last_peered":"2023-11-30T23:28:10.191488+0000","last_clean":"2023-11-30T23:28:10.191488+0000","last_became_active":"2023-11-30T23:13:30.596915+0000","last_became_peered":"2023-11-30T23:13:30.596915+0000","last_unstale":"2023-11-30T23:28:10.191488+0000","last_undegraded":"2023-11-30T23:28:10.191488+0000","last_fullsized":"2023-11-30T23:28:10.191488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3682","last_scrub_stamp":"2023-11-30T23:28:10.191456+0000","last_deep_scrub":"49'3682","last_deep_scrub_stamp":"2023-11-30T23:28:10.191456+0000","last_clean_scrub_stamp":"2023-11-30T23:28:10.191456+0000","objects_scrubbed":3,"log_size":3682,"log_dups_size":0,"ondisk_log_size":3682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:18:45.839337+0000","scrub_duration":0.042728659000000002,"objects_trimmed":0,"snaptrim_duration":0.0066900809999999996,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"49'1893","reported_seq":1951,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:04.386249+0000","last_change":"2023-11-30T23:28:04.386438+0000","last_active":"2023-11-30T23:28:04.386249+0000","last_peered":"2023-11-30T23:28:04.386249+0000","last_clean":"2023-11-30T23:28:04.386249+0000","last_became_active":"2023-11-30T23:12:47.139047+0000","last_became_peered":"2023-11-30T23:12:47.139047+0000","last_unstale":"2023-11-30T23:28:04.386249+0000","last_undegraded":"2023-11-30T23:28:04.386249+0000","last_fullsized":"2023-11-30T23:28:04.386249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1893","last_scrub_stamp":"2023-11-30T23:28:04.386222+0000","last_deep_scrub":"49'1893","last_deep_scrub_stamp":"2023-11-30T23:28:04.386222+0000","last_clean_scrub_stamp":"2023-11-30T23:28:04.386222+0000","objects_scrubbed":21,"log_size":1893,"log_dups_size":0,"ondisk_log_size":1893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:18:40.034102+0000","scrub_duration":0.058105267000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":1932,"num_write_kb":25642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":128094,"num_omap_keys":254,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"49'3571","reported_seq":2966,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:23.571803+0000","last_change":"2023-11-30T23:28:23.571970+0000","last_active":"2023-11-30T23:28:23.571803+0000","last_peered":"2023-11-30T23:28:23.571803+0000","last_clean":"2023-11-30T23:28:23.571803+0000","last_became_active":"2023-11-30T23:12:47.522711+0000","last_became_peered":"2023-11-30T23:12:47.522711+0000","last_unstale":"2023-11-30T23:28:23.571803+0000","last_undegraded":"2023-11-30T23:28:23.571803+0000","last_fullsized":"2023-11-30T23:28:23.571803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3571","last_scrub_stamp":"2023-11-30T23:28:23.571773+0000","last_deep_scrub":"49'3571","last_deep_scrub_stamp":"2023-11-30T23:28:23.571773+0000","last_clean_scrub_stamp":"2023-11-30T23:28:23.571773+0000","objects_scrubbed":1,"log_size":3571,"log_dups_size":0,"ondisk_log_size":3571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:17:00.417094+0000","scrub_duration":0.027092887999999999,"objects_trimmed":0,"snaptrim_duration":0.028725985999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"49'3077","reported_seq":3135,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:11.099776+0000","last_change":"2023-11-30T23:28:11.099938+0000","last_active":"2023-11-30T23:28:11.099776+0000","last_peered":"2023-11-30T23:28:11.099776+0000","last_clean":"2023-11-30T23:28:11.099776+0000","last_became_active":"2023-11-30T23:12:47.140531+0000","last_became_peered":"2023-11-30T23:12:47.140531+0000","last_unstale":"2023-11-30T23:28:11.099776+0000","last_undegraded":"2023-11-30T23:28:11.099776+0000","last_fullsized":"2023-11-30T23:28:11.099776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3077","last_scrub_stamp":"2023-11-30T23:28:11.099752+0000","last_deep_scrub":"49'3077","last_deep_scrub_stamp":"2023-11-30T23:28:11.099752+0000","last_clean_scrub_stamp":"2023-11-30T23:28:11.099752+0000","objects_scrubbed":21,"log_size":3077,"log_dups_size":0,"ondisk_log_size":3077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:56:26.982144+0000","scrub_duration":0.057941271000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":3128,"num_write_kb":22065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":123254,"num_omap_keys":244,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'3775","reported_seq":3149,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:06.784637+0000","last_change":"2023-11-30T23:28:06.784753+0000","last_active":"2023-11-30T23:28:06.784637+0000","last_peered":"2023-11-30T23:28:06.784637+0000","last_clean":"2023-11-30T23:28:06.784637+0000","last_became_active":"2023-11-30T23:12:47.513983+0000","last_became_peered":"2023-11-30T23:12:47.513983+0000","last_unstale":"2023-11-30T23:28:06.784637+0000","last_undegraded":"2023-11-30T23:28:06.784637+0000","last_fullsized":"2023-11-30T23:28:06.784637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3775","last_scrub_stamp":"2023-11-30T23:28:06.784616+0000","last_deep_scrub":"49'3775","last_deep_scrub_stamp":"2023-11-30T23:28:06.784616+0000","last_clean_scrub_stamp":"2023-11-30T23:28:06.784616+0000","objects_scrubbed":5,"log_size":3775,"log_dups_size":0,"ondisk_log_size":3775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:12.270013+0000","scrub_duration":0.041895794,"objects_trimmed":0,"snaptrim_duration":0.010376995,"stat_sum":{"num_bytes":9,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1166,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"49'3864","reported_seq":3922,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:03.570741+0000","last_change":"2023-11-30T23:28:03.570940+0000","last_active":"2023-11-30T23:28:03.570741+0000","last_peered":"2023-11-30T23:28:03.570741+0000","last_clean":"2023-11-30T23:28:03.570741+0000","last_became_active":"2023-11-30T23:12:47.139799+0000","last_became_peered":"2023-11-30T23:12:47.139799+0000","last_unstale":"2023-11-30T23:28:03.570741+0000","last_undegraded":"2023-11-30T23:28:03.570741+0000","last_fullsized":"2023-11-30T23:28:03.570741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3864","last_scrub_stamp":"2023-11-30T23:28:03.570709+0000","last_deep_scrub":"49'3864","last_deep_scrub_stamp":"2023-11-30T23:28:03.570709+0000","last_clean_scrub_stamp":"2023-11-30T23:28:03.570709+0000","objects_scrubbed":20,"log_size":3864,"log_dups_size":0,"ondisk_log_size":3864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:49:00.267142+0000","scrub_duration":0.086803594999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":3911,"num_write_kb":30389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99239,"num_omap_keys":195,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"48'3523","reported_seq":2903,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.914920+0000","last_change":"2023-11-30T23:27:40.772832+0000","last_active":"2023-11-30T23:27:48.914920+0000","last_peered":"2023-11-30T23:27:48.914920+0000","last_clean":"2023-11-30T23:27:48.914920+0000","last_became_active":"2023-11-30T23:12:47.503333+0000","last_became_peered":"2023-11-30T23:12:47.503333+0000","last_unstale":"2023-11-30T23:27:48.914920+0000","last_undegraded":"2023-11-30T23:27:48.914920+0000","last_fullsized":"2023-11-30T23:27:48.914920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3523,"log_dups_size":0,"ondisk_log_size":3523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070303589999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"49'1943","reported_seq":2001,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:55.603559+0000","last_change":"2023-11-30T23:27:55.603926+0000","last_active":"2023-11-30T23:27:55.603559+0000","last_peered":"2023-11-30T23:27:55.603559+0000","last_clean":"2023-11-30T23:27:55.603559+0000","last_became_active":"2023-11-30T23:12:47.136620+0000","last_became_peered":"2023-11-30T23:12:47.136620+0000","last_unstale":"2023-11-30T23:27:55.603559+0000","last_undegraded":"2023-11-30T23:27:55.603559+0000","last_fullsized":"2023-11-30T23:27:55.603559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1943","last_scrub_stamp":"2023-11-30T23:27:55.603484+0000","last_deep_scrub":"49'1943","last_deep_scrub_stamp":"2023-11-30T23:27:55.603484+0000","last_clean_scrub_stamp":"2023-11-30T23:27:55.603484+0000","objects_scrubbed":23,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:01:50.595690+0000","scrub_duration":0.066985327999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":2012,"num_write_kb":17264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":138602,"num_omap_keys":275,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"49'3608","reported_seq":2994,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:06.722647+0000","last_change":"2023-11-30T23:28:06.722813+0000","last_active":"2023-11-30T23:28:06.722647+0000","last_peered":"2023-11-30T23:28:06.722647+0000","last_clean":"2023-11-30T23:28:06.722647+0000","last_became_active":"2023-11-30T23:12:47.503294+0000","last_became_peered":"2023-11-30T23:12:47.503294+0000","last_unstale":"2023-11-30T23:28:06.722647+0000","last_undegraded":"2023-11-30T23:28:06.722647+0000","last_fullsized":"2023-11-30T23:28:06.722647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3608","last_scrub_stamp":"2023-11-30T23:28:06.722625+0000","last_deep_scrub":"49'3608","last_deep_scrub_stamp":"2023-11-30T23:28:06.722625+0000","last_clean_scrub_stamp":"2023-11-30T23:28:06.722625+0000","objects_scrubbed":5,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:12.208022+0000","scrub_duration":0.049361031,"objects_trimmed":0,"snaptrim_duration":0.028538382000000001,"stat_sum":{"num_bytes":8235,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1203,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"49'94","reported_seq":152,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:15.187933+0000","last_change":"2023-11-30T23:28:15.188228+0000","last_active":"2023-11-30T23:28:15.187933+0000","last_peered":"2023-11-30T23:28:15.187933+0000","last_clean":"2023-11-30T23:28:15.187933+0000","last_became_active":"2023-11-30T23:12:47.140125+0000","last_became_peered":"2023-11-30T23:12:47.140125+0000","last_unstale":"2023-11-30T23:28:15.187933+0000","last_undegraded":"2023-11-30T23:28:15.187933+0000","last_fullsized":"2023-11-30T23:28:15.187933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'94","last_scrub_stamp":"2023-11-30T23:28:15.187880+0000","last_deep_scrub":"49'94","last_deep_scrub_stamp":"2023-11-30T23:28:15.187880+0000","last_clean_scrub_stamp":"2023-11-30T23:28:15.187880+0000","objects_scrubbed":12,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:41:16.589753+0000","scrub_duration":0.020105610999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":140,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":78108,"num_omap_keys":155,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"48'3957","reported_seq":3288,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.914391+0000","last_change":"2023-11-30T23:27:40.777472+0000","last_active":"2023-11-30T23:27:48.914391+0000","last_peered":"2023-11-30T23:27:48.914391+0000","last_clean":"2023-11-30T23:27:48.914391+0000","last_became_active":"2023-11-30T23:12:47.515427+0000","last_became_peered":"2023-11-30T23:12:47.515427+0000","last_unstale":"2023-11-30T23:27:48.914391+0000","last_undegraded":"2023-11-30T23:27:48.914391+0000","last_fullsized":"2023-11-30T23:27:48.914391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3957,"log_dups_size":0,"ondisk_log_size":3957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066010289999999996,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"49'1127","reported_seq":1185,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:01.508789+0000","last_change":"2023-11-30T23:28:01.508982+0000","last_active":"2023-11-30T23:28:01.508789+0000","last_peered":"2023-11-30T23:28:01.508789+0000","last_clean":"2023-11-30T23:28:01.508789+0000","last_became_active":"2023-11-30T23:12:47.129180+0000","last_became_peered":"2023-11-30T23:12:47.129180+0000","last_unstale":"2023-11-30T23:28:01.508789+0000","last_undegraded":"2023-11-30T23:28:01.508789+0000","last_fullsized":"2023-11-30T23:28:01.508789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1127","last_scrub_stamp":"2023-11-30T23:28:01.508755+0000","last_deep_scrub":"49'1127","last_deep_scrub_stamp":"2023-11-30T23:28:01.508755+0000","last_clean_scrub_stamp":"2023-11-30T23:28:01.508755+0000","objects_scrubbed":10,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:06.994151+0000","scrub_duration":0.041205466000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":1162,"num_write_kb":9042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":54342,"num_omap_keys":108,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"48'3496","reported_seq":2899,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:18.578782+0000","last_change":"2023-11-30T23:28:18.578910+0000","last_active":"2023-11-30T23:28:18.578782+0000","last_peered":"2023-11-30T23:28:18.578782+0000","last_clean":"2023-11-30T23:28:18.578782+0000","last_became_active":"2023-11-30T23:12:47.516980+0000","last_became_peered":"2023-11-30T23:12:47.516980+0000","last_unstale":"2023-11-30T23:28:18.578782+0000","last_undegraded":"2023-11-30T23:28:18.578782+0000","last_fullsized":"2023-11-30T23:28:18.578782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3496","last_scrub_stamp":"2023-11-30T23:28:18.578760+0000","last_deep_scrub":"48'3496","last_deep_scrub_stamp":"2023-11-30T23:28:18.578760+0000","last_clean_scrub_stamp":"2023-11-30T23:28:18.578760+0000","objects_scrubbed":0,"log_size":3496,"log_dups_size":0,"ondisk_log_size":3496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:16:55.424081+0000","scrub_duration":0.035006735999999997,"objects_trimmed":0,"snaptrim_duration":0.014912678,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"49'1321","reported_seq":1379,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:53.092041+0000","last_change":"2023-11-30T23:27:53.092378+0000","last_active":"2023-11-30T23:27:53.092041+0000","last_peered":"2023-11-30T23:27:53.092041+0000","last_clean":"2023-11-30T23:27:53.092041+0000","last_became_active":"2023-11-30T23:12:47.129349+0000","last_became_peered":"2023-11-30T23:12:47.129349+0000","last_unstale":"2023-11-30T23:27:53.092041+0000","last_undegraded":"2023-11-30T23:27:53.092041+0000","last_fullsized":"2023-11-30T23:27:53.092041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1321","last_scrub_stamp":"2023-11-30T23:27:53.091986+0000","last_deep_scrub":"49'1321","last_deep_scrub_stamp":"2023-11-30T23:27:53.091986+0000","last_clean_scrub_stamp":"2023-11-30T23:27:53.091986+0000","objects_scrubbed":21,"log_size":1321,"log_dups_size":0,"ondisk_log_size":1321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:10:18.115508+0000","scrub_duration":0.045828347999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":1371,"num_write_kb":13381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":104070,"num_omap_keys":207,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"49'3747","reported_seq":3081,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:21.020433+0000","last_change":"2023-11-30T23:28:21.020580+0000","last_active":"2023-11-30T23:28:21.020433+0000","last_peered":"2023-11-30T23:28:21.020433+0000","last_clean":"2023-11-30T23:28:21.020433+0000","last_became_active":"2023-11-30T23:12:47.514140+0000","last_became_peered":"2023-11-30T23:12:47.514140+0000","last_unstale":"2023-11-30T23:28:21.020433+0000","last_undegraded":"2023-11-30T23:28:21.020433+0000","last_fullsized":"2023-11-30T23:28:21.020433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3747","last_scrub_stamp":"2023-11-30T23:28:21.020407+0000","last_deep_scrub":"49'3747","last_deep_scrub_stamp":"2023-11-30T23:28:21.020407+0000","last_clean_scrub_stamp":"2023-11-30T23:28:21.020407+0000","objects_scrubbed":4,"log_size":3747,"log_dups_size":0,"ondisk_log_size":3747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:38:32.823826+0000","scrub_duration":0.053450994000000002,"objects_trimmed":0,"snaptrim_duration":0.0087768900000000007,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1241,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"49'1122","reported_seq":1180,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:54.893373+0000","last_change":"2023-11-30T23:27:54.893545+0000","last_active":"2023-11-30T23:27:54.893373+0000","last_peered":"2023-11-30T23:27:54.893373+0000","last_clean":"2023-11-30T23:27:54.893373+0000","last_became_active":"2023-11-30T23:12:47.136631+0000","last_became_peered":"2023-11-30T23:12:47.136631+0000","last_unstale":"2023-11-30T23:27:54.893373+0000","last_undegraded":"2023-11-30T23:27:54.893373+0000","last_fullsized":"2023-11-30T23:27:54.893373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1122","last_scrub_stamp":"2023-11-30T23:27:54.893334+0000","last_deep_scrub":"49'1122","last_deep_scrub_stamp":"2023-11-30T23:27:54.893334+0000","last_clean_scrub_stamp":"2023-11-30T23:27:54.893334+0000","objects_scrubbed":24,"log_size":1122,"log_dups_size":0,"ondisk_log_size":1122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:52:55.445683+0000","scrub_duration":0.067445020999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":1176,"num_write_kb":13385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":144754,"num_omap_keys":287,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"49'3440","reported_seq":2854,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:19.014160+0000","last_change":"2023-11-30T23:28:19.014473+0000","last_active":"2023-11-30T23:28:19.014160+0000","last_peered":"2023-11-30T23:28:19.014160+0000","last_clean":"2023-11-30T23:28:19.014160+0000","last_became_active":"2023-11-30T23:12:47.514053+0000","last_became_peered":"2023-11-30T23:12:47.514053+0000","last_unstale":"2023-11-30T23:28:19.014160+0000","last_undegraded":"2023-11-30T23:28:19.014160+0000","last_fullsized":"2023-11-30T23:28:19.014160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3440","last_scrub_stamp":"2023-11-30T23:28:19.014119+0000","last_deep_scrub":"49'3440","last_deep_scrub_stamp":"2023-11-30T23:28:19.014119+0000","last_clean_scrub_stamp":"2023-11-30T23:28:19.014119+0000","objects_scrubbed":6,"log_size":3440,"log_dups_size":0,"ondisk_log_size":3440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:17:05.528432+0000","scrub_duration":0.050855755000000002,"objects_trimmed":0,"snaptrim_duration":0.0080231629999999998,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"49'2054","reported_seq":2112,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:51.134718+0000","last_change":"2023-11-30T23:27:51.134903+0000","last_active":"2023-11-30T23:27:51.134718+0000","last_peered":"2023-11-30T23:27:51.134718+0000","last_clean":"2023-11-30T23:27:51.134718+0000","last_became_active":"2023-11-30T23:12:47.137695+0000","last_became_peered":"2023-11-30T23:12:47.137695+0000","last_unstale":"2023-11-30T23:27:51.134718+0000","last_undegraded":"2023-11-30T23:27:51.134718+0000","last_fullsized":"2023-11-30T23:27:51.134718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'2054","last_scrub_stamp":"2023-11-30T23:27:51.134674+0000","last_deep_scrub":"49'2054","last_deep_scrub_stamp":"2023-11-30T23:27:51.134674+0000","last_clean_scrub_stamp":"2023-11-30T23:27:51.134674+0000","objects_scrubbed":19,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:52:51.687024+0000","scrub_duration":0.047092548999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":2104,"num_write_kb":13092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":111684,"num_omap_keys":222,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"48'3567","reported_seq":2931,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:48.915981+0000","last_change":"2023-11-30T23:27:40.778859+0000","last_active":"2023-11-30T23:27:48.915981+0000","last_peered":"2023-11-30T23:27:48.915981+0000","last_clean":"2023-11-30T23:27:48.915981+0000","last_became_active":"2023-11-30T23:12:47.514822+0000","last_became_peered":"2023-11-30T23:12:47.514822+0000","last_unstale":"2023-11-30T23:27:48.915981+0000","last_undegraded":"2023-11-30T23:27:48.915981+0000","last_fullsized":"2023-11-30T23:27:48.915981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3567,"log_dups_size":0,"ondisk_log_size":3567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076646960000000004,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"49'4620","reported_seq":4680,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:55.010629+0000","last_change":"2023-11-30T23:27:55.010759+0000","last_active":"2023-11-30T23:27:55.010629+0000","last_peered":"2023-11-30T23:27:55.010629+0000","last_clean":"2023-11-30T23:27:55.010629+0000","last_became_active":"2023-11-30T23:12:47.128682+0000","last_became_peered":"2023-11-30T23:12:47.128682+0000","last_unstale":"2023-11-30T23:27:55.010629+0000","last_undegraded":"2023-11-30T23:27:55.010629+0000","last_fullsized":"2023-11-30T23:27:55.010629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4620","last_scrub_stamp":"2023-11-30T23:27:55.010606+0000","last_deep_scrub":"49'4620","last_deep_scrub_stamp":"2023-11-30T23:27:55.010606+0000","last_clean_scrub_stamp":"2023-11-30T23:27:55.010606+0000","objects_scrubbed":25,"log_size":4620,"log_dups_size":0,"ondisk_log_size":4620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:18:38.031596+0000","scrub_duration":0.1011722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583127,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":4657,"num_write_kb":26783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":151374,"num_omap_keys":301,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"48'3659","reported_seq":2967,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.070207+0000","last_change":"2023-11-30T23:27:40.521110+0000","last_active":"2023-11-30T23:27:49.070207+0000","last_peered":"2023-11-30T23:27:49.070207+0000","last_clean":"2023-11-30T23:27:49.070207+0000","last_became_active":"2023-11-30T23:12:47.516317+0000","last_became_peered":"2023-11-30T23:12:47.516317+0000","last_unstale":"2023-11-30T23:27:49.070207+0000","last_undegraded":"2023-11-30T23:27:49.070207+0000","last_fullsized":"2023-11-30T23:27:49.070207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3659,"log_dups_size":0,"ondisk_log_size":3659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018738761999999999,"stat_sum":{"num_bytes":16384,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1262,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"49'4380","reported_seq":4438,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:58.156912+0000","last_change":"2023-11-30T23:27:58.157082+0000","last_active":"2023-11-30T23:27:58.156912+0000","last_peered":"2023-11-30T23:27:58.156912+0000","last_clean":"2023-11-30T23:27:58.156912+0000","last_became_active":"2023-11-30T23:12:47.140400+0000","last_became_peered":"2023-11-30T23:12:47.140400+0000","last_unstale":"2023-11-30T23:27:58.156912+0000","last_undegraded":"2023-11-30T23:27:58.156912+0000","last_fullsized":"2023-11-30T23:27:58.156912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4380","last_scrub_stamp":"2023-11-30T23:27:58.156885+0000","last_deep_scrub":"49'4380","last_deep_scrub_stamp":"2023-11-30T23:27:58.156885+0000","last_clean_scrub_stamp":"2023-11-30T23:27:58.156885+0000","objects_scrubbed":18,"log_size":4380,"log_dups_size":0,"ondisk_log_size":4380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:18:41.177875+0000","scrub_duration":0.083489562000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4418,"num_write_kb":27644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73070,"num_omap_keys":145,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"48'3509","reported_seq":2947,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:25.016486+0000","last_change":"2023-11-30T23:28:25.016598+0000","last_active":"2023-11-30T23:28:25.016486+0000","last_peered":"2023-11-30T23:28:25.016486+0000","last_clean":"2023-11-30T23:28:25.016486+0000","last_became_active":"2023-11-30T23:12:47.521481+0000","last_became_peered":"2023-11-30T23:12:47.521481+0000","last_unstale":"2023-11-30T23:28:25.016486+0000","last_undegraded":"2023-11-30T23:28:25.016486+0000","last_fullsized":"2023-11-30T23:28:25.016486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3509","last_scrub_stamp":"2023-11-30T23:28:25.016466+0000","last_deep_scrub":"48'3509","last_deep_scrub_stamp":"2023-11-30T23:28:25.016466+0000","last_clean_scrub_stamp":"2023-11-30T23:28:25.016466+0000","objects_scrubbed":0,"log_size":3509,"log_dups_size":0,"ondisk_log_size":3509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:06:29.157670+0000","scrub_duration":0.035706193999999997,"objects_trimmed":0,"snaptrim_duration":0.010302225,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1071,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"49'119","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:58.842711+0000","last_change":"2023-11-30T23:27:58.842999+0000","last_active":"2023-11-30T23:27:58.842711+0000","last_peered":"2023-11-30T23:27:58.842711+0000","last_clean":"2023-11-30T23:27:58.842711+0000","last_became_active":"2023-11-30T23:12:36.556455+0000","last_became_peered":"2023-11-30T23:12:36.556455+0000","last_unstale":"2023-11-30T23:27:58.842711+0000","last_undegraded":"2023-11-30T23:27:58.842711+0000","last_fullsized":"2023-11-30T23:27:58.842711+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'119","last_scrub_stamp":"2023-11-30T23:27:58.842660+0000","last_deep_scrub":"49'119","last_deep_scrub_stamp":"2023-11-30T23:27:58.842660+0000","last_clean_scrub_stamp":"2023-11-30T23:27:58.842660+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:48:55.539093+0000","scrub_duration":0.013295479000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"49'958","reported_seq":1019,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:10.270416+0000","last_change":"2023-11-30T23:28:10.270633+0000","last_active":"2023-11-30T23:28:10.270416+0000","last_peered":"2023-11-30T23:28:10.270416+0000","last_clean":"2023-11-30T23:28:10.270416+0000","last_became_active":"2023-11-30T23:12:47.132365+0000","last_became_peered":"2023-11-30T23:12:47.132365+0000","last_unstale":"2023-11-30T23:28:10.270416+0000","last_undegraded":"2023-11-30T23:28:10.270416+0000","last_fullsized":"2023-11-30T23:28:10.270416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'958","last_scrub_stamp":"2023-11-30T23:28:10.270374+0000","last_deep_scrub":"49'958","last_deep_scrub_stamp":"2023-11-30T23:28:10.270374+0000","last_clean_scrub_stamp":"2023-11-30T23:28:10.270374+0000","objects_scrubbed":25,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:25:05.357492+0000","scrub_duration":0.063963533000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":1011,"num_write_kb":13216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":151874,"num_omap_keys":302,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"48'3463","reported_seq":2912,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:13.730886+0000","last_change":"2023-11-30T23:28:13.731013+0000","last_active":"2023-11-30T23:28:13.730886+0000","last_peered":"2023-11-30T23:28:13.730886+0000","last_clean":"2023-11-30T23:28:13.730886+0000","last_became_active":"2023-11-30T23:12:47.508677+0000","last_became_peered":"2023-11-30T23:12:47.508677+0000","last_unstale":"2023-11-30T23:28:13.730886+0000","last_undegraded":"2023-11-30T23:28:13.730886+0000","last_fullsized":"2023-11-30T23:28:13.730886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3463","last_scrub_stamp":"2023-11-30T23:28:13.730861+0000","last_deep_scrub":"48'3463","last_deep_scrub_stamp":"2023-11-30T23:28:13.730861+0000","last_clean_scrub_stamp":"2023-11-30T23:28:13.730861+0000","objects_scrubbed":0,"log_size":3463,"log_dups_size":0,"ondisk_log_size":3463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:56:29.613252+0000","scrub_duration":0.032192482000000001,"objects_trimmed":0,"snaptrim_duration":0.029660272000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1097,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"49'3532","reported_seq":3591,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:03.939565+0000","last_change":"2023-11-30T23:28:03.939708+0000","last_active":"2023-11-30T23:28:03.939565+0000","last_peered":"2023-11-30T23:28:03.939565+0000","last_clean":"2023-11-30T23:28:03.939565+0000","last_became_active":"2023-11-30T23:12:47.148547+0000","last_became_peered":"2023-11-30T23:12:47.148547+0000","last_unstale":"2023-11-30T23:28:03.939565+0000","last_undegraded":"2023-11-30T23:28:03.939565+0000","last_fullsized":"2023-11-30T23:28:03.939565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3532","last_scrub_stamp":"2023-11-30T23:28:03.939542+0000","last_deep_scrub":"49'3532","last_deep_scrub_stamp":"2023-11-30T23:28:03.939542+0000","last_clean_scrub_stamp":"2023-11-30T23:28:03.939542+0000","objects_scrubbed":20,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:18:39.587422+0000","scrub_duration":0.077305334000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":3602,"num_write_kb":26128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":119298,"num_omap_keys":237,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"48'3481","reported_seq":2877,"reported_epoch":49,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-30T23:27:48.402494+0000","last_change":"2023-11-30T23:27:56.567585+0000","last_active":"2023-11-30T23:27:48.402494+0000","last_peered":"2023-11-30T23:27:48.402494+0000","last_clean":"2023-11-30T23:27:48.402494+0000","last_became_active":"2023-11-30T23:12:47.515553+0000","last_became_peered":"2023-11-30T23:12:47.515553+0000","last_unstale":"2023-11-30T23:27:48.402494+0000","last_undegraded":"2023-11-30T23:27:48.402494+0000","last_fullsized":"2023-11-30T23:27:48.402494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021186228000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1162,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"49'2714","reported_seq":3288,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:52.126094+0000","last_change":"2023-11-30T23:27:52.126287+0000","last_active":"2023-11-30T23:27:52.126094+0000","last_peered":"2023-11-30T23:27:52.126094+0000","last_clean":"2023-11-30T23:27:52.126094+0000","last_became_active":"2023-11-30T23:12:47.135746+0000","last_became_peered":"2023-11-30T23:12:47.135746+0000","last_unstale":"2023-11-30T23:27:52.126094+0000","last_undegraded":"2023-11-30T23:27:52.126094+0000","last_fullsized":"2023-11-30T23:27:52.126094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'2714","last_scrub_stamp":"2023-11-30T23:27:52.126064+0000","last_deep_scrub":"49'2714","last_deep_scrub_stamp":"2023-11-30T23:27:52.126064+0000","last_clean_scrub_stamp":"2023-11-30T23:27:52.126064+0000","objects_scrubbed":20,"log_size":2714,"log_dups_size":0,"ondisk_log_size":2714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:01:47.118270+0000","scrub_duration":0.050486340999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3169767,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":530,"num_read_kb":3420,"num_write":2759,"num_write_kb":16501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":122836,"num_omap_keys":244,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'3597","reported_seq":2979,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:13.025144+0000","last_change":"2023-11-30T23:28:13.025304+0000","last_active":"2023-11-30T23:28:13.025144+0000","last_peered":"2023-11-30T23:28:13.025144+0000","last_clean":"2023-11-30T23:28:13.025144+0000","last_became_active":"2023-11-30T23:12:47.510024+0000","last_became_peered":"2023-11-30T23:12:47.510024+0000","last_unstale":"2023-11-30T23:28:13.025144+0000","last_undegraded":"2023-11-30T23:28:13.025144+0000","last_fullsized":"2023-11-30T23:28:13.025144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3597","last_scrub_stamp":"2023-11-30T23:28:13.025101+0000","last_deep_scrub":"49'3597","last_deep_scrub_stamp":"2023-11-30T23:28:13.025101+0000","last_clean_scrub_stamp":"2023-11-30T23:28:13.025101+0000","objects_scrubbed":4,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:25:08.112218+0000","scrub_duration":0.042807316999999998,"objects_trimmed":0,"snaptrim_duration":0.045211289000000002,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"49'4604","reported_seq":4663,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:08.371552+0000","last_change":"2023-11-30T23:28:08.371721+0000","last_active":"2023-11-30T23:28:08.371552+0000","last_peered":"2023-11-30T23:28:08.371552+0000","last_clean":"2023-11-30T23:28:08.371552+0000","last_became_active":"2023-11-30T23:12:47.141115+0000","last_became_peered":"2023-11-30T23:12:47.141115+0000","last_unstale":"2023-11-30T23:28:08.371552+0000","last_undegraded":"2023-11-30T23:28:08.371552+0000","last_fullsized":"2023-11-30T23:28:08.371552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4604","last_scrub_stamp":"2023-11-30T23:28:08.371526+0000","last_deep_scrub":"49'4604","last_deep_scrub_stamp":"2023-11-30T23:28:08.371526+0000","last_clean_scrub_stamp":"2023-11-30T23:28:08.371526+0000","objects_scrubbed":22,"log_size":4604,"log_dups_size":0,"ondisk_log_size":4604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:56:24.253918+0000","scrub_duration":0.097972583000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":4625,"num_write_kb":30671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":111760,"num_omap_keys":222,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"48'3767","reported_seq":3109,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:55.873932+0000","last_change":"2023-11-30T23:27:55.874045+0000","last_active":"2023-11-30T23:27:55.873932+0000","last_peered":"2023-11-30T23:27:55.873932+0000","last_clean":"2023-11-30T23:27:55.873932+0000","last_became_active":"2023-11-30T23:12:47.514572+0000","last_became_peered":"2023-11-30T23:12:47.514572+0000","last_unstale":"2023-11-30T23:27:55.873932+0000","last_undegraded":"2023-11-30T23:27:55.873932+0000","last_fullsized":"2023-11-30T23:27:55.873932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3767","last_scrub_stamp":"2023-11-30T23:27:55.873914+0000","last_deep_scrub":"48'3767","last_deep_scrub_stamp":"2023-11-30T23:27:55.873914+0000","last_clean_scrub_stamp":"2023-11-30T23:27:55.873914+0000","objects_scrubbed":0,"log_size":3767,"log_dups_size":0,"ondisk_log_size":3767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:01:50.866119+0000","scrub_duration":0.037263154,"objects_trimmed":0,"snaptrim_duration":0.010674993000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"49'168","reported_seq":227,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:02.037975+0000","last_change":"2023-11-30T23:28:02.038132+0000","last_active":"2023-11-30T23:28:02.037975+0000","last_peered":"2023-11-30T23:28:02.037975+0000","last_clean":"2023-11-30T23:28:02.037975+0000","last_became_active":"2023-11-30T23:12:47.141411+0000","last_became_peered":"2023-11-30T23:12:47.141411+0000","last_unstale":"2023-11-30T23:28:02.037975+0000","last_undegraded":"2023-11-30T23:28:02.037975+0000","last_fullsized":"2023-11-30T23:28:02.037975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'168","last_scrub_stamp":"2023-11-30T23:28:02.037952+0000","last_deep_scrub":"49'168","last_deep_scrub_stamp":"2023-11-30T23:28:02.037952+0000","last_clean_scrub_stamp":"2023-11-30T23:28:02.037952+0000","objects_scrubbed":15,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:48:58.734385+0000","scrub_duration":0.042734723000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":238,"num_write_kb":8770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":93108,"num_omap_keys":185,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"49'3576","reported_seq":2944,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:21.148689+0000","last_change":"2023-11-30T23:28:21.148848+0000","last_active":"2023-11-30T23:28:21.148689+0000","last_peered":"2023-11-30T23:28:21.148689+0000","last_clean":"2023-11-30T23:28:21.148689+0000","last_became_active":"2023-11-30T23:13:30.305367+0000","last_became_peered":"2023-11-30T23:13:30.305367+0000","last_unstale":"2023-11-30T23:28:21.148689+0000","last_undegraded":"2023-11-30T23:28:21.148689+0000","last_fullsized":"2023-11-30T23:28:21.148689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3576","last_scrub_stamp":"2023-11-30T23:28:21.148659+0000","last_deep_scrub":"49'3576","last_deep_scrub_stamp":"2023-11-30T23:28:21.148659+0000","last_clean_scrub_stamp":"2023-11-30T23:28:21.148659+0000","objects_scrubbed":1,"log_size":3576,"log_dups_size":0,"ondisk_log_size":3576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:39:59.940634+0000","scrub_duration":0.039025882999999997,"objects_trimmed":0,"snaptrim_duration":0.017828157000000001,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"49'2067","reported_seq":2126,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:07.980476+0000","last_change":"2023-11-30T23:28:07.980660+0000","last_active":"2023-11-30T23:28:07.980476+0000","last_peered":"2023-11-30T23:28:07.980476+0000","last_clean":"2023-11-30T23:28:07.980476+0000","last_became_active":"2023-11-30T23:12:47.143061+0000","last_became_peered":"2023-11-30T23:12:47.143061+0000","last_unstale":"2023-11-30T23:28:07.980476+0000","last_undegraded":"2023-11-30T23:28:07.980476+0000","last_fullsized":"2023-11-30T23:28:07.980476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'2067","last_scrub_stamp":"2023-11-30T23:28:07.980446+0000","last_deep_scrub":"49'2067","last_deep_scrub_stamp":"2023-11-30T23:28:07.980446+0000","last_clean_scrub_stamp":"2023-11-30T23:28:07.980446+0000","objects_scrubbed":11,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:56:23.862838+0000","scrub_duration":0.039739874000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":2145,"num_write_kb":21845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":71684,"num_omap_keys":142,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"49'3506","reported_seq":2909,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:21.902506+0000","last_change":"2023-11-30T23:28:21.902615+0000","last_active":"2023-11-30T23:28:21.902506+0000","last_peered":"2023-11-30T23:28:21.902506+0000","last_clean":"2023-11-30T23:28:21.902506+0000","last_became_active":"2023-11-30T23:12:47.501516+0000","last_became_peered":"2023-11-30T23:12:47.501516+0000","last_unstale":"2023-11-30T23:28:21.902506+0000","last_undegraded":"2023-11-30T23:28:21.902506+0000","last_fullsized":"2023-11-30T23:28:21.902506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3506","last_scrub_stamp":"2023-11-30T23:28:21.902485+0000","last_deep_scrub":"49'3506","last_deep_scrub_stamp":"2023-11-30T23:28:21.902485+0000","last_clean_scrub_stamp":"2023-11-30T23:28:21.902485+0000","objects_scrubbed":1,"log_size":3506,"log_dups_size":0,"ondisk_log_size":3506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:17:08.416798+0000","scrub_duration":0.039385293000000002,"objects_trimmed":0,"snaptrim_duration":0.040930987000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"49'2130","reported_seq":2189,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:59.120106+0000","last_change":"2023-11-30T23:27:59.120106+0000","last_active":"2023-11-30T23:27:59.120106+0000","last_peered":"2023-11-30T23:27:59.120106+0000","last_clean":"2023-11-30T23:27:59.120106+0000","last_became_active":"2023-11-30T23:12:47.134776+0000","last_became_peered":"2023-11-30T23:12:47.134776+0000","last_unstale":"2023-11-30T23:27:59.120106+0000","last_undegraded":"2023-11-30T23:27:59.120106+0000","last_fullsized":"2023-11-30T23:27:59.120106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'2130","last_scrub_stamp":"2023-11-30T23:27:59.119884+0000","last_deep_scrub":"49'2130","last_deep_scrub_stamp":"2023-11-30T23:27:59.119884+0000","last_clean_scrub_stamp":"2023-11-30T23:27:59.119884+0000","objects_scrubbed":23,"log_size":2130,"log_dups_size":0,"ondisk_log_size":2130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:04.605281+0000","scrub_duration":0.153358732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":2452,"num_write_kb":16294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":130911,"num_omap_keys":260,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"49'3246","reported_seq":2673,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:04.785742+0000","last_change":"2023-11-30T23:28:04.785911+0000","last_active":"2023-11-30T23:28:04.785742+0000","last_peered":"2023-11-30T23:28:04.785742+0000","last_clean":"2023-11-30T23:28:04.785742+0000","last_became_active":"2023-11-30T23:12:47.498631+0000","last_became_peered":"2023-11-30T23:12:47.498631+0000","last_unstale":"2023-11-30T23:28:04.785742+0000","last_undegraded":"2023-11-30T23:28:04.785742+0000","last_fullsized":"2023-11-30T23:28:04.785742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3246","last_scrub_stamp":"2023-11-30T23:28:04.785710+0000","last_deep_scrub":"49'3246","last_deep_scrub_stamp":"2023-11-30T23:28:04.785710+0000","last_clean_scrub_stamp":"2023-11-30T23:28:04.785710+0000","objects_scrubbed":1,"log_size":3246,"log_dups_size":0,"ondisk_log_size":3246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:49:01.482143+0000","scrub_duration":0.043044225999999998,"objects_trimmed":0,"snaptrim_duration":0.033287613000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1095,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"49'1702","reported_seq":1761,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:51.521544+0000","last_change":"2023-11-30T23:27:51.521544+0000","last_active":"2023-11-30T23:27:51.521544+0000","last_peered":"2023-11-30T23:27:51.521544+0000","last_clean":"2023-11-30T23:27:51.521544+0000","last_became_active":"2023-11-30T23:12:47.137406+0000","last_became_peered":"2023-11-30T23:12:47.137406+0000","last_unstale":"2023-11-30T23:27:51.521544+0000","last_undegraded":"2023-11-30T23:27:51.521544+0000","last_fullsized":"2023-11-30T23:27:51.521544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1702","last_scrub_stamp":"2023-11-30T23:27:51.521408+0000","last_deep_scrub":"49'1702","last_deep_scrub_stamp":"2023-11-30T23:27:51.521408+0000","last_clean_scrub_stamp":"2023-11-30T23:27:51.521408+0000","objects_scrubbed":16,"log_size":1702,"log_dups_size":0,"ondisk_log_size":1702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:10:16.544929+0000","scrub_duration":0.038042897999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":1761,"num_write_kb":9276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":90070,"num_omap_keys":179,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"49'3475","reported_seq":2893,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:13.682702+0000","last_change":"2023-11-30T23:28:13.682858+0000","last_active":"2023-11-30T23:28:13.682702+0000","last_peered":"2023-11-30T23:28:13.682702+0000","last_clean":"2023-11-30T23:28:13.682702+0000","last_became_active":"2023-11-30T23:12:47.506447+0000","last_became_peered":"2023-11-30T23:12:47.506447+0000","last_unstale":"2023-11-30T23:28:13.682702+0000","last_undegraded":"2023-11-30T23:28:13.682702+0000","last_fullsized":"2023-11-30T23:28:13.682702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3475","last_scrub_stamp":"2023-11-30T23:28:13.682682+0000","last_deep_scrub":"49'3475","last_deep_scrub_stamp":"2023-11-30T23:28:13.682682+0000","last_clean_scrub_stamp":"2023-11-30T23:28:13.682682+0000","objects_scrubbed":3,"log_size":3475,"log_dups_size":0,"ondisk_log_size":3475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:55:26.571747+0000","scrub_duration":0.041430724000000002,"objects_trimmed":0,"snaptrim_duration":0.037907362999999999,"stat_sum":{"num_bytes":4105,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1170,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"49'1570","reported_seq":1629,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:09.959737+0000","last_change":"2023-11-30T23:28:09.959883+0000","last_active":"2023-11-30T23:28:09.959737+0000","last_peered":"2023-11-30T23:28:09.959737+0000","last_clean":"2023-11-30T23:28:09.959737+0000","last_became_active":"2023-11-30T23:12:47.142135+0000","last_became_peered":"2023-11-30T23:12:47.142135+0000","last_unstale":"2023-11-30T23:28:09.959737+0000","last_undegraded":"2023-11-30T23:28:09.959737+0000","last_fullsized":"2023-11-30T23:28:09.959737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1570","last_scrub_stamp":"2023-11-30T23:28:09.959713+0000","last_deep_scrub":"49'1570","last_deep_scrub_stamp":"2023-11-30T23:28:09.959713+0000","last_clean_scrub_stamp":"2023-11-30T23:28:09.959713+0000","objects_scrubbed":22,"log_size":1570,"log_dups_size":0,"ondisk_log_size":1570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:25:05.046830+0000","scrub_duration":0.056782458000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":1654,"num_write_kb":9390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158140,"num_omap_keys":314,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"49'3432","reported_seq":2823,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:01.796529+0000","last_change":"2023-11-30T23:28:01.796633+0000","last_active":"2023-11-30T23:28:01.796529+0000","last_peered":"2023-11-30T23:28:01.796529+0000","last_clean":"2023-11-30T23:28:01.796529+0000","last_became_active":"2023-11-30T23:12:47.513966+0000","last_became_peered":"2023-11-30T23:12:47.513966+0000","last_unstale":"2023-11-30T23:28:01.796529+0000","last_undegraded":"2023-11-30T23:28:01.796529+0000","last_fullsized":"2023-11-30T23:28:01.796529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3432","last_scrub_stamp":"2023-11-30T23:28:01.796504+0000","last_deep_scrub":"49'3432","last_deep_scrub_stamp":"2023-11-30T23:28:01.796504+0000","last_clean_scrub_stamp":"2023-11-30T23:28:01.796504+0000","objects_scrubbed":1,"log_size":3432,"log_dups_size":0,"ondisk_log_size":3432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:18:44.817494+0000","scrub_duration":0.040597133000000001,"objects_trimmed":0,"snaptrim_duration":0.003646318,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"49'2309","reported_seq":2368,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.983621+0000","last_change":"2023-11-30T23:27:49.983621+0000","last_active":"2023-11-30T23:27:49.983621+0000","last_peered":"2023-11-30T23:27:49.983621+0000","last_clean":"2023-11-30T23:27:49.983621+0000","last_became_active":"2023-11-30T23:12:47.140565+0000","last_became_peered":"2023-11-30T23:12:47.140565+0000","last_unstale":"2023-11-30T23:27:49.983621+0000","last_undegraded":"2023-11-30T23:27:49.983621+0000","last_fullsized":"2023-11-30T23:27:49.983621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'2309","last_scrub_stamp":"2023-11-30T23:27:49.983450+0000","last_deep_scrub":"49'2309","last_deep_scrub_stamp":"2023-11-30T23:27:49.983450+0000","last_clean_scrub_stamp":"2023-11-30T23:27:49.983450+0000","objects_scrubbed":14,"log_size":2309,"log_dups_size":0,"ondisk_log_size":2309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:03:38.592123+0000","scrub_duration":0.051593888999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":2336,"num_write_kb":17365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":84032,"num_omap_keys":167,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"49'3598","reported_seq":2959,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:09.673859+0000","last_change":"2023-11-30T23:28:09.674062+0000","last_active":"2023-11-30T23:28:09.673859+0000","last_peered":"2023-11-30T23:28:09.673859+0000","last_clean":"2023-11-30T23:28:09.673859+0000","last_became_active":"2023-11-30T23:12:47.501315+0000","last_became_peered":"2023-11-30T23:12:47.501315+0000","last_unstale":"2023-11-30T23:28:09.673859+0000","last_undegraded":"2023-11-30T23:28:09.673859+0000","last_fullsized":"2023-11-30T23:28:09.673859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3598","last_scrub_stamp":"2023-11-30T23:28:09.673787+0000","last_deep_scrub":"49'3598","last_deep_scrub_stamp":"2023-11-30T23:28:09.673787+0000","last_clean_scrub_stamp":"2023-11-30T23:28:09.673787+0000","objects_scrubbed":3,"log_size":3598,"log_dups_size":0,"ondisk_log_size":3598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:18:45.321668+0000","scrub_duration":0.039006821999999997,"objects_trimmed":0,"snaptrim_duration":0.026736012999999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"49'2886","reported_seq":2945,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:07.112372+0000","last_change":"2023-11-30T23:28:07.112567+0000","last_active":"2023-11-30T23:28:07.112372+0000","last_peered":"2023-11-30T23:28:07.112372+0000","last_clean":"2023-11-30T23:28:07.112372+0000","last_became_active":"2023-11-30T23:12:47.140037+0000","last_became_peered":"2023-11-30T23:12:47.140037+0000","last_unstale":"2023-11-30T23:28:07.112372+0000","last_undegraded":"2023-11-30T23:28:07.112372+0000","last_fullsized":"2023-11-30T23:28:07.112372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'2886","last_scrub_stamp":"2023-11-30T23:28:07.112328+0000","last_deep_scrub":"49'2886","last_deep_scrub_stamp":"2023-11-30T23:28:07.112328+0000","last_clean_scrub_stamp":"2023-11-30T23:28:07.112328+0000","objects_scrubbed":15,"log_size":2886,"log_dups_size":0,"ondisk_log_size":2886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:18:42.760209+0000","scrub_duration":0.079742007000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":2935,"num_write_kb":26081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":70994,"num_omap_keys":141,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"49'3362","reported_seq":2788,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:15.685208+0000","last_change":"2023-11-30T23:28:15.685357+0000","last_active":"2023-11-30T23:28:15.685208+0000","last_peered":"2023-11-30T23:28:15.685208+0000","last_clean":"2023-11-30T23:28:15.685208+0000","last_became_active":"2023-11-30T23:12:47.507181+0000","last_became_peered":"2023-11-30T23:12:47.507181+0000","last_unstale":"2023-11-30T23:28:15.685208+0000","last_undegraded":"2023-11-30T23:28:15.685208+0000","last_fullsized":"2023-11-30T23:28:15.685208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3362","last_scrub_stamp":"2023-11-30T23:28:15.685181+0000","last_deep_scrub":"49'3362","last_deep_scrub_stamp":"2023-11-30T23:28:15.685181+0000","last_clean_scrub_stamp":"2023-11-30T23:28:15.685181+0000","objects_scrubbed":3,"log_size":3362,"log_dups_size":0,"ondisk_log_size":3362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:25:10.772298+0000","scrub_duration":0.040165856999999999,"objects_trimmed":0,"snaptrim_duration":0.030024714000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"49'4607","reported_seq":4665,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:15.063224+0000","last_change":"2023-11-30T23:28:15.063379+0000","last_active":"2023-11-30T23:28:15.063224+0000","last_peered":"2023-11-30T23:28:15.063224+0000","last_clean":"2023-11-30T23:28:15.063224+0000","last_became_active":"2023-11-30T23:12:47.141664+0000","last_became_peered":"2023-11-30T23:12:47.141664+0000","last_unstale":"2023-11-30T23:28:15.063224+0000","last_undegraded":"2023-11-30T23:28:15.063224+0000","last_fullsized":"2023-11-30T23:28:15.063224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4607","last_scrub_stamp":"2023-11-30T23:28:15.063200+0000","last_deep_scrub":"49'4607","last_deep_scrub_stamp":"2023-11-30T23:28:15.063200+0000","last_clean_scrub_stamp":"2023-11-30T23:28:15.063200+0000","objects_scrubbed":23,"log_size":4607,"log_dups_size":0,"ondisk_log_size":4607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:41:16.465072+0000","scrub_duration":0.083387379999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4647,"num_write_kb":30581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":137087,"num_omap_keys":273,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"49'3590","reported_seq":2945,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:10.571189+0000","last_change":"2023-11-30T23:28:10.571476+0000","last_active":"2023-11-30T23:28:10.571189+0000","last_peered":"2023-11-30T23:28:10.571189+0000","last_clean":"2023-11-30T23:28:10.571189+0000","last_became_active":"2023-11-30T23:12:47.516939+0000","last_became_peered":"2023-11-30T23:12:47.516939+0000","last_unstale":"2023-11-30T23:28:10.571189+0000","last_undegraded":"2023-11-30T23:28:10.571189+0000","last_fullsized":"2023-11-30T23:28:10.571189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3590","last_scrub_stamp":"2023-11-30T23:28:10.571134+0000","last_deep_scrub":"49'3590","last_deep_scrub_stamp":"2023-11-30T23:28:10.571134+0000","last_clean_scrub_stamp":"2023-11-30T23:28:10.571134+0000","objects_scrubbed":1,"log_size":3590,"log_dups_size":0,"ondisk_log_size":3590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:56:26.453525+0000","scrub_duration":0.037709890000000003,"objects_trimmed":0,"snaptrim_duration":0.014334588000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"48'3872","reported_seq":3224,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.073356+0000","last_change":"2023-11-30T23:27:40.517369+0000","last_active":"2023-11-30T23:27:49.073356+0000","last_peered":"2023-11-30T23:27:49.073356+0000","last_clean":"2023-11-30T23:27:49.073356+0000","last_became_active":"2023-11-30T23:12:47.521310+0000","last_became_peered":"2023-11-30T23:12:47.521310+0000","last_unstale":"2023-11-30T23:27:49.073356+0000","last_undegraded":"2023-11-30T23:27:49.073356+0000","last_fullsized":"2023-11-30T23:27:49.073356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3872,"log_dups_size":0,"ondisk_log_size":3872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015666933000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"49'637","reported_seq":695,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:18.002990+0000","last_change":"2023-11-30T23:28:18.003211+0000","last_active":"2023-11-30T23:28:18.002990+0000","last_peered":"2023-11-30T23:28:18.002990+0000","last_clean":"2023-11-30T23:28:18.002990+0000","last_became_active":"2023-11-30T23:12:47.143512+0000","last_became_peered":"2023-11-30T23:12:47.143512+0000","last_unstale":"2023-11-30T23:28:18.002990+0000","last_undegraded":"2023-11-30T23:28:18.002990+0000","last_fullsized":"2023-11-30T23:28:18.002990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'637","last_scrub_stamp":"2023-11-30T23:28:18.002965+0000","last_deep_scrub":"49'637","last_deep_scrub_stamp":"2023-11-30T23:28:18.002965+0000","last_clean_scrub_stamp":"2023-11-30T23:28:18.002965+0000","objects_scrubbed":15,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:26:28.869417+0000","scrub_duration":0.025368044999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":689,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":85608,"num_omap_keys":170,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"48'3820","reported_seq":3130,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.073315+0000","last_change":"2023-11-30T23:27:40.520201+0000","last_active":"2023-11-30T23:27:49.073315+0000","last_peered":"2023-11-30T23:27:49.073315+0000","last_clean":"2023-11-30T23:27:49.073315+0000","last_became_active":"2023-11-30T23:12:47.520322+0000","last_became_peered":"2023-11-30T23:12:47.520322+0000","last_unstale":"2023-11-30T23:27:49.073315+0000","last_undegraded":"2023-11-30T23:27:49.073315+0000","last_fullsized":"2023-11-30T23:27:49.073315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-30T23:12:47.099974+0000","last_clean_scrub_stamp":"2023-11-30T23:12:47.099974+0000","objects_scrubbed":0,"log_size":3820,"log_dups_size":0,"ondisk_log_size":3820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018218595000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"49'4596","reported_seq":4656,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:16.094875+0000","last_change":"2023-11-30T23:28:16.095089+0000","last_active":"2023-11-30T23:28:16.094875+0000","last_peered":"2023-11-30T23:28:16.094875+0000","last_clean":"2023-11-30T23:28:16.094875+0000","last_became_active":"2023-11-30T23:12:47.141965+0000","last_became_peered":"2023-11-30T23:12:47.141965+0000","last_unstale":"2023-11-30T23:28:16.094875+0000","last_undegraded":"2023-11-30T23:28:16.094875+0000","last_fullsized":"2023-11-30T23:28:16.094875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4596","last_scrub_stamp":"2023-11-30T23:28:16.094835+0000","last_deep_scrub":"49'4596","last_deep_scrub_stamp":"2023-11-30T23:28:16.094835+0000","last_clean_scrub_stamp":"2023-11-30T23:28:16.094835+0000","objects_scrubbed":26,"log_size":4596,"log_dups_size":0,"ondisk_log_size":4596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:02:45.261146+0000","scrub_duration":0.11253972399999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4627,"num_write_kb":34948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":138836,"num_omap_keys":276,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"49'3354","reported_seq":2807,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:26.490808+0000","last_change":"2023-11-30T23:28:26.491044+0000","last_active":"2023-11-30T23:28:26.490808+0000","last_peered":"2023-11-30T23:28:26.490808+0000","last_clean":"2023-11-30T23:28:26.490808+0000","last_became_active":"2023-11-30T23:12:47.522002+0000","last_became_peered":"2023-11-30T23:12:47.522002+0000","last_unstale":"2023-11-30T23:28:26.490808+0000","last_undegraded":"2023-11-30T23:28:26.490808+0000","last_fullsized":"2023-11-30T23:28:26.490808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3354","last_scrub_stamp":"2023-11-30T23:28:26.490741+0000","last_deep_scrub":"49'3354","last_deep_scrub_stamp":"2023-11-30T23:28:26.490741+0000","last_clean_scrub_stamp":"2023-11-30T23:28:26.490741+0000","objects_scrubbed":2,"log_size":3354,"log_dups_size":0,"ondisk_log_size":3354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:49:51.622648+0000","scrub_duration":0.025897142000000001,"objects_trimmed":0,"snaptrim_duration":0.025109995999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1079,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"49'4091","reported_seq":4150,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:51.788815+0000","last_change":"2023-11-30T23:27:51.789032+0000","last_active":"2023-11-30T23:27:51.788815+0000","last_peered":"2023-11-30T23:27:51.788815+0000","last_clean":"2023-11-30T23:27:51.788815+0000","last_became_active":"2023-11-30T23:12:47.138275+0000","last_became_peered":"2023-11-30T23:12:47.138275+0000","last_unstale":"2023-11-30T23:27:51.788815+0000","last_undegraded":"2023-11-30T23:27:51.788815+0000","last_fullsized":"2023-11-30T23:27:51.788815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4091","last_scrub_stamp":"2023-11-30T23:27:51.788769+0000","last_deep_scrub":"49'4091","last_deep_scrub_stamp":"2023-11-30T23:27:51.788769+0000","last_clean_scrub_stamp":"2023-11-30T23:27:51.788769+0000","objects_scrubbed":23,"log_size":4091,"log_dups_size":0,"ondisk_log_size":4091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:01:46.780974+0000","scrub_duration":0.097030336999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":4121,"num_write_kb":30658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":137716,"num_omap_keys":273,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"49'3347","reported_seq":2761,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:01.772486+0000","last_change":"2023-11-30T23:28:01.772617+0000","last_active":"2023-11-30T23:28:01.772486+0000","last_peered":"2023-11-30T23:28:01.772486+0000","last_clean":"2023-11-30T23:28:01.772486+0000","last_became_active":"2023-11-30T23:12:47.508718+0000","last_became_peered":"2023-11-30T23:12:47.508718+0000","last_unstale":"2023-11-30T23:28:01.772486+0000","last_undegraded":"2023-11-30T23:28:01.772486+0000","last_fullsized":"2023-11-30T23:28:01.772486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3347","last_scrub_stamp":"2023-11-30T23:28:01.772467+0000","last_deep_scrub":"49'3347","last_deep_scrub_stamp":"2023-11-30T23:28:01.772467+0000","last_clean_scrub_stamp":"2023-11-30T23:28:01.772467+0000","objects_scrubbed":1,"log_size":3347,"log_dups_size":0,"ondisk_log_size":3347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:07.257864+0000","scrub_duration":0.049927862000000003,"objects_trimmed":0,"snaptrim_duration":0.037282159000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"49'807","reported_seq":866,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:54.540611+0000","last_change":"2023-11-30T23:27:54.540737+0000","last_active":"2023-11-30T23:27:54.540611+0000","last_peered":"2023-11-30T23:27:54.540611+0000","last_clean":"2023-11-30T23:27:54.540611+0000","last_became_active":"2023-11-30T23:12:47.140891+0000","last_became_peered":"2023-11-30T23:12:47.140891+0000","last_unstale":"2023-11-30T23:27:54.540611+0000","last_undegraded":"2023-11-30T23:27:54.540611+0000","last_fullsized":"2023-11-30T23:27:54.540611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'807","last_scrub_stamp":"2023-11-30T23:27:54.540586+0000","last_deep_scrub":"49'807","last_deep_scrub_stamp":"2023-11-30T23:27:54.540586+0000","last_clean_scrub_stamp":"2023-11-30T23:27:54.540586+0000","objects_scrubbed":17,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:52:55.092935+0000","scrub_duration":0.051767756999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":847,"num_write_kb":12818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":125846,"num_omap_keys":246,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":74679,"num_write_kb":40592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228942,"ondisk_log_size":228942,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":275279537,"num_objects":614,"num_object_clones":0,"num_object_copies":1228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":614,"num_whiteouts":0,"num_read":1037,"num_read_kb":3420,"num_write":81074,"num_write_kb":625818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":540,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3578267,"num_omap_keys":7100,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":550617088,"data_stored":550559074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79243,"ondisk_log_size":79243,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575042,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":422580,"kb_used_data":70828,"kb_used_omap":0,"kb_used_meta":351744,"kb_avail":93949260,"statfs":{"total":96636764160,"available":96204042240,"internally_reserved":0,"allocated":72527872,"data_stored":72184368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":360185856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.34100000000000003,"5min":0.247,"15min":0.247},"max":{"1min":0.88300000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.169},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.85099999999999998,"15min":0.78500000000000003},"min":{"1min":0.29299999999999998,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":1.171,"5min":6.9429999999999996,"15min":6.9429999999999996},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.82199999999999995,"5min":7.0540000000000003,"15min":7.0540000000000003},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.749},"min":{"1min":0.54200000000000004,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.89700000000000002,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.82899999999999996,"15min":0.82699999999999996},"min":{"1min":0.373,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.0369999999999999,"5min":5.54,"15min":5.54},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.84299999999999997,"15min":0.83999999999999997},"min":{"1min":0.437,"5min":0.312,"15min":0.312},"max":{"1min":0.95499999999999996,"5min":5.5880000000000001,"15min":5.5880000000000001},"last":1.0780000000000001}]},{"osd":3,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.91800000000000004,"15min":0.89900000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1379999999999999,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.94399999999999995,"15min":0.95499999999999996},"min":{"1min":0.54000000000000004,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":1.093,"5min":4.6589999999999998,"15min":4.6589999999999998},"last":1.1439999999999999}]},{"osd":4,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68700000000000006,"15min":0.76300000000000001},"min":{"1min":0.41699999999999998,"5min":0.316,"15min":0.314},"max":{"1min":1.069,"5min":1.3029999999999999,"15min":1.3759999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.78800000000000003,"15min":0.872},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.244,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77900000000000003,"15min":0.86299999999999999},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.097,"5min":1.7110000000000001,"15min":1.7210000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.81799999999999995,"15min":0.879},"min":{"1min":0.49299999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2330000000000001,"5min":1.796,"15min":1.796},"last":1.04}]},{"osd":6,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.873,"15min":0.93899999999999995},"min":{"1min":0.69499999999999995,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3620000000000001,"5min":1.694,"15min":2.9670000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90200000000000002,"15min":0.97499999999999998},"min":{"1min":0.46700000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.226,"5min":2.23,"15min":2.23},"last":1.107}]}]},{"osd":6,"up_from":13,"seq":55834575042,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":346012,"kb_used_data":90196,"kb_used_omap":0,"kb_used_meta":255808,"kb_avail":94025828,"statfs":{"total":96636764160,"available":96282447872,"internally_reserved":0,"allocated":92360704,"data_stored":92035739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":261947392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.73999999999999999,"15min":0.73799999999999999},"min":{"1min":0.28899999999999998,"5min":0.23999999999999999,"15min":0.221},"max":{"1min":1.722,"5min":2.1640000000000001,"15min":2.5640000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78000000000000003,"15min":0.77900000000000003},"min":{"1min":0.29899999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.389,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Nov 30 23:28:15 2023","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":0.99299999999999999,"15min":0.91700000000000004},"min":{"1min":0.32100000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":10.983000000000001,"5min":10.983000000000001,"15min":12.172000000000001},"last":1.149},{"interface":"front","average":{"1min":1.052,"5min":0.89200000000000002,"15min":0.85799999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":5.6980000000000004},"last":0.91100000000000003}]},{"osd":2,"last update":"Thu Nov 30 23:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78600000000000003,"15min":0.78200000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.948,"5min":2.327,"15min":2.327},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.85399999999999998,"15min":0.872},"min":{"1min":0.41999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.7430000000000001,"5min":2.1240000000000001,"15min":2.774},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Nov 30 23:28:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":0.96299999999999997,"15min":0.90500000000000003},"min":{"1min":0.58099999999999996,"5min":0.434,"15min":0.38900000000000001},"max":{"1min":5.3339999999999996,"5min":5.3339999999999996,"15min":5.3339999999999996},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.363,"5min":0.96599999999999997,"15min":0.89700000000000002},"min":{"1min":0.36399999999999999,"5min":0.318,"15min":0.318},"max":{"1min":9.3249999999999993,"5min":9.3249999999999993,"15min":9.3249999999999993},"last":1.1739999999999999}]},{"osd":4,"last update":"Thu Nov 30 23:28:15 2023","interfaces":[{"interface":"back","average":{"1min":1.641,"5min":0.90600000000000003,"15min":0.88500000000000001},"min":{"1min":0.43099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":15.194000000000001,"5min":15.194000000000001,"15min":15.194000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":2.0630000000000002,"5min":1.101,"15min":0.96399999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":21.247,"5min":21.247,"15min":21.247},"last":1.119}]},{"osd":5,"last update":"Thu Nov 30 23:28:15 2023","interfaces":[{"interface":"back","average":{"1min":2.133,"5min":1.0800000000000001,"15min":0.93300000000000005},"min":{"1min":0.435,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":23.149000000000001,"5min":23.149000000000001,"15min":23.149000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":1,"5min":0.90400000000000003,"15min":0.97299999999999998},"min":{"1min":0.32200000000000001,"5min":0.314,"15min":0.314},"max":{"1min":2.0259999999999998,"5min":2.2400000000000002,"15min":2.7040000000000002},"last":1.2470000000000001}]},{"osd":7,"last update":"Thu Nov 30 23:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.0720000000000001,"15min":1.0409999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.274,"5min":11.220000000000001,"15min":11.220000000000001},"last":1.222},{"interface":"front","average":{"1min":1.05,"5min":1.103,"15min":1.139},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.893,"5min":12.874000000000001,"15min":30.405999999999999},"last":1.29}]}]},{"osd":5,"up_from":13,"seq":55834575042,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":384304,"kb_used_data":86632,"kb_used_omap":0,"kb_used_meta":297664,"kb_avail":93987536,"statfs":{"total":96636764160,"available":96243236864,"internally_reserved":0,"allocated":88711168,"data_stored":88370710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304807936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":2.4260000000000002,"5min":0.98999999999999999,"15min":0.81599999999999995},"min":{"1min":0.55800000000000005,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":28.123000000000001,"5min":28.123000000000001,"15min":28.123000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":2.2080000000000002,"5min":1.0309999999999999,"15min":0.84299999999999997},"min":{"1min":0.56699999999999995,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":24.707000000000001,"5min":24.707000000000001,"15min":24.707000000000001},"last":0.752}]},{"osd":1,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":2.1230000000000002,"5min":1.0449999999999999,"15min":0.90300000000000002},"min":{"1min":0.47499999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":22.565999999999999,"5min":22.565999999999999,"15min":22.565999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":2.1560000000000001,"5min":1.0449999999999999,"15min":0.94399999999999995},"min":{"1min":0.68899999999999995,"5min":0.313,"15min":0.313},"max":{"1min":22.395,"5min":22.395,"15min":22.395},"last":1.266}]},{"osd":2,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":2.7519999999999998,"5min":1.1419999999999999,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.311,"15min":0.26700000000000002},"max":{"1min":33.149000000000001,"5min":33.149000000000001,"15min":33.149000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":2.101,"5min":1.036,"15min":0.91600000000000004},"min":{"1min":0.61099999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":22.699000000000002,"5min":22.699000000000002,"15min":22.699000000000002},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":2.1360000000000001,"5min":1.081,"15min":0.93300000000000005},"min":{"1min":0.629,"5min":0.314,"15min":0.314},"max":{"1min":22.943000000000001,"5min":22.943000000000001,"15min":22.943000000000001},"last":1.365},{"interface":"front","average":{"1min":2.4500000000000002,"5min":1.1419999999999999,"15min":1.0109999999999999},"min":{"1min":0.59399999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":27.643999999999998,"5min":27.643999999999998,"15min":27.643999999999998},"last":1.171}]},{"osd":4,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.70099999999999996,"15min":0.80100000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.335,"5min":1.456,"15min":1.4930000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81899999999999995,"15min":0.85499999999999998},"min":{"1min":0.44600000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.3029999999999999,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.137}]},{"osd":6,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":0.88700000000000001,"15min":0.90400000000000003},"min":{"1min":0.622,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":5.3719999999999999,"5min":5.3719999999999999,"15min":5.3719999999999999},"last":1.232},{"interface":"front","average":{"1min":0.996,"5min":0.86399999999999999,"15min":0.93200000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.9370000000000001,"5min":3.073,"15min":3.073},"last":1.419}]},{"osd":7,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.89100000000000001,"15min":0.94199999999999995},"min":{"1min":0.41999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.4970000000000001,"5min":2.895,"15min":2.895},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.282,"5min":0.97499999999999998,"15min":0.995},"min":{"1min":0.52600000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":5.4139999999999997,"5min":5.4139999999999997,"15min":5.4139999999999997},"last":1.3200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575041,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":349356,"kb_used_data":65636,"kb_used_omap":0,"kb_used_meta":283712,"kb_avail":94022484,"statfs":{"total":96636764160,"available":96279023616,"internally_reserved":0,"allocated":67211264,"data_stored":66877715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":290521088},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:28:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.83899999999999997,"15min":0.749},"min":{"1min":0.39500000000000002,"5min":0.245,"15min":0.245},"max":{"1min":1.2589999999999999,"5min":12.91,"15min":12.91},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.86199999999999999,"15min":0.77800000000000002},"min":{"1min":0.48099999999999998,"5min":0.253,"15min":0.253},"max":{"1min":1.1639999999999999,"5min":12.962,"15min":12.962},"last":0.999}]},{"osd":1,"last update":"Thu Nov 30 23:28:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.76600000000000001,"15min":0.77900000000000003},"min":{"1min":0.45300000000000001,"5min":0.32600000000000001,"15min":0.25600000000000001},"max":{"1min":1.236,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.82899999999999996,"15min":0.78500000000000003},"min":{"1min":0.57999999999999996,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1080000000000001,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":0.92900000000000005}]},{"osd":2,"last update":"Thu Nov 30 23:28:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84999999999999998,"15min":0.81000000000000005},"min":{"1min":0.51800000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.27,"5min":9.0229999999999997,"15min":9.0229999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.91900000000000004,"15min":0.89900000000000002},"min":{"1min":0.56100000000000005,"5min":0.376,"15min":0.33600000000000002},"max":{"1min":1.2250000000000001,"5min":8.9990000000000006,"15min":8.9990000000000006},"last":0.95399999999999996}]},{"osd":3,"last update":"Thu Nov 30 23:28:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.87,"15min":0.84899999999999998},"min":{"1min":0.63300000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1379999999999999,"5min":5.0209999999999999,"15min":5.0209999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.80600000000000005,"15min":0.82499999999999996},"min":{"1min":0.57199999999999995,"5min":0.311,"15min":0.311},"max":{"1min":1.1020000000000001,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Nov 30 23:28:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":1.5649999999999999,"15min":1.073},"min":{"1min":0.434,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0249999999999999,"5min":81.837000000000003,"15min":81.837000000000003},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.7030000000000001,"15min":1.1759999999999999},"min":{"1min":0.71599999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.222,"5min":81.751999999999995,"15min":81.751999999999995},"last":0.86899999999999999}]},{"osd":6,"last update":"Thu Nov 30 23:28:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.573,"15min":1.093},"min":{"1min":0.46300000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.204,"5min":79.655000000000001,"15min":79.655000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.673,"15min":1.202},"min":{"1min":0.60699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.339,"5min":80.540000000000006,"15min":80.540000000000006},"last":0.90000000000000002}]},{"osd":7,"last update":"Thu Nov 30 23:28:13 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.7210000000000001,"15min":1.206},"min":{"1min":0.49299999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.29,"5min":80.486000000000004,"15min":80.486000000000004},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.03,"5min":1.724,"15min":1.2},"min":{"1min":0.53900000000000003,"5min":0.373,"15min":0.373},"max":{"1min":1.343,"5min":81.875,"15min":81.875},"last":0.68799999999999994}]}]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370932,"kb_used_data":61036,"kb_used_omap":0,"kb_used_meta":309888,"kb_avail":94000908,"statfs":{"total":96636764160,"available":96256929792,"internally_reserved":0,"allocated":62500864,"data_stored":62176772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":317325312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.41999999999999998,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.05,"5min":1.2130000000000001,"15min":2.6589999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.34100000000000003,"5min":0.24299999999999999,"15min":0.23999999999999999},"max":{"1min":1.018,"5min":2.1850000000000001,"15min":2.4750000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.29499999999999998,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.86799999999999999,"5min":1.125,"15min":1.6319999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.749,"15min":0.77600000000000002},"min":{"1min":0.40100000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0620000000000001,"5min":1.256,"15min":4.8150000000000004},"last":0.95199999999999996}]},{"osd":2,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.77000000000000002},"min":{"1min":0.42699999999999999,"5min":0.35599999999999998,"15min":0.28000000000000003},"max":{"1min":0.96699999999999997,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82999999999999996,"15min":0.84999999999999998},"min":{"1min":0.55700000000000005,"5min":0.252,"15min":0.252},"max":{"1min":1.048,"5min":1.3580000000000001,"15min":4.8719999999999999},"last":1.0189999999999999}]},{"osd":4,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.89800000000000002,"15min":0.89600000000000002},"min":{"1min":0.66200000000000003,"5min":0.34100000000000003,"15min":0.31},"max":{"1min":1.6970000000000001,"5min":1.8919999999999999,"15min":2.536},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95799999999999996,"15min":0.95599999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.378},"max":{"1min":1.3,"5min":4.6820000000000004,"15min":4.6820000000000004},"last":1.5449999999999999}]},{"osd":5,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0629999999999999,"15min":1.0209999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.42099999999999999},"max":{"1min":1.3440000000000001,"5min":8.8010000000000002,"15min":8.8010000000000002},"last":1.381},{"interface":"front","average":{"1min":0.999,"5min":0.98699999999999999,"15min":1.04},"min":{"1min":0.47799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.2410000000000001,"5min":1.8500000000000001,"15min":4.9909999999999997},"last":1.2310000000000001}]},{"osd":6,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0389999999999999,"15min":1.02},"min":{"1min":0.60499999999999998,"5min":0.52100000000000002,"15min":0.378},"max":{"1min":1.284,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.0069999999999999,"15min":1.0649999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.45500000000000002},"max":{"1min":1.3380000000000001,"5min":1.4410000000000001,"15min":4.4379999999999997},"last":1.4770000000000001}]},{"osd":7,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0349999999999999,"15min":1.087},"min":{"1min":0.625,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.381,"5min":1.4910000000000001,"15min":5.0369999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.052,"15min":1.069},"min":{"1min":0.65300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.355,"5min":2.214,"15min":2.5609999999999999},"last":1.2090000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575043,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224108,"kb_used_data":40548,"kb_used_omap":0,"kb_used_meta":183552,"kb_avail":94147732,"statfs":{"total":96636764160,"available":96407277568,"internally_reserved":0,"allocated":41521152,"data_stored":41200500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":187957248},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.432,"5min":0.216,"15min":0.216},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.41699999999999998,"5min":0.222,"15min":0.17999999999999999},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":0.97999999999999998,"15min":0.80300000000000005},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":18.102,"5min":18.102,"15min":18.102},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.749,"15min":0.77400000000000002},"min":{"1min":0.32200000000000001,"5min":0.27500000000000002,"15min":0.224},"max":{"1min":1.899,"5min":1.899,"15min":11.457000000000001},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":2.198,"5min":1.087,"15min":0.83699999999999997},"min":{"1min":0.35799999999999998,"5min":0.224,"15min":0.224},"max":{"1min":29.039000000000001,"5min":29.039000000000001,"15min":29.039000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.876,"15min":0.85799999999999998},"min":{"1min":0.54400000000000004,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":0.74199999999999999}]},{"osd":4,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.85799999999999998,"15min":0.88300000000000001},"min":{"1min":0.44,"5min":0.30599999999999999,"15min":0.28299999999999997},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.872},{"interface":"front","average":{"1min":1,"5min":0.89500000000000002,"15min":0.879},"min":{"1min":0.59399999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.7160000000000002,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.997,"15min":1.0009999999999999},"min":{"1min":0.60899999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.829,"5min":2.323,"15min":2.323},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.401,"5min":1.073,"15min":1.024},"min":{"1min":0.47699999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":9.6150000000000002,"5min":9.6150000000000002,"15min":9.6150000000000002},"last":1.0649999999999999}]},{"osd":6,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.02,"15min":0.97599999999999998},"min":{"1min":0.45700000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":3.7549999999999999,"5min":4.9420000000000002,"15min":4.9420000000000002},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.7270000000000001,"5min":1.1879999999999999,"15min":1.1080000000000001},"min":{"1min":0.65700000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":13.433,"5min":13.433,"15min":13.433},"last":0.96699999999999997}]},{"osd":7,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.0649999999999999,"15min":1.0669999999999999},"min":{"1min":0.623,"5min":0.376,"15min":0.376},"max":{"1min":3.9399999999999999,"5min":3.9399999999999999,"15min":3.9399999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.1020000000000001,"15min":1.054},"min":{"1min":0.58399999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.782,"5min":3.782,"15min":3.782},"last":0.997}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396572,"kb_used_data":86612,"kb_used_omap":0,"kb_used_meta":309952,"kb_avail":93975268,"statfs":{"total":96636764160,"available":96230674432,"internally_reserved":0,"allocated":88690688,"data_stored":88358599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":317390848},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63600000000000001,"15min":0.60299999999999998},"min":{"1min":0.28499999999999998,"5min":0.24299999999999999,"15min":0.183},"max":{"1min":0.99399999999999999,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.67900000000000005,"15min":0.66500000000000004},"min":{"1min":0.28000000000000003,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.77400000000000002}]},{"osd":2,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.175,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.745,"15min":0.72599999999999998},"min":{"1min":0.316,"5min":0.26000000000000001,"15min":0.20699999999999999},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.93999999999999995}]},{"osd":3,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77400000000000002,"15min":0.79400000000000004},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.222,"5min":1.222,"15min":1.431},"last":1},{"interface":"front","average":{"1min":0.752,"5min":0.76800000000000002,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.137,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.82099999999999995}]},{"osd":4,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.86899999999999999,"15min":0.877},"min":{"1min":0.58099999999999996,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.538,"5min":3.476,"15min":3.476},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.85899999999999999,"15min":0.879},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.6919999999999999},"last":1.079}]},{"osd":5,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83399999999999996,"15min":0.84299999999999997},"min":{"1min":0.38800000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.2809999999999999,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.0129999999999999,"15min":0.995},"min":{"1min":0.53400000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":1.1299999999999999}]},{"osd":6,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.91700000000000004,"15min":0.92500000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.351,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":1.3680000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.016,"15min":1.018},"min":{"1min":0.68300000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.496,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.98499999999999999,"15min":0.999},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":1.4019999999999999,"5min":2.7549999999999999,"15min":2.7549999999999999},"last":1.2789999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.98799999999999999,"15min":0.997},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.5980000000000001,"5min":3.2280000000000002,"15min":3.2280000000000002},"last":1.3220000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575042,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243824,"kb_used_data":42152,"kb_used_omap":0,"kb_used_meta":201664,"kb_avail":94128016,"statfs":{"total":96636764160,"available":96387088384,"internally_reserved":0,"allocated":43163648,"data_stored":42816095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":206503936},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63800000000000001,"15min":0.61499999999999999},"min":{"1min":0.32500000000000001,"5min":0.26800000000000002,"15min":0.20999999999999999},"max":{"1min":1.048,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.67700000000000005,"15min":0.66600000000000004},"min":{"1min":0.36499999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.486,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":1.798,"5min":0.94899999999999995,"15min":0.81599999999999995},"min":{"1min":0.38400000000000001,"5min":0.311,"15min":0.23699999999999999},"max":{"1min":16.774999999999999,"5min":16.774999999999999,"15min":16.774999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.798,"5min":0.97399999999999998,"15min":0.84099999999999997},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":16.652999999999999,"5min":16.652999999999999,"15min":16.652999999999999},"last":0.76400000000000001}]},{"osd":3,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69899999999999995,"15min":0.71599999999999997},"min":{"1min":0.378,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.85599999999999998,"5min":1.387,"15min":4.3170000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85099999999999998,"15min":0.83199999999999996},"min":{"1min":0.439,"5min":0.254,"15min":0.254},"max":{"1min":1.036,"5min":1.925,"15min":2.395},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90500000000000003,"15min":0.88500000000000001},"min":{"1min":0.36899999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.3180000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.1839999999999999,"5min":0.92600000000000005,"15min":0.90600000000000003},"min":{"1min":0.40699999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":5.5720000000000001,"5min":5.5720000000000001,"15min":5.5720000000000001},"last":0.93700000000000006}]},{"osd":5,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":2.1190000000000002,"5min":1.131,"15min":0.98799999999999999},"min":{"1min":0.59899999999999998,"5min":0.315,"15min":0.315},"max":{"1min":19.577999999999999,"5min":19.577999999999999,"15min":19.577999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":4.3890000000000002,"5min":1.724,"15min":1.2869999999999999},"min":{"1min":0.54500000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":52.176000000000002,"5min":52.176000000000002,"15min":52.176000000000002},"last":1.216}]},{"osd":6,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.0720000000000001,"15min":1.0649999999999999},"min":{"1min":0.68300000000000005,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.341,"5min":2.0840000000000001,"15min":2.5209999999999999},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.026,"15min":1.018},"min":{"1min":0.45700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.2529999999999999,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.96799999999999997}]},{"osd":7,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.0720000000000001,"15min":1.083},"min":{"1min":0.49399999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.395,"5min":2.254,"15min":8.3490000000000002},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0049999999999999,"15min":1.0309999999999999},"min":{"1min":0.57999999999999996,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2170000000000001,"5min":1.9059999999999999,"15min":6.1529999999999996},"last":1.014}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41955328,"data_stored":41943678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":88088576,"data_stored":88080689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40919040,"data_stored":40918503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61898752,"data_stored":61890695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":66600960,"data_stored":66587530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":88084480,"data_stored":88080474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":91762688,"data_stored":91753755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":28760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":24621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":28708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":32788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":36947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":28695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":36961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T23:28:32.843 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:32.843 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:32.844 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:32.844 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:32.844 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:32.844 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:32.844 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:32.844 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:32.845 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:32.845 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:32.845 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:32.846 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:32.846 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:32.846 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:32.846 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:32.847 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:32.847 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:32.848 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-11-30T23:12:47.099974+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=12, tm_sec=47, tm_wday=3, tm_yday=334, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=30, tm_hour=23, tm_min=27, tm_sec=46, tm_wday=3, tm_yday=334, tm_isdst=0) 2023-11-30T23:28:32.848 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-30T23:28:52.849 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-30T23:28:52.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94359e700 1 Processor -- start 2023-11-30T23:28:52.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94359e700 1 -- start start 2023-11-30T23:28:52.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94359e700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff9440b2710 0x7ff9440aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:52.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94359e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441470a0 0x7ff94413d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:52.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94359e700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94406f210 con 0x7ff94413d070 2023-11-30T23:28:52.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94359e700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9440afe30 con 0x7ff9440b2710 2023-11-30T23:28:52.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94359e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440af4e0 con 0x7ff9441470a0 2023-11-30T23:28:52.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff942d9d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441470a0 0x7ff94413d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:52.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94259c700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff9440b2710 0x7ff9440aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:52.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff941d9b700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff94413d070 0x7ff944146990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.73:46968/0 (socket says 172.21.15.73:46968) 2023-11-30T23:28:52.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff941d9b700 1 -- 172.21.15.73:0/1778975296 learned_addr learned my addr 172.21.15.73:0/1778975296 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:28:52.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94159a700 1 -- 172.21.15.73:0/1778975296 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223514020 0 0) 0x7ff94406f210 con 0x7ff94413d070 2023-11-30T23:28:52.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94159a700 1 -- 172.21.15.73:0/1778975296 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff92c0057e0 con 0x7ff94413d070 2023-11-30T23:28:52.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff942d9d700 1 -- 172.21.15.73:0/1778975296 >> v2:172.21.15.156:3300/0 conn(0x7ff9440b2710 msgr2=0x7ff9440aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:28:52.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff942d9d700 1 --2- 172.21.15.73:0/1778975296 >> v2:172.21.15.156:3300/0 conn(0x7ff9440b2710 0x7ff9440aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:52.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff942d9d700 1 -- 172.21.15.73:0/1778975296 >> v1:172.21.15.156:6789/0 conn(0x7ff94413d070 legacy=0x7ff944146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:52.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff942d9d700 1 -- 172.21.15.73:0/1778975296 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9440b2af0 con 0x7ff9441470a0 2023-11-30T23:28:52.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff942d9d700 1 --2- 172.21.15.73:0/1778975296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441470a0 0x7ff94413d4d0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009850 tx=0x7ff93c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c559489b3bf9a8b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:52.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94159a700 1 -- 172.21.15.73:0/1778975296 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c011830 con 0x7ff9441470a0 2023-11-30T23:28:52.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94159a700 1 -- 172.21.15.73:0/1778975296 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c011990 con 0x7ff9441470a0 2023-11-30T23:28:52.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94159a700 1 -- 172.21.15.73:0/1778975296 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c011d40 con 0x7ff9441470a0 2023-11-30T23:28:52.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94359e700 1 -- 172.21.15.73:0/1778975296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441470a0 msgr2=0x7ff94413d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:52.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94359e700 1 --2- 172.21.15.73:0/1778975296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441470a0 0x7ff94413d4d0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009850 tx=0x7ff93c009b60 comp rx=0 tx=0).stop 2023-11-30T23:28:52.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94359e700 1 -- 172.21.15.73:0/1778975296 shutdown_connections 2023-11-30T23:28:52.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94359e700 1 --2- 172.21.15.73:0/1778975296 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441470a0 0x7ff94413d4d0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:52.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94359e700 1 --2- 172.21.15.73:0/1778975296 >> v2:172.21.15.156:3300/0 conn(0x7ff9440b2710 0x7ff9440aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:52.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94359e700 1 -- 172.21.15.73:0/1778975296 >> 172.21.15.73:0/1778975296 conn(0x7ff9440b45a0 msgr2=0x7ff9440b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:52.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94359e700 1 -- 172.21.15.73:0/1778975296 shutdown_connections 2023-11-30T23:28:52.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.972+0000 7ff94359e700 1 -- 172.21.15.73:0/1778975296 wait complete. 2023-11-30T23:28:52.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff94359e700 1 Processor -- start 2023-11-30T23:28:52.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff94359e700 1 -- start start 2023-11-30T23:28:52.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff94359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9440b2710 0x7ff9441db4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:52.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff94359e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff94413d070 0x7ff944142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:52.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff94359e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441470a0 0x7ff94413ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:52.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff94359e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9441433d0 con 0x7ff9440b2710 2023-11-30T23:28:52.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff94359e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9441db060 con 0x7ff94413d070 2023-11-30T23:28:52.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff94359e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff944142e80 con 0x7ff9441470a0 2023-11-30T23:28:52.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff94259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9440b2710 0x7ff9441db4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:52.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff941d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff94413d070 0x7ff944142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:52.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff94259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9440b2710 0x7ff9441db4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39248/0 (socket says 172.21.15.73:39248) 2023-11-30T23:28:52.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff94259c700 1 -- 172.21.15.73:0/3005244588 learned_addr learned my addr 172.21.15.73:0/3005244588 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:28:52.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff942d9d700 1 --2- 172.21.15.73:0/3005244588 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441470a0 0x7ff94413ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:52.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff94259c700 1 -- 172.21.15.73:0/3005244588 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441470a0 msgr2=0x7ff94413ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:52.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff94259c700 1 --2- 172.21.15.73:0/3005244588 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441470a0 0x7ff94413ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:52.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff94259c700 1 -- 172.21.15.73:0/3005244588 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff94413d070 msgr2=0x7ff944142940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:52.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff94259c700 1 --2- 172.21.15.73:0/3005244588 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff94413d070 0x7ff944142940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:52.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff94259c700 1 -- 172.21.15.73:0/3005244588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c0094b0 con 0x7ff9440b2710 2023-11-30T23:28:52.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff941d9b700 1 --2- 172.21.15.73:0/3005244588 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff94413d070 0x7ff944142940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-30T23:28:52.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff94259c700 1 --2- 172.21.15.73:0/3005244588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9440b2710 0x7ff9441db4f0 secure :-1 s=READY pgs=4266 cs=0 l=1 rev1=1 crypto rx=0x7ff93800e9d0 tx=0x7ff93800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:52.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.976+0000 7ff932ffd700 1 -- 172.21.15.73:0/3005244588 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff938009720 con 0x7ff9440b2710 2023-11-30T23:28:52.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.980+0000 7ff932ffd700 1 -- 172.21.15.73:0/3005244588 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93800ee70 con 0x7ff9440b2710 2023-11-30T23:28:52.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.980+0000 7ff94359e700 1 -- 172.21.15.73:0/3005244588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9441daa10 con 0x7ff9440b2710 2023-11-30T23:28:52.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.980+0000 7ff932ffd700 1 -- 172.21.15.73:0/3005244588 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93800ca50 con 0x7ff9440b2710 2023-11-30T23:28:52.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.980+0000 7ff94359e700 1 -- 172.21.15.73:0/3005244588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94413b070 con 0x7ff9440b2710 2023-11-30T23:28:52.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.980+0000 7ff94359e700 1 -- 172.21.15.73:0/3005244588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94406ed00 con 0x7ff9440b2710 2023-11-30T23:28:52.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.980+0000 7ff932ffd700 1 -- 172.21.15.73:0/3005244588 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff93800cbb0 con 0x7ff9440b2710 2023-11-30T23:28:52.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.980+0000 7ff932ffd700 1 --2- 172.21.15.73:0/3005244588 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff924065b00 0x7ff924067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:52.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.980+0000 7ff941d9b700 1 --2- 172.21.15.73:0/3005244588 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff924065b00 0x7ff924067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:52.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.980+0000 7ff932ffd700 1 -- 172.21.15.73:0/3005244588 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7ff938083180 con 0x7ff9440b2710 2023-11-30T23:28:52.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.984+0000 7ff941d9b700 1 --2- 172.21.15.73:0/3005244588 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff924065b00 0x7ff924067fc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff94413b5e0 tx=0x7ff934001a90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:52.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:52.992+0000 7ff932ffd700 1 -- 172.21.15.73:0/3005244588 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7ff938050aa0 con 0x7ff9440b2710 2023-11-30T23:28:53.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.156+0000 7ff94359e700 1 -- 172.21.15.73:0/3005244588 --> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9440afa50 con 0x7ff924065b00 2023-11-30T23:28:53.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.172+0000 7ff932ffd700 1 -- 172.21.15.73:0/3005244588 <== mgr.4104 v2:172.21.15.73:6832/36559 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+293676 (secure 0 0 0) 0x7ff934014450 con 0x7ff924065b00 2023-11-30T23:28:53.180 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:28:53.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.176+0000 7ff94359e700 1 -- 172.21.15.73:0/3005244588 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff924065b00 msgr2=0x7ff924067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:53.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.176+0000 7ff94359e700 1 --2- 172.21.15.73:0/3005244588 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff924065b00 0x7ff924067fc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff94413b5e0 tx=0x7ff934001a90 comp rx=0 tx=0).stop 2023-11-30T23:28:53.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.176+0000 7ff94359e700 1 -- 172.21.15.73:0/3005244588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9440b2710 msgr2=0x7ff9441db4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:53.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.176+0000 7ff94359e700 1 --2- 172.21.15.73:0/3005244588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9440b2710 0x7ff9441db4f0 secure :-1 s=READY pgs=4266 cs=0 l=1 rev1=1 crypto rx=0x7ff93800e9d0 tx=0x7ff93800ece0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.176+0000 7ff94359e700 1 -- 172.21.15.73:0/3005244588 shutdown_connections 2023-11-30T23:28:53.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.180+0000 7ff94359e700 1 --2- 172.21.15.73:0/3005244588 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7ff9441470a0 0x7ff94413ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.180+0000 7ff94359e700 1 --2- 172.21.15.73:0/3005244588 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7ff924065b00 0x7ff924067fc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.180+0000 7ff94359e700 1 --2- 172.21.15.73:0/3005244588 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff94413d070 0x7ff944142940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.180+0000 7ff94359e700 1 --2- 172.21.15.73:0/3005244588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9440b2710 0x7ff9441db4f0 unknown :-1 s=CLOSED pgs=4266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.180+0000 7ff94359e700 1 -- 172.21.15.73:0/3005244588 >> 172.21.15.73:0/3005244588 conn(0x7ff9440b45a0 msgr2=0x7ff944144650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:53.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.180+0000 7ff94359e700 1 -- 172.21.15.73:0/3005244588 shutdown_connections 2023-11-30T23:28:53.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.180+0000 7ff94359e700 1 -- 172.21.15.73:0/3005244588 wait complete. 2023-11-30T23:28:53.184 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-11-30T23:28:53.196 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":532,"stamp":"2023-11-30T23:28:52.696378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":275997093,"num_objects":743,"num_object_clones":28,"num_object_copies":1486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":743,"num_whiteouts":15,"num_read":1184,"num_read_kb":3541,"num_write":155912,"num_write_kb":668826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":540,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3578267,"num_omap_keys":7100,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":308344,"ondisk_log_size":308344,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2741784,"kb_used_data":543640,"kb_used_omap":0,"kb_used_meta":2198080,"kb_avail":752232936,"statfs":{"total":773094113280,"available":770286526464,"internally_reserved":0,"allocated":556687360,"data_stored":554020498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2250833920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004898"},"pg_stats":[{"pgid":"3.3f","version":"49'3485","reported_seq":2893,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:47.914557+0000","last_change":"2023-11-30T23:28:47.914724+0000","last_active":"2023-11-30T23:28:47.914557+0000","last_peered":"2023-11-30T23:28:47.914557+0000","last_clean":"2023-11-30T23:28:47.914557+0000","last_became_active":"2023-11-30T23:12:47.512980+0000","last_became_peered":"2023-11-30T23:12:47.512980+0000","last_unstale":"2023-11-30T23:28:47.914557+0000","last_undegraded":"2023-11-30T23:28:47.914557+0000","last_fullsized":"2023-11-30T23:28:47.914557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3485","last_scrub_stamp":"2023-11-30T23:28:47.914533+0000","last_deep_scrub":"49'3485","last_deep_scrub_stamp":"2023-11-30T23:28:47.914533+0000","last_clean_scrub_stamp":"2023-11-30T23:28:47.914533+0000","objects_scrubbed":4,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:16:15.674948+0000","scrub_duration":0.036538848999999998,"objects_trimmed":0,"snaptrim_duration":0.0061607720000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1134,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"49'3351","reported_seq":2791,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:18.896980+0000","last_change":"2023-11-30T23:28:18.897137+0000","last_active":"2023-11-30T23:28:18.896980+0000","last_peered":"2023-11-30T23:28:18.896980+0000","last_clean":"2023-11-30T23:28:18.896980+0000","last_became_active":"2023-11-30T23:12:47.508771+0000","last_became_peered":"2023-11-30T23:12:47.508771+0000","last_unstale":"2023-11-30T23:28:18.896980+0000","last_undegraded":"2023-11-30T23:28:18.896980+0000","last_fullsized":"2023-11-30T23:28:18.896980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3351","last_scrub_stamp":"2023-11-30T23:28:18.896957+0000","last_deep_scrub":"49'3351","last_deep_scrub_stamp":"2023-11-30T23:28:18.896957+0000","last_clean_scrub_stamp":"2023-11-30T23:28:18.896957+0000","objects_scrubbed":4,"log_size":3351,"log_dups_size":0,"ondisk_log_size":3351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:02:16.995243+0000","scrub_duration":0.037289786999999998,"objects_trimmed":0,"snaptrim_duration":0.055178039999999998,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1093,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"49'3514","reported_seq":2928,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:01.610476+0000","last_change":"2023-11-30T23:28:01.610618+0000","last_active":"2023-11-30T23:28:01.610476+0000","last_peered":"2023-11-30T23:28:01.610476+0000","last_clean":"2023-11-30T23:28:01.610476+0000","last_became_active":"2023-11-30T23:12:47.507829+0000","last_became_peered":"2023-11-30T23:12:47.507829+0000","last_unstale":"2023-11-30T23:28:01.610476+0000","last_undegraded":"2023-11-30T23:28:01.610476+0000","last_fullsized":"2023-11-30T23:28:01.610476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3514","last_scrub_stamp":"2023-11-30T23:28:01.610451+0000","last_deep_scrub":"49'3514","last_deep_scrub_stamp":"2023-11-30T23:28:01.610451+0000","last_clean_scrub_stamp":"2023-11-30T23:28:01.610451+0000","objects_scrubbed":1,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:18:44.631441+0000","scrub_duration":0.030646911999999998,"objects_trimmed":0,"snaptrim_duration":0.031269901000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"49'3600","reported_seq":2976,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:42.379019+0000","last_change":"2023-11-30T23:28:42.379187+0000","last_active":"2023-11-30T23:28:42.379019+0000","last_peered":"2023-11-30T23:28:42.379019+0000","last_clean":"2023-11-30T23:28:42.379019+0000","last_became_active":"2023-11-30T23:12:47.522208+0000","last_became_peered":"2023-11-30T23:12:47.522208+0000","last_unstale":"2023-11-30T23:28:42.379019+0000","last_undegraded":"2023-11-30T23:28:42.379019+0000","last_fullsized":"2023-11-30T23:28:42.379019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3600","last_scrub_stamp":"2023-11-30T23:28:42.378992+0000","last_deep_scrub":"49'3600","last_deep_scrub_stamp":"2023-11-30T23:28:42.378992+0000","last_clean_scrub_stamp":"2023-11-30T23:28:42.378992+0000","objects_scrubbed":1,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:29:48.624054+0000","scrub_duration":0.044920452,"objects_trimmed":0,"snaptrim_duration":0.020703408,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"49'3347","reported_seq":2740,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:34.930375+0000","last_change":"2023-11-30T23:28:34.930613+0000","last_active":"2023-11-30T23:28:34.930375+0000","last_peered":"2023-11-30T23:28:34.930375+0000","last_clean":"2023-11-30T23:28:34.930375+0000","last_became_active":"2023-11-30T23:13:30.302763+0000","last_became_peered":"2023-11-30T23:13:30.302763+0000","last_unstale":"2023-11-30T23:28:34.930375+0000","last_undegraded":"2023-11-30T23:28:34.930375+0000","last_fullsized":"2023-11-30T23:28:34.930375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3347","last_scrub_stamp":"2023-11-30T23:28:34.930316+0000","last_deep_scrub":"49'3347","last_deep_scrub_stamp":"2023-11-30T23:28:34.930316+0000","last_clean_scrub_stamp":"2023-11-30T23:28:34.930316+0000","objects_scrubbed":1,"log_size":3347,"log_dups_size":0,"ondisk_log_size":3347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:22:13.977333+0000","scrub_duration":0.02500374,"objects_trimmed":0,"snaptrim_duration":0.047963988999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"49'3404","reported_seq":2832,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:46.381609+0000","last_change":"2023-11-30T23:28:46.381718+0000","last_active":"2023-11-30T23:28:46.381609+0000","last_peered":"2023-11-30T23:28:46.381609+0000","last_clean":"2023-11-30T23:28:46.381609+0000","last_became_active":"2023-11-30T23:12:47.513491+0000","last_became_peered":"2023-11-30T23:12:47.513491+0000","last_unstale":"2023-11-30T23:28:46.381609+0000","last_undegraded":"2023-11-30T23:28:46.381609+0000","last_fullsized":"2023-11-30T23:28:46.381609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3404","last_scrub_stamp":"2023-11-30T23:28:46.381585+0000","last_deep_scrub":"49'3404","last_deep_scrub_stamp":"2023-11-30T23:28:46.381585+0000","last_clean_scrub_stamp":"2023-11-30T23:28:46.381585+0000","objects_scrubbed":2,"log_size":3404,"log_dups_size":0,"ondisk_log_size":3404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T00:16:14.142000+0000","scrub_duration":0.035019038000000002,"objects_trimmed":0,"snaptrim_duration":0.019296939999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"48'3534","reported_seq":2955,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:40.984010+0000","last_change":"2023-11-30T23:28:40.984136+0000","last_active":"2023-11-30T23:28:40.984010+0000","last_peered":"2023-11-30T23:28:40.984010+0000","last_clean":"2023-11-30T23:28:40.984010+0000","last_became_active":"2023-11-30T23:12:47.507747+0000","last_became_peered":"2023-11-30T23:12:47.507747+0000","last_unstale":"2023-11-30T23:28:40.984010+0000","last_undegraded":"2023-11-30T23:28:40.984010+0000","last_fullsized":"2023-11-30T23:28:40.984010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3534","last_scrub_stamp":"2023-11-30T23:28:40.983989+0000","last_deep_scrub":"48'3534","last_deep_scrub_stamp":"2023-11-30T23:28:40.983989+0000","last_clean_scrub_stamp":"2023-11-30T23:28:40.983989+0000","objects_scrubbed":0,"log_size":3534,"log_dups_size":0,"ondisk_log_size":3534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:52:02.239277+0000","scrub_duration":0.040558102999999998,"objects_trimmed":0,"snaptrim_duration":0.0077627249999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"49'3401","reported_seq":2800,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:31.569919+0000","last_change":"2023-11-30T23:28:31.570026+0000","last_active":"2023-11-30T23:28:31.569919+0000","last_peered":"2023-11-30T23:28:31.569919+0000","last_clean":"2023-11-30T23:28:31.569919+0000","last_became_active":"2023-11-30T23:12:47.523430+0000","last_became_peered":"2023-11-30T23:12:47.523430+0000","last_unstale":"2023-11-30T23:28:31.569919+0000","last_undegraded":"2023-11-30T23:28:31.569919+0000","last_fullsized":"2023-11-30T23:28:31.569919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3401","last_scrub_stamp":"2023-11-30T23:28:31.569898+0000","last_deep_scrub":"49'3401","last_deep_scrub_stamp":"2023-11-30T23:28:31.569898+0000","last_clean_scrub_stamp":"2023-11-30T23:28:31.569898+0000","objects_scrubbed":1,"log_size":3401,"log_dups_size":0,"ondisk_log_size":3401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:06:35.711103+0000","scrub_duration":0.037221511999999998,"objects_trimmed":0,"snaptrim_duration":0.023650336000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"49'3726","reported_seq":3075,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:43.915586+0000","last_change":"2023-11-30T23:28:43.915867+0000","last_active":"2023-11-30T23:28:43.915586+0000","last_peered":"2023-11-30T23:28:43.915586+0000","last_clean":"2023-11-30T23:28:43.915586+0000","last_became_active":"2023-11-30T23:12:47.521393+0000","last_became_peered":"2023-11-30T23:12:47.521393+0000","last_unstale":"2023-11-30T23:28:43.915586+0000","last_undegraded":"2023-11-30T23:28:43.915586+0000","last_fullsized":"2023-11-30T23:28:43.915586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3726","last_scrub_stamp":"2023-11-30T23:28:43.915535+0000","last_deep_scrub":"49'3726","last_deep_scrub_stamp":"2023-11-30T23:28:43.915535+0000","last_clean_scrub_stamp":"2023-11-30T23:28:43.915535+0000","objects_scrubbed":2,"log_size":3726,"log_dups_size":0,"ondisk_log_size":3726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:29:50.160597+0000","scrub_duration":0.034695071000000001,"objects_trimmed":0,"snaptrim_duration":0.0078674580000000008,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1228,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"49'3654","reported_seq":3134,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:30.708740+0000","last_change":"2023-11-30T23:28:30.708911+0000","last_active":"2023-11-30T23:28:30.708740+0000","last_peered":"2023-11-30T23:28:30.708740+0000","last_clean":"2023-11-30T23:28:30.708740+0000","last_became_active":"2023-11-30T23:12:47.522618+0000","last_became_peered":"2023-11-30T23:12:47.522618+0000","last_unstale":"2023-11-30T23:28:30.708740+0000","last_undegraded":"2023-11-30T23:28:30.708740+0000","last_fullsized":"2023-11-30T23:28:30.708740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3654","last_scrub_stamp":"2023-11-30T23:28:30.708708+0000","last_deep_scrub":"49'3654","last_deep_scrub_stamp":"2023-11-30T23:28:30.708708+0000","last_clean_scrub_stamp":"2023-11-30T23:28:30.708708+0000","objects_scrubbed":7,"log_size":3654,"log_dups_size":0,"ondisk_log_size":3654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:06:34.849912+0000","scrub_duration":0.048193895,"objects_trimmed":0,"snaptrim_duration":0.016421781999999999,"stat_sum":{"num_bytes":4110,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":1106,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"49'3244","reported_seq":2745,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:12.562814+0000","last_change":"2023-11-30T23:28:12.563172+0000","last_active":"2023-11-30T23:28:12.562814+0000","last_peered":"2023-11-30T23:28:12.562814+0000","last_clean":"2023-11-30T23:28:12.562814+0000","last_became_active":"2023-11-30T23:13:30.304972+0000","last_became_peered":"2023-11-30T23:13:30.304972+0000","last_unstale":"2023-11-30T23:28:12.562814+0000","last_undegraded":"2023-11-30T23:28:12.562814+0000","last_fullsized":"2023-11-30T23:28:12.562814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3244","last_scrub_stamp":"2023-11-30T23:28:12.562738+0000","last_deep_scrub":"49'3244","last_deep_scrub_stamp":"2023-11-30T23:28:12.562738+0000","last_clean_scrub_stamp":"2023-11-30T23:28:12.562738+0000","objects_scrubbed":1,"log_size":3244,"log_dups_size":0,"ondisk_log_size":3244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:25:07.649855+0000","scrub_duration":0.029739873999999999,"objects_trimmed":0,"snaptrim_duration":0.016353854000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"48'3479","reported_seq":2867,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:08.819998+0000","last_change":"2023-11-30T23:28:08.820160+0000","last_active":"2023-11-30T23:28:08.819998+0000","last_peered":"2023-11-30T23:28:08.819998+0000","last_clean":"2023-11-30T23:28:08.819998+0000","last_became_active":"2023-11-30T23:12:47.513401+0000","last_became_peered":"2023-11-30T23:12:47.513401+0000","last_unstale":"2023-11-30T23:28:08.819998+0000","last_undegraded":"2023-11-30T23:28:08.819998+0000","last_fullsized":"2023-11-30T23:28:08.819998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3479","last_scrub_stamp":"2023-11-30T23:28:08.819951+0000","last_deep_scrub":"48'3479","last_deep_scrub_stamp":"2023-11-30T23:28:08.819951+0000","last_clean_scrub_stamp":"2023-11-30T23:28:08.819951+0000","objects_scrubbed":2,"log_size":3479,"log_dups_size":0,"ondisk_log_size":3479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:49:05.516384+0000","scrub_duration":0.03499451,"objects_trimmed":0,"snaptrim_duration":0.011359997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"49'3379","reported_seq":2842,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:38.592477+0000","last_change":"2023-11-30T23:28:38.592643+0000","last_active":"2023-11-30T23:28:38.592477+0000","last_peered":"2023-11-30T23:28:38.592477+0000","last_clean":"2023-11-30T23:28:38.592477+0000","last_became_active":"2023-11-30T23:12:47.513714+0000","last_became_peered":"2023-11-30T23:12:47.513714+0000","last_unstale":"2023-11-30T23:28:38.592477+0000","last_undegraded":"2023-11-30T23:28:38.592477+0000","last_fullsized":"2023-11-30T23:28:38.592477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3379","last_scrub_stamp":"2023-11-30T23:28:38.592442+0000","last_deep_scrub":"49'3379","last_deep_scrub_stamp":"2023-11-30T23:28:38.592442+0000","last_clean_scrub_stamp":"2023-11-30T23:28:38.592442+0000","objects_scrubbed":4,"log_size":3379,"log_dups_size":0,"ondisk_log_size":3379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:22:17.639458+0000","scrub_duration":0.042227464999999999,"objects_trimmed":0,"snaptrim_duration":0.024370613999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1066,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"49'3644","reported_seq":3015,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:17.651306+0000","last_change":"2023-11-30T23:28:17.651561+0000","last_active":"2023-11-30T23:28:17.651306+0000","last_peered":"2023-11-30T23:28:17.651306+0000","last_clean":"2023-11-30T23:28:17.651306+0000","last_became_active":"2023-11-30T23:12:47.506967+0000","last_became_peered":"2023-11-30T23:12:47.506967+0000","last_unstale":"2023-11-30T23:28:17.651306+0000","last_undegraded":"2023-11-30T23:28:17.651306+0000","last_fullsized":"2023-11-30T23:28:17.651306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3644","last_scrub_stamp":"2023-11-30T23:28:17.651240+0000","last_deep_scrub":"49'3644","last_deep_scrub_stamp":"2023-11-30T23:28:17.651240+0000","last_clean_scrub_stamp":"2023-11-30T23:28:17.651240+0000","objects_scrubbed":1,"log_size":3644,"log_dups_size":0,"ondisk_log_size":3644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:25:12.738357+0000","scrub_duration":0.036232482000000003,"objects_trimmed":0,"snaptrim_duration":0.025050587999999999,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"49'3639","reported_seq":2983,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:28.890133+0000","last_change":"2023-11-30T23:28:28.890270+0000","last_active":"2023-11-30T23:28:28.890133+0000","last_peered":"2023-11-30T23:28:28.890133+0000","last_clean":"2023-11-30T23:28:28.890133+0000","last_became_active":"2023-11-30T23:12:47.513018+0000","last_became_peered":"2023-11-30T23:12:47.513018+0000","last_unstale":"2023-11-30T23:28:28.890133+0000","last_undegraded":"2023-11-30T23:28:28.890133+0000","last_fullsized":"2023-11-30T23:28:28.890133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3639","last_scrub_stamp":"2023-11-30T23:28:28.890108+0000","last_deep_scrub":"49'3639","last_deep_scrub_stamp":"2023-11-30T23:28:28.890108+0000","last_clean_scrub_stamp":"2023-11-30T23:28:28.890108+0000","objects_scrubbed":3,"log_size":3639,"log_dups_size":0,"ondisk_log_size":3639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:06:33.031312+0000","scrub_duration":0.050216454000000001,"objects_trimmed":0,"snaptrim_duration":0.059143527000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1251,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"48'3670","reported_seq":3031,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:26.200439+0000","last_change":"2023-11-30T23:28:26.200556+0000","last_active":"2023-11-30T23:28:26.200439+0000","last_peered":"2023-11-30T23:28:26.200439+0000","last_clean":"2023-11-30T23:28:26.200439+0000","last_became_active":"2023-11-30T23:12:47.520518+0000","last_became_peered":"2023-11-30T23:12:47.520518+0000","last_unstale":"2023-11-30T23:28:26.200439+0000","last_undegraded":"2023-11-30T23:28:26.200439+0000","last_fullsized":"2023-11-30T23:28:26.200439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3670","last_scrub_stamp":"2023-11-30T23:28:26.200415+0000","last_deep_scrub":"48'3670","last_deep_scrub_stamp":"2023-11-30T23:28:26.200415+0000","last_clean_scrub_stamp":"2023-11-30T23:28:26.200415+0000","objects_scrubbed":0,"log_size":3670,"log_dups_size":0,"ondisk_log_size":3670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:06:30.341620+0000","scrub_duration":0.029244801000000001,"objects_trimmed":0,"snaptrim_duration":0.016206259000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"49'3894","reported_seq":3203,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:19.109901+0000","last_change":"2023-11-30T23:28:19.110028+0000","last_active":"2023-11-30T23:28:19.109901+0000","last_peered":"2023-11-30T23:28:19.109901+0000","last_clean":"2023-11-30T23:28:19.109901+0000","last_became_active":"2023-11-30T23:12:47.516382+0000","last_became_peered":"2023-11-30T23:12:47.516382+0000","last_unstale":"2023-11-30T23:28:19.109901+0000","last_undegraded":"2023-11-30T23:28:19.109901+0000","last_fullsized":"2023-11-30T23:28:19.109901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3894","last_scrub_stamp":"2023-11-30T23:28:19.109877+0000","last_deep_scrub":"49'3894","last_deep_scrub_stamp":"2023-11-30T23:28:19.109877+0000","last_clean_scrub_stamp":"2023-11-30T23:28:19.109877+0000","objects_scrubbed":2,"log_size":3894,"log_dups_size":0,"ondisk_log_size":3894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:17:05.624190+0000","scrub_duration":0.034182327999999998,"objects_trimmed":0,"snaptrim_duration":0.020102808999999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"49'3337","reported_seq":2829,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:05.189002+0000","last_change":"2023-11-30T23:28:05.189174+0000","last_active":"2023-11-30T23:28:05.189002+0000","last_peered":"2023-11-30T23:28:05.189002+0000","last_clean":"2023-11-30T23:28:05.189002+0000","last_became_active":"2023-11-30T23:12:47.509340+0000","last_became_peered":"2023-11-30T23:12:47.509340+0000","last_unstale":"2023-11-30T23:28:05.189002+0000","last_undegraded":"2023-11-30T23:28:05.189002+0000","last_fullsized":"2023-11-30T23:28:05.189002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3337","last_scrub_stamp":"2023-11-30T23:28:05.188973+0000","last_deep_scrub":"49'3337","last_deep_scrub_stamp":"2023-11-30T23:28:05.188973+0000","last_clean_scrub_stamp":"2023-11-30T23:28:05.188973+0000","objects_scrubbed":1,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:49:01.885406+0000","scrub_duration":0.034767988,"objects_trimmed":0,"snaptrim_duration":0.0085862969999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1061,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"49'3632","reported_seq":3016,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:55.924811+0000","last_change":"2023-11-30T23:27:55.924811+0000","last_active":"2023-11-30T23:27:55.924811+0000","last_peered":"2023-11-30T23:27:55.924811+0000","last_clean":"2023-11-30T23:27:55.924811+0000","last_became_active":"2023-11-30T23:12:47.506733+0000","last_became_peered":"2023-11-30T23:12:47.506733+0000","last_unstale":"2023-11-30T23:27:55.924811+0000","last_undegraded":"2023-11-30T23:27:55.924811+0000","last_fullsized":"2023-11-30T23:27:55.924811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3632","last_scrub_stamp":"2023-11-30T23:27:55.924680+0000","last_deep_scrub":"49'3632","last_deep_scrub_stamp":"2023-11-30T23:27:55.924680+0000","last_clean_scrub_stamp":"2023-11-30T23:27:55.924680+0000","objects_scrubbed":2,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:01.410077+0000","scrub_duration":0.042987108000000003,"objects_trimmed":0,"snaptrim_duration":0.010198370999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"49'3604","reported_seq":2977,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:21.644769+0000","last_change":"2023-11-30T23:28:21.644769+0000","last_active":"2023-11-30T23:28:21.644769+0000","last_peered":"2023-11-30T23:28:21.644769+0000","last_clean":"2023-11-30T23:28:21.644769+0000","last_became_active":"2023-11-30T23:12:47.518819+0000","last_became_peered":"2023-11-30T23:12:47.518819+0000","last_unstale":"2023-11-30T23:28:21.644769+0000","last_undegraded":"2023-11-30T23:28:21.644769+0000","last_fullsized":"2023-11-30T23:28:21.644769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3604","last_scrub_stamp":"2023-11-30T23:28:21.644595+0000","last_deep_scrub":"49'3604","last_deep_scrub_stamp":"2023-11-30T23:28:21.644595+0000","last_clean_scrub_stamp":"2023-11-30T23:28:21.644595+0000","objects_scrubbed":4,"log_size":3604,"log_dups_size":0,"ondisk_log_size":3604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:49:46.776503+0000","scrub_duration":0.044331269,"objects_trimmed":0,"snaptrim_duration":0.014700833,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"49'3685","reported_seq":3080,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:28.467501+0000","last_change":"2023-11-30T23:28:28.467501+0000","last_active":"2023-11-30T23:28:28.467501+0000","last_peered":"2023-11-30T23:28:28.467501+0000","last_clean":"2023-11-30T23:28:28.467501+0000","last_became_active":"2023-11-30T23:12:47.514223+0000","last_became_peered":"2023-11-30T23:12:47.514223+0000","last_unstale":"2023-11-30T23:28:28.467501+0000","last_undegraded":"2023-11-30T23:28:28.467501+0000","last_fullsized":"2023-11-30T23:28:28.467501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3685","last_scrub_stamp":"2023-11-30T23:28:28.467202+0000","last_deep_scrub":"49'3685","last_deep_scrub_stamp":"2023-11-30T23:28:28.467202+0000","last_clean_scrub_stamp":"2023-11-30T23:28:28.467202+0000","objects_scrubbed":2,"log_size":3685,"log_dups_size":0,"ondisk_log_size":3685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:17:14.981515+0000","scrub_duration":0.04516212,"objects_trimmed":0,"snaptrim_duration":0.036942162000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"49'4031","reported_seq":3339,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:44.370668+0000","last_change":"2023-11-30T23:28:44.370908+0000","last_active":"2023-11-30T23:28:44.370668+0000","last_peered":"2023-11-30T23:28:44.370668+0000","last_clean":"2023-11-30T23:28:44.370668+0000","last_became_active":"2023-11-30T23:12:47.520228+0000","last_became_peered":"2023-11-30T23:12:47.520228+0000","last_unstale":"2023-11-30T23:28:44.370668+0000","last_undegraded":"2023-11-30T23:28:44.370668+0000","last_fullsized":"2023-11-30T23:28:44.370668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4031","last_scrub_stamp":"2023-11-30T23:28:44.370617+0000","last_deep_scrub":"49'4031","last_deep_scrub_stamp":"2023-11-30T23:28:44.370617+0000","last_clean_scrub_stamp":"2023-11-30T23:28:44.370617+0000","objects_scrubbed":2,"log_size":4031,"log_dups_size":0,"ondisk_log_size":4031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:28:03.401358+0000","scrub_duration":0.045527052999999998,"objects_trimmed":0,"snaptrim_duration":0.023056817,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1244,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"48'3705","reported_seq":3094,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:26.629215+0000","last_change":"2023-11-30T23:28:26.629215+0000","last_active":"2023-11-30T23:28:26.629215+0000","last_peered":"2023-11-30T23:28:26.629215+0000","last_clean":"2023-11-30T23:28:26.629215+0000","last_became_active":"2023-11-30T23:12:47.515247+0000","last_became_peered":"2023-11-30T23:12:47.515247+0000","last_unstale":"2023-11-30T23:28:26.629215+0000","last_undegraded":"2023-11-30T23:28:26.629215+0000","last_fullsized":"2023-11-30T23:28:26.629215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3705","last_scrub_stamp":"2023-11-30T23:28:26.629081+0000","last_deep_scrub":"48'3705","last_deep_scrub_stamp":"2023-11-30T23:28:26.629081+0000","last_clean_scrub_stamp":"2023-11-30T23:28:26.629081+0000","objects_scrubbed":0,"log_size":3705,"log_dups_size":0,"ondisk_log_size":3705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:40:05.421057+0000","scrub_duration":0.045874146999999997,"objects_trimmed":0,"snaptrim_duration":0.026511877,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"49'3605","reported_seq":2971,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:16.183882+0000","last_change":"2023-11-30T23:28:16.184116+0000","last_active":"2023-11-30T23:28:16.183882+0000","last_peered":"2023-11-30T23:28:16.183882+0000","last_clean":"2023-11-30T23:28:16.183882+0000","last_became_active":"2023-11-30T23:12:47.511097+0000","last_became_peered":"2023-11-30T23:12:47.511097+0000","last_unstale":"2023-11-30T23:28:16.183882+0000","last_undegraded":"2023-11-30T23:28:16.183882+0000","last_fullsized":"2023-11-30T23:28:16.183882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3605","last_scrub_stamp":"2023-11-30T23:28:16.183848+0000","last_deep_scrub":"49'3605","last_deep_scrub_stamp":"2023-11-30T23:28:16.183848+0000","last_clean_scrub_stamp":"2023-11-30T23:28:16.183848+0000","objects_scrubbed":3,"log_size":3605,"log_dups_size":0,"ondisk_log_size":3605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:02:14.282133+0000","scrub_duration":0.046432888999999998,"objects_trimmed":0,"snaptrim_duration":0.023833039,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"49'3201","reported_seq":2643,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:24.532544+0000","last_change":"2023-11-30T23:28:24.532699+0000","last_active":"2023-11-30T23:28:24.532544+0000","last_peered":"2023-11-30T23:28:24.532544+0000","last_clean":"2023-11-30T23:28:24.532544+0000","last_became_active":"2023-11-30T23:12:47.510404+0000","last_became_peered":"2023-11-30T23:12:47.510404+0000","last_unstale":"2023-11-30T23:28:24.532544+0000","last_undegraded":"2023-11-30T23:28:24.532544+0000","last_fullsized":"2023-11-30T23:28:24.532544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3201","last_scrub_stamp":"2023-11-30T23:28:24.532514+0000","last_deep_scrub":"49'3201","last_deep_scrub_stamp":"2023-11-30T23:28:24.532514+0000","last_clean_scrub_stamp":"2023-11-30T23:28:24.532514+0000","objects_scrubbed":2,"log_size":3201,"log_dups_size":0,"ondisk_log_size":3201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:17:11.046827+0000","scrub_duration":0.034134656999999999,"objects_trimmed":0,"snaptrim_duration":0.031984205000000002,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"49'3859","reported_seq":3204,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:25.662698+0000","last_change":"2023-11-30T23:28:25.662856+0000","last_active":"2023-11-30T23:28:25.662698+0000","last_peered":"2023-11-30T23:28:25.662698+0000","last_clean":"2023-11-30T23:28:25.662698+0000","last_became_active":"2023-11-30T23:12:47.516539+0000","last_became_peered":"2023-11-30T23:12:47.516539+0000","last_unstale":"2023-11-30T23:28:25.662698+0000","last_undegraded":"2023-11-30T23:28:25.662698+0000","last_fullsized":"2023-11-30T23:28:25.662698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3859","last_scrub_stamp":"2023-11-30T23:28:25.662672+0000","last_deep_scrub":"49'3859","last_deep_scrub_stamp":"2023-11-30T23:28:25.662672+0000","last_clean_scrub_stamp":"2023-11-30T23:28:25.662672+0000","objects_scrubbed":4,"log_size":3859,"log_dups_size":0,"ondisk_log_size":3859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:40:04.454648+0000","scrub_duration":0.045213978000000002,"objects_trimmed":0,"snaptrim_duration":0.018080019999999999,"stat_sum":{"num_bytes":4105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"48'3361","reported_seq":2788,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:17.905046+0000","last_change":"2023-11-30T23:28:17.905157+0000","last_active":"2023-11-30T23:28:17.905046+0000","last_peered":"2023-11-30T23:28:17.905046+0000","last_clean":"2023-11-30T23:28:17.905046+0000","last_became_active":"2023-11-30T23:12:47.506284+0000","last_became_peered":"2023-11-30T23:12:47.506284+0000","last_unstale":"2023-11-30T23:28:17.905046+0000","last_undegraded":"2023-11-30T23:28:17.905046+0000","last_fullsized":"2023-11-30T23:28:17.905046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3361","last_scrub_stamp":"2023-11-30T23:28:17.905024+0000","last_deep_scrub":"48'3361","last_deep_scrub_stamp":"2023-11-30T23:28:17.905024+0000","last_clean_scrub_stamp":"2023-11-30T23:28:17.905024+0000","objects_scrubbed":0,"log_size":3361,"log_dups_size":0,"ondisk_log_size":3361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:41:19.306897+0000","scrub_duration":0.031316189000000001,"objects_trimmed":0,"snaptrim_duration":0.058342590999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"48'3356","reported_seq":2760,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:21.562168+0000","last_change":"2023-11-30T23:28:21.562380+0000","last_active":"2023-11-30T23:28:21.562168+0000","last_peered":"2023-11-30T23:28:21.562168+0000","last_clean":"2023-11-30T23:28:21.562168+0000","last_became_active":"2023-11-30T23:12:47.511800+0000","last_became_peered":"2023-11-30T23:12:47.511800+0000","last_unstale":"2023-11-30T23:28:21.562168+0000","last_undegraded":"2023-11-30T23:28:21.562168+0000","last_fullsized":"2023-11-30T23:28:21.562168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3356","last_scrub_stamp":"2023-11-30T23:28:21.562145+0000","last_deep_scrub":"48'3356","last_deep_scrub_stamp":"2023-11-30T23:28:21.562145+0000","last_clean_scrub_stamp":"2023-11-30T23:28:21.562145+0000","objects_scrubbed":0,"log_size":3356,"log_dups_size":0,"ondisk_log_size":3356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:02:19.660431+0000","scrub_duration":0.035109890999999997,"objects_trimmed":0,"snaptrim_duration":0.034899355,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1130,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"49'3594","reported_seq":3015,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:15.603630+0000","last_change":"2023-11-30T23:28:15.603772+0000","last_active":"2023-11-30T23:28:15.603630+0000","last_peered":"2023-11-30T23:28:15.603630+0000","last_clean":"2023-11-30T23:28:15.603630+0000","last_became_active":"2023-11-30T23:12:47.512978+0000","last_became_peered":"2023-11-30T23:12:47.512978+0000","last_unstale":"2023-11-30T23:28:15.603630+0000","last_undegraded":"2023-11-30T23:28:15.603630+0000","last_fullsized":"2023-11-30T23:28:15.603630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3594","last_scrub_stamp":"2023-11-30T23:28:15.603609+0000","last_deep_scrub":"49'3594","last_deep_scrub_stamp":"2023-11-30T23:28:15.603609+0000","last_clean_scrub_stamp":"2023-11-30T23:28:15.603609+0000","objects_scrubbed":1,"log_size":3594,"log_dups_size":0,"ondisk_log_size":3594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:56:31.486001+0000","scrub_duration":0.036598453000000003,"objects_trimmed":0,"snaptrim_duration":0.032442869999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1122,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"49'3351","reported_seq":2793,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:32.246996+0000","last_change":"2023-11-30T23:28:32.247240+0000","last_active":"2023-11-30T23:28:32.246996+0000","last_peered":"2023-11-30T23:28:32.246996+0000","last_clean":"2023-11-30T23:28:32.246996+0000","last_became_active":"2023-11-30T23:12:47.511699+0000","last_became_peered":"2023-11-30T23:12:47.511699+0000","last_unstale":"2023-11-30T23:28:32.246996+0000","last_undegraded":"2023-11-30T23:28:32.246996+0000","last_fullsized":"2023-11-30T23:28:32.246996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3351","last_scrub_stamp":"2023-11-30T23:28:32.246937+0000","last_deep_scrub":"49'3351","last_deep_scrub_stamp":"2023-11-30T23:28:32.246937+0000","last_clean_scrub_stamp":"2023-11-30T23:28:32.246937+0000","objects_scrubbed":1,"log_size":3351,"log_dups_size":0,"ondisk_log_size":3351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:22:11.293953+0000","scrub_duration":0.042385262999999999,"objects_trimmed":0,"snaptrim_duration":0.021133078,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"49'4048","reported_seq":3311,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:02.179925+0000","last_change":"2023-11-30T23:28:02.180100+0000","last_active":"2023-11-30T23:28:02.179925+0000","last_peered":"2023-11-30T23:28:02.179925+0000","last_clean":"2023-11-30T23:28:02.179925+0000","last_became_active":"2023-11-30T23:12:47.521604+0000","last_became_peered":"2023-11-30T23:12:47.521604+0000","last_unstale":"2023-11-30T23:28:02.179925+0000","last_undegraded":"2023-11-30T23:28:02.179925+0000","last_fullsized":"2023-11-30T23:28:02.179925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4048","last_scrub_stamp":"2023-11-30T23:28:02.179890+0000","last_deep_scrub":"49'4048","last_deep_scrub_stamp":"2023-11-30T23:28:02.179890+0000","last_clean_scrub_stamp":"2023-11-30T23:28:02.179890+0000","objects_scrubbed":5,"log_size":4048,"log_dups_size":0,"ondisk_log_size":4048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:07.665287+0000","scrub_duration":0.046875120999999999,"objects_trimmed":0,"snaptrim_duration":0.0081020610000000007,"stat_sum":{"num_bytes":4121,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1336,"num_write_kb":721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"49'3909","reported_seq":3244,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:23.613865+0000","last_change":"2023-11-30T23:28:23.614041+0000","last_active":"2023-11-30T23:28:23.613865+0000","last_peered":"2023-11-30T23:28:23.613865+0000","last_clean":"2023-11-30T23:28:23.613865+0000","last_became_active":"2023-11-30T23:12:47.517283+0000","last_became_peered":"2023-11-30T23:12:47.517283+0000","last_unstale":"2023-11-30T23:28:23.613865+0000","last_undegraded":"2023-11-30T23:28:23.613865+0000","last_fullsized":"2023-11-30T23:28:23.613865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3909","last_scrub_stamp":"2023-11-30T23:28:23.613833+0000","last_deep_scrub":"49'3909","last_deep_scrub_stamp":"2023-11-30T23:28:23.613833+0000","last_clean_scrub_stamp":"2023-11-30T23:28:23.613833+0000","objects_scrubbed":1,"log_size":3909,"log_dups_size":0,"ondisk_log_size":3909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:17:10.128146+0000","scrub_duration":0.040663194999999999,"objects_trimmed":0,"snaptrim_duration":0.016665117,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"49'3481","reported_seq":2892,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:56.890441+0000","last_change":"2023-11-30T23:27:56.890633+0000","last_active":"2023-11-30T23:27:56.890441+0000","last_peered":"2023-11-30T23:27:56.890441+0000","last_clean":"2023-11-30T23:27:56.890441+0000","last_became_active":"2023-11-30T23:12:47.508725+0000","last_became_peered":"2023-11-30T23:12:47.508725+0000","last_unstale":"2023-11-30T23:27:56.890441+0000","last_undegraded":"2023-11-30T23:27:56.890441+0000","last_fullsized":"2023-11-30T23:27:56.890441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3481","last_scrub_stamp":"2023-11-30T23:27:56.890382+0000","last_deep_scrub":"49'3481","last_deep_scrub_stamp":"2023-11-30T23:27:56.890382+0000","last_clean_scrub_stamp":"2023-11-30T23:27:56.890382+0000","objects_scrubbed":1,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:10:21.913904+0000","scrub_duration":0.039608870999999997,"objects_trimmed":0,"snaptrim_duration":0.010267352,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1134,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"49'4002","reported_seq":4060,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:57.811764+0000","last_change":"2023-11-30T23:27:57.811924+0000","last_active":"2023-11-30T23:27:57.811764+0000","last_peered":"2023-11-30T23:27:57.811764+0000","last_clean":"2023-11-30T23:27:57.811764+0000","last_became_active":"2023-11-30T23:12:47.138768+0000","last_became_peered":"2023-11-30T23:12:47.138768+0000","last_unstale":"2023-11-30T23:27:57.811764+0000","last_undegraded":"2023-11-30T23:27:57.811764+0000","last_fullsized":"2023-11-30T23:27:57.811764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4002","last_scrub_stamp":"2023-11-30T23:27:57.811738+0000","last_deep_scrub":"49'4002","last_deep_scrub_stamp":"2023-11-30T23:27:57.811738+0000","last_clean_scrub_stamp":"2023-11-30T23:27:57.811738+0000","objects_scrubbed":21,"log_size":4002,"log_dups_size":0,"ondisk_log_size":4002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:18:40.832728+0000","scrub_duration":0.092190944999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":4054,"num_write_kb":19067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":131298,"num_omap_keys":261,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"49'3596","reported_seq":3003,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:08.660864+0000","last_change":"2023-11-30T23:28:08.660979+0000","last_active":"2023-11-30T23:28:08.660864+0000","last_peered":"2023-11-30T23:28:08.660864+0000","last_clean":"2023-11-30T23:28:08.660864+0000","last_became_active":"2023-11-30T23:12:47.516214+0000","last_became_peered":"2023-11-30T23:12:47.516214+0000","last_unstale":"2023-11-30T23:28:08.660864+0000","last_undegraded":"2023-11-30T23:28:08.660864+0000","last_fullsized":"2023-11-30T23:28:08.660864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3596","last_scrub_stamp":"2023-11-30T23:28:08.660841+0000","last_deep_scrub":"49'3596","last_deep_scrub_stamp":"2023-11-30T23:28:08.660841+0000","last_clean_scrub_stamp":"2023-11-30T23:28:08.660841+0000","objects_scrubbed":1,"log_size":3596,"log_dups_size":0,"ondisk_log_size":3596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:49:05.357274+0000","scrub_duration":0.026849743999999998,"objects_trimmed":0,"snaptrim_duration":0.037604525,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"49'4566","reported_seq":4624,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:56.588030+0000","last_change":"2023-11-30T23:27:56.588227+0000","last_active":"2023-11-30T23:27:56.588030+0000","last_peered":"2023-11-30T23:27:56.588030+0000","last_clean":"2023-11-30T23:27:56.588030+0000","last_became_active":"2023-11-30T23:12:47.129771+0000","last_became_peered":"2023-11-30T23:12:47.129771+0000","last_unstale":"2023-11-30T23:27:56.588030+0000","last_undegraded":"2023-11-30T23:27:56.588030+0000","last_fullsized":"2023-11-30T23:27:56.588030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4566","last_scrub_stamp":"2023-11-30T23:27:56.588004+0000","last_deep_scrub":"49'4566","last_deep_scrub_stamp":"2023-11-30T23:27:56.588004+0000","last_clean_scrub_stamp":"2023-11-30T23:27:56.588004+0000","objects_scrubbed":20,"log_size":4566,"log_dups_size":0,"ondisk_log_size":4566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:18:39.608994+0000","scrub_duration":0.072522685000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7867003,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":4621,"num_write_kb":33841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":132064,"num_omap_keys":262,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"49'869","reported_seq":927,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:52.760047+0000","last_change":"2023-11-30T23:27:52.760196+0000","last_active":"2023-11-30T23:27:52.760047+0000","last_peered":"2023-11-30T23:27:52.760047+0000","last_clean":"2023-11-30T23:27:52.760047+0000","last_became_active":"2023-11-30T23:12:47.133440+0000","last_became_peered":"2023-11-30T23:12:47.133440+0000","last_unstale":"2023-11-30T23:27:52.760047+0000","last_undegraded":"2023-11-30T23:27:52.760047+0000","last_fullsized":"2023-11-30T23:27:52.760047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'869","last_scrub_stamp":"2023-11-30T23:27:52.760025+0000","last_deep_scrub":"49'869","last_deep_scrub_stamp":"2023-11-30T23:27:52.760025+0000","last_clean_scrub_stamp":"2023-11-30T23:27:52.760025+0000","objects_scrubbed":18,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:03:41.368698+0000","scrub_duration":0.042867220999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":928,"num_write_kb":12986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":117912,"num_omap_keys":234,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"49'3962","reported_seq":3228,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:20.543966+0000","last_change":"2023-11-30T23:28:20.544108+0000","last_active":"2023-11-30T23:28:20.543966+0000","last_peered":"2023-11-30T23:28:20.543966+0000","last_clean":"2023-11-30T23:28:20.543966+0000","last_became_active":"2023-11-30T23:12:47.507617+0000","last_became_peered":"2023-11-30T23:12:47.507617+0000","last_unstale":"2023-11-30T23:28:20.543966+0000","last_undegraded":"2023-11-30T23:28:20.543966+0000","last_fullsized":"2023-11-30T23:28:20.543966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3962","last_scrub_stamp":"2023-11-30T23:28:20.543943+0000","last_deep_scrub":"49'3962","last_deep_scrub_stamp":"2023-11-30T23:28:20.543943+0000","last_clean_scrub_stamp":"2023-11-30T23:28:20.543943+0000","objects_scrubbed":1,"log_size":3962,"log_dups_size":0,"ondisk_log_size":3962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:41:21.945816+0000","scrub_duration":0.039558478000000001,"objects_trimmed":0,"snaptrim_duration":0.022313091,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1298,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"49'3818","reported_seq":3876,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:55.344789+0000","last_change":"2023-11-30T23:27:55.344927+0000","last_active":"2023-11-30T23:27:55.344789+0000","last_peered":"2023-11-30T23:27:55.344789+0000","last_clean":"2023-11-30T23:27:55.344789+0000","last_became_active":"2023-11-30T23:12:47.132351+0000","last_became_peered":"2023-11-30T23:12:47.132351+0000","last_unstale":"2023-11-30T23:27:55.344789+0000","last_undegraded":"2023-11-30T23:27:55.344789+0000","last_fullsized":"2023-11-30T23:27:55.344789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3818","last_scrub_stamp":"2023-11-30T23:27:55.344768+0000","last_deep_scrub":"49'3818","last_deep_scrub_stamp":"2023-11-30T23:27:55.344768+0000","last_clean_scrub_stamp":"2023-11-30T23:27:55.344768+0000","objects_scrubbed":15,"log_size":3818,"log_dups_size":0,"ondisk_log_size":3818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:00.830165+0000","scrub_duration":0.063752615999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":3859,"num_write_kb":38490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66804,"num_omap_keys":133,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"48'3665","reported_seq":3076,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:23.951004+0000","last_change":"2023-11-30T23:28:23.951117+0000","last_active":"2023-11-30T23:28:23.951004+0000","last_peered":"2023-11-30T23:28:23.951004+0000","last_clean":"2023-11-30T23:28:23.951004+0000","last_became_active":"2023-11-30T23:12:47.506082+0000","last_became_peered":"2023-11-30T23:12:47.506082+0000","last_unstale":"2023-11-30T23:28:23.951004+0000","last_undegraded":"2023-11-30T23:28:23.951004+0000","last_fullsized":"2023-11-30T23:28:23.951004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3665","last_scrub_stamp":"2023-11-30T23:28:23.950982+0000","last_deep_scrub":"48'3665","last_deep_scrub_stamp":"2023-11-30T23:28:23.950982+0000","last_clean_scrub_stamp":"2023-11-30T23:28:23.950982+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:40:02.742957+0000","scrub_duration":0.040544931999999999,"objects_trimmed":0,"snaptrim_duration":0.052118631999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"49'1115","reported_seq":1173,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:08.692273+0000","last_change":"2023-11-30T23:28:08.692475+0000","last_active":"2023-11-30T23:28:08.692273+0000","last_peered":"2023-11-30T23:28:08.692273+0000","last_clean":"2023-11-30T23:28:08.692273+0000","last_became_active":"2023-11-30T23:12:47.139400+0000","last_became_peered":"2023-11-30T23:12:47.139400+0000","last_unstale":"2023-11-30T23:28:08.692273+0000","last_undegraded":"2023-11-30T23:28:08.692273+0000","last_fullsized":"2023-11-30T23:28:08.692273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1115","last_scrub_stamp":"2023-11-30T23:28:08.692238+0000","last_deep_scrub":"49'1115","last_deep_scrub_stamp":"2023-11-30T23:28:08.692238+0000","last_clean_scrub_stamp":"2023-11-30T23:28:08.692238+0000","objects_scrubbed":19,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:55:21.581303+0000","scrub_duration":0.084637698999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":1152,"num_write_kb":13161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":93798,"num_omap_keys":186,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"49'3682","reported_seq":3061,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:10.191488+0000","last_change":"2023-11-30T23:28:10.191644+0000","last_active":"2023-11-30T23:28:10.191488+0000","last_peered":"2023-11-30T23:28:10.191488+0000","last_clean":"2023-11-30T23:28:10.191488+0000","last_became_active":"2023-11-30T23:13:30.596915+0000","last_became_peered":"2023-11-30T23:13:30.596915+0000","last_unstale":"2023-11-30T23:28:10.191488+0000","last_undegraded":"2023-11-30T23:28:10.191488+0000","last_fullsized":"2023-11-30T23:28:10.191488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3682","last_scrub_stamp":"2023-11-30T23:28:10.191456+0000","last_deep_scrub":"49'3682","last_deep_scrub_stamp":"2023-11-30T23:28:10.191456+0000","last_clean_scrub_stamp":"2023-11-30T23:28:10.191456+0000","objects_scrubbed":3,"log_size":3682,"log_dups_size":0,"ondisk_log_size":3682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:18:45.839337+0000","scrub_duration":0.042728659000000002,"objects_trimmed":0,"snaptrim_duration":0.0066900809999999996,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"49'1893","reported_seq":1951,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:04.386249+0000","last_change":"2023-11-30T23:28:04.386438+0000","last_active":"2023-11-30T23:28:04.386249+0000","last_peered":"2023-11-30T23:28:04.386249+0000","last_clean":"2023-11-30T23:28:04.386249+0000","last_became_active":"2023-11-30T23:12:47.139047+0000","last_became_peered":"2023-11-30T23:12:47.139047+0000","last_unstale":"2023-11-30T23:28:04.386249+0000","last_undegraded":"2023-11-30T23:28:04.386249+0000","last_fullsized":"2023-11-30T23:28:04.386249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1893","last_scrub_stamp":"2023-11-30T23:28:04.386222+0000","last_deep_scrub":"49'1893","last_deep_scrub_stamp":"2023-11-30T23:28:04.386222+0000","last_clean_scrub_stamp":"2023-11-30T23:28:04.386222+0000","objects_scrubbed":21,"log_size":1893,"log_dups_size":0,"ondisk_log_size":1893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:18:40.034102+0000","scrub_duration":0.058105267000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":1932,"num_write_kb":25642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":128094,"num_omap_keys":254,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"49'3571","reported_seq":2966,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:23.571803+0000","last_change":"2023-11-30T23:28:23.571970+0000","last_active":"2023-11-30T23:28:23.571803+0000","last_peered":"2023-11-30T23:28:23.571803+0000","last_clean":"2023-11-30T23:28:23.571803+0000","last_became_active":"2023-11-30T23:12:47.522711+0000","last_became_peered":"2023-11-30T23:12:47.522711+0000","last_unstale":"2023-11-30T23:28:23.571803+0000","last_undegraded":"2023-11-30T23:28:23.571803+0000","last_fullsized":"2023-11-30T23:28:23.571803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3571","last_scrub_stamp":"2023-11-30T23:28:23.571773+0000","last_deep_scrub":"49'3571","last_deep_scrub_stamp":"2023-11-30T23:28:23.571773+0000","last_clean_scrub_stamp":"2023-11-30T23:28:23.571773+0000","objects_scrubbed":1,"log_size":3571,"log_dups_size":0,"ondisk_log_size":3571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:17:00.417094+0000","scrub_duration":0.027092887999999999,"objects_trimmed":0,"snaptrim_duration":0.028725985999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"49'3077","reported_seq":3135,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:11.099776+0000","last_change":"2023-11-30T23:28:11.099938+0000","last_active":"2023-11-30T23:28:11.099776+0000","last_peered":"2023-11-30T23:28:11.099776+0000","last_clean":"2023-11-30T23:28:11.099776+0000","last_became_active":"2023-11-30T23:12:47.140531+0000","last_became_peered":"2023-11-30T23:12:47.140531+0000","last_unstale":"2023-11-30T23:28:11.099776+0000","last_undegraded":"2023-11-30T23:28:11.099776+0000","last_fullsized":"2023-11-30T23:28:11.099776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3077","last_scrub_stamp":"2023-11-30T23:28:11.099752+0000","last_deep_scrub":"49'3077","last_deep_scrub_stamp":"2023-11-30T23:28:11.099752+0000","last_clean_scrub_stamp":"2023-11-30T23:28:11.099752+0000","objects_scrubbed":21,"log_size":3077,"log_dups_size":0,"ondisk_log_size":3077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:56:26.982144+0000","scrub_duration":0.057941271000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":3128,"num_write_kb":22065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":123254,"num_omap_keys":244,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'3775","reported_seq":3149,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:06.784637+0000","last_change":"2023-11-30T23:28:06.784753+0000","last_active":"2023-11-30T23:28:06.784637+0000","last_peered":"2023-11-30T23:28:06.784637+0000","last_clean":"2023-11-30T23:28:06.784637+0000","last_became_active":"2023-11-30T23:12:47.513983+0000","last_became_peered":"2023-11-30T23:12:47.513983+0000","last_unstale":"2023-11-30T23:28:06.784637+0000","last_undegraded":"2023-11-30T23:28:06.784637+0000","last_fullsized":"2023-11-30T23:28:06.784637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3775","last_scrub_stamp":"2023-11-30T23:28:06.784616+0000","last_deep_scrub":"49'3775","last_deep_scrub_stamp":"2023-11-30T23:28:06.784616+0000","last_clean_scrub_stamp":"2023-11-30T23:28:06.784616+0000","objects_scrubbed":5,"log_size":3775,"log_dups_size":0,"ondisk_log_size":3775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:12.270013+0000","scrub_duration":0.041895794,"objects_trimmed":0,"snaptrim_duration":0.010376995,"stat_sum":{"num_bytes":9,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1166,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"49'3864","reported_seq":3922,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:03.570741+0000","last_change":"2023-11-30T23:28:03.570940+0000","last_active":"2023-11-30T23:28:03.570741+0000","last_peered":"2023-11-30T23:28:03.570741+0000","last_clean":"2023-11-30T23:28:03.570741+0000","last_became_active":"2023-11-30T23:12:47.139799+0000","last_became_peered":"2023-11-30T23:12:47.139799+0000","last_unstale":"2023-11-30T23:28:03.570741+0000","last_undegraded":"2023-11-30T23:28:03.570741+0000","last_fullsized":"2023-11-30T23:28:03.570741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3864","last_scrub_stamp":"2023-11-30T23:28:03.570709+0000","last_deep_scrub":"49'3864","last_deep_scrub_stamp":"2023-11-30T23:28:03.570709+0000","last_clean_scrub_stamp":"2023-11-30T23:28:03.570709+0000","objects_scrubbed":20,"log_size":3864,"log_dups_size":0,"ondisk_log_size":3864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:49:00.267142+0000","scrub_duration":0.086803594999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":3911,"num_write_kb":30389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99239,"num_omap_keys":195,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"49'3524","reported_seq":2915,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:45.933132+0000","last_change":"2023-11-30T23:28:45.933478+0000","last_active":"2023-11-30T23:28:45.933132+0000","last_peered":"2023-11-30T23:28:45.933132+0000","last_clean":"2023-11-30T23:28:45.933132+0000","last_became_active":"2023-11-30T23:12:47.503333+0000","last_became_peered":"2023-11-30T23:12:47.503333+0000","last_unstale":"2023-11-30T23:28:45.933132+0000","last_undegraded":"2023-11-30T23:28:45.933132+0000","last_fullsized":"2023-11-30T23:28:45.933132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3524","last_scrub_stamp":"2023-11-30T23:28:45.933056+0000","last_deep_scrub":"49'3524","last_deep_scrub_stamp":"2023-11-30T23:28:45.933056+0000","last_clean_scrub_stamp":"2023-11-30T23:28:45.933056+0000","objects_scrubbed":1,"log_size":3524,"log_dups_size":0,"ondisk_log_size":3524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:28:04.963796+0000","scrub_duration":0.047713453000000003,"objects_trimmed":0,"snaptrim_duration":0.0070303589999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"49'1943","reported_seq":2001,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:55.603559+0000","last_change":"2023-11-30T23:27:55.603926+0000","last_active":"2023-11-30T23:27:55.603559+0000","last_peered":"2023-11-30T23:27:55.603559+0000","last_clean":"2023-11-30T23:27:55.603559+0000","last_became_active":"2023-11-30T23:12:47.136620+0000","last_became_peered":"2023-11-30T23:12:47.136620+0000","last_unstale":"2023-11-30T23:27:55.603559+0000","last_undegraded":"2023-11-30T23:27:55.603559+0000","last_fullsized":"2023-11-30T23:27:55.603559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1943","last_scrub_stamp":"2023-11-30T23:27:55.603484+0000","last_deep_scrub":"49'1943","last_deep_scrub_stamp":"2023-11-30T23:27:55.603484+0000","last_clean_scrub_stamp":"2023-11-30T23:27:55.603484+0000","objects_scrubbed":23,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:01:50.595690+0000","scrub_duration":0.066985327999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":2012,"num_write_kb":17264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":138602,"num_omap_keys":275,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"49'3608","reported_seq":2994,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:06.722647+0000","last_change":"2023-11-30T23:28:06.722813+0000","last_active":"2023-11-30T23:28:06.722647+0000","last_peered":"2023-11-30T23:28:06.722647+0000","last_clean":"2023-11-30T23:28:06.722647+0000","last_became_active":"2023-11-30T23:12:47.503294+0000","last_became_peered":"2023-11-30T23:12:47.503294+0000","last_unstale":"2023-11-30T23:28:06.722647+0000","last_undegraded":"2023-11-30T23:28:06.722647+0000","last_fullsized":"2023-11-30T23:28:06.722647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3608","last_scrub_stamp":"2023-11-30T23:28:06.722625+0000","last_deep_scrub":"49'3608","last_deep_scrub_stamp":"2023-11-30T23:28:06.722625+0000","last_clean_scrub_stamp":"2023-11-30T23:28:06.722625+0000","objects_scrubbed":5,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:12.208022+0000","scrub_duration":0.049361031,"objects_trimmed":0,"snaptrim_duration":0.028538382000000001,"stat_sum":{"num_bytes":8235,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1203,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"49'94","reported_seq":152,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:15.187933+0000","last_change":"2023-11-30T23:28:15.188228+0000","last_active":"2023-11-30T23:28:15.187933+0000","last_peered":"2023-11-30T23:28:15.187933+0000","last_clean":"2023-11-30T23:28:15.187933+0000","last_became_active":"2023-11-30T23:12:47.140125+0000","last_became_peered":"2023-11-30T23:12:47.140125+0000","last_unstale":"2023-11-30T23:28:15.187933+0000","last_undegraded":"2023-11-30T23:28:15.187933+0000","last_fullsized":"2023-11-30T23:28:15.187933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'94","last_scrub_stamp":"2023-11-30T23:28:15.187880+0000","last_deep_scrub":"49'94","last_deep_scrub_stamp":"2023-11-30T23:28:15.187880+0000","last_clean_scrub_stamp":"2023-11-30T23:28:15.187880+0000","objects_scrubbed":12,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:41:16.589753+0000","scrub_duration":0.020105610999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":140,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":78108,"num_omap_keys":155,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"49'3958","reported_seq":3300,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:35.016232+0000","last_change":"2023-11-30T23:28:35.016398+0000","last_active":"2023-11-30T23:28:35.016232+0000","last_peered":"2023-11-30T23:28:35.016232+0000","last_clean":"2023-11-30T23:28:35.016232+0000","last_became_active":"2023-11-30T23:12:47.515427+0000","last_became_peered":"2023-11-30T23:12:47.515427+0000","last_unstale":"2023-11-30T23:28:35.016232+0000","last_undegraded":"2023-11-30T23:28:35.016232+0000","last_fullsized":"2023-11-30T23:28:35.016232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3958","last_scrub_stamp":"2023-11-30T23:28:35.016208+0000","last_deep_scrub":"49'3958","last_deep_scrub_stamp":"2023-11-30T23:28:35.016208+0000","last_clean_scrub_stamp":"2023-11-30T23:28:35.016208+0000","objects_scrubbed":1,"log_size":3958,"log_dups_size":0,"ondisk_log_size":3958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:51:55.740460+0000","scrub_duration":0.044691658000000002,"objects_trimmed":0,"snaptrim_duration":0.0066010289999999996,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"49'1127","reported_seq":1185,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:01.508789+0000","last_change":"2023-11-30T23:28:01.508982+0000","last_active":"2023-11-30T23:28:01.508789+0000","last_peered":"2023-11-30T23:28:01.508789+0000","last_clean":"2023-11-30T23:28:01.508789+0000","last_became_active":"2023-11-30T23:12:47.129180+0000","last_became_peered":"2023-11-30T23:12:47.129180+0000","last_unstale":"2023-11-30T23:28:01.508789+0000","last_undegraded":"2023-11-30T23:28:01.508789+0000","last_fullsized":"2023-11-30T23:28:01.508789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1127","last_scrub_stamp":"2023-11-30T23:28:01.508755+0000","last_deep_scrub":"49'1127","last_deep_scrub_stamp":"2023-11-30T23:28:01.508755+0000","last_clean_scrub_stamp":"2023-11-30T23:28:01.508755+0000","objects_scrubbed":10,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:06.994151+0000","scrub_duration":0.041205466000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":1162,"num_write_kb":9042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":54342,"num_omap_keys":108,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"48'3496","reported_seq":2899,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:18.578782+0000","last_change":"2023-11-30T23:28:18.578910+0000","last_active":"2023-11-30T23:28:18.578782+0000","last_peered":"2023-11-30T23:28:18.578782+0000","last_clean":"2023-11-30T23:28:18.578782+0000","last_became_active":"2023-11-30T23:12:47.516980+0000","last_became_peered":"2023-11-30T23:12:47.516980+0000","last_unstale":"2023-11-30T23:28:18.578782+0000","last_undegraded":"2023-11-30T23:28:18.578782+0000","last_fullsized":"2023-11-30T23:28:18.578782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3496","last_scrub_stamp":"2023-11-30T23:28:18.578760+0000","last_deep_scrub":"48'3496","last_deep_scrub_stamp":"2023-11-30T23:28:18.578760+0000","last_clean_scrub_stamp":"2023-11-30T23:28:18.578760+0000","objects_scrubbed":0,"log_size":3496,"log_dups_size":0,"ondisk_log_size":3496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:16:55.424081+0000","scrub_duration":0.035006735999999997,"objects_trimmed":0,"snaptrim_duration":0.014912678,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"49'1321","reported_seq":1379,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:53.092041+0000","last_change":"2023-11-30T23:27:53.092378+0000","last_active":"2023-11-30T23:27:53.092041+0000","last_peered":"2023-11-30T23:27:53.092041+0000","last_clean":"2023-11-30T23:27:53.092041+0000","last_became_active":"2023-11-30T23:12:47.129349+0000","last_became_peered":"2023-11-30T23:12:47.129349+0000","last_unstale":"2023-11-30T23:27:53.092041+0000","last_undegraded":"2023-11-30T23:27:53.092041+0000","last_fullsized":"2023-11-30T23:27:53.092041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1321","last_scrub_stamp":"2023-11-30T23:27:53.091986+0000","last_deep_scrub":"49'1321","last_deep_scrub_stamp":"2023-11-30T23:27:53.091986+0000","last_clean_scrub_stamp":"2023-11-30T23:27:53.091986+0000","objects_scrubbed":21,"log_size":1321,"log_dups_size":0,"ondisk_log_size":1321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:10:18.115508+0000","scrub_duration":0.045828347999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":1371,"num_write_kb":13381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":104070,"num_omap_keys":207,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"49'3747","reported_seq":3081,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:21.020433+0000","last_change":"2023-11-30T23:28:21.020580+0000","last_active":"2023-11-30T23:28:21.020433+0000","last_peered":"2023-11-30T23:28:21.020433+0000","last_clean":"2023-11-30T23:28:21.020433+0000","last_became_active":"2023-11-30T23:12:47.514140+0000","last_became_peered":"2023-11-30T23:12:47.514140+0000","last_unstale":"2023-11-30T23:28:21.020433+0000","last_undegraded":"2023-11-30T23:28:21.020433+0000","last_fullsized":"2023-11-30T23:28:21.020433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3747","last_scrub_stamp":"2023-11-30T23:28:21.020407+0000","last_deep_scrub":"49'3747","last_deep_scrub_stamp":"2023-11-30T23:28:21.020407+0000","last_clean_scrub_stamp":"2023-11-30T23:28:21.020407+0000","objects_scrubbed":4,"log_size":3747,"log_dups_size":0,"ondisk_log_size":3747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:38:32.823826+0000","scrub_duration":0.053450994000000002,"objects_trimmed":0,"snaptrim_duration":0.0087768900000000007,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1241,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"49'1122","reported_seq":1181,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:54.893545+0000","last_change":"2023-11-30T23:27:54.893545+0000","last_active":"2023-11-30T23:27:54.893545+0000","last_peered":"2023-11-30T23:27:54.893545+0000","last_clean":"2023-11-30T23:27:54.893545+0000","last_became_active":"2023-11-30T23:12:47.136631+0000","last_became_peered":"2023-11-30T23:12:47.136631+0000","last_unstale":"2023-11-30T23:27:54.893545+0000","last_undegraded":"2023-11-30T23:27:54.893545+0000","last_fullsized":"2023-11-30T23:27:54.893545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1122","last_scrub_stamp":"2023-11-30T23:27:54.893334+0000","last_deep_scrub":"49'1122","last_deep_scrub_stamp":"2023-11-30T23:27:54.893334+0000","last_clean_scrub_stamp":"2023-11-30T23:27:54.893334+0000","objects_scrubbed":24,"log_size":1122,"log_dups_size":0,"ondisk_log_size":1122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:52:55.445683+0000","scrub_duration":0.067445020999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":1176,"num_write_kb":13385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":144754,"num_omap_keys":287,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"49'3440","reported_seq":2855,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:19.014473+0000","last_change":"2023-11-30T23:28:19.014473+0000","last_active":"2023-11-30T23:28:19.014473+0000","last_peered":"2023-11-30T23:28:19.014473+0000","last_clean":"2023-11-30T23:28:19.014473+0000","last_became_active":"2023-11-30T23:12:47.514053+0000","last_became_peered":"2023-11-30T23:12:47.514053+0000","last_unstale":"2023-11-30T23:28:19.014473+0000","last_undegraded":"2023-11-30T23:28:19.014473+0000","last_fullsized":"2023-11-30T23:28:19.014473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3440","last_scrub_stamp":"2023-11-30T23:28:19.014119+0000","last_deep_scrub":"49'3440","last_deep_scrub_stamp":"2023-11-30T23:28:19.014119+0000","last_clean_scrub_stamp":"2023-11-30T23:28:19.014119+0000","objects_scrubbed":6,"log_size":3440,"log_dups_size":0,"ondisk_log_size":3440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:17:05.528432+0000","scrub_duration":0.050855755000000002,"objects_trimmed":0,"snaptrim_duration":0.0080231629999999998,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"49'2054","reported_seq":2113,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:51.134903+0000","last_change":"2023-11-30T23:27:51.134903+0000","last_active":"2023-11-30T23:27:51.134903+0000","last_peered":"2023-11-30T23:27:51.134903+0000","last_clean":"2023-11-30T23:27:51.134903+0000","last_became_active":"2023-11-30T23:12:47.137695+0000","last_became_peered":"2023-11-30T23:12:47.137695+0000","last_unstale":"2023-11-30T23:27:51.134903+0000","last_undegraded":"2023-11-30T23:27:51.134903+0000","last_fullsized":"2023-11-30T23:27:51.134903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'2054","last_scrub_stamp":"2023-11-30T23:27:51.134674+0000","last_deep_scrub":"49'2054","last_deep_scrub_stamp":"2023-11-30T23:27:51.134674+0000","last_clean_scrub_stamp":"2023-11-30T23:27:51.134674+0000","objects_scrubbed":19,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:52:51.687024+0000","scrub_duration":0.047092548999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":2104,"num_write_kb":13092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":111684,"num_omap_keys":222,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"49'3570","reported_seq":2946,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:39.981975+0000","last_change":"2023-11-30T23:28:39.982120+0000","last_active":"2023-11-30T23:28:39.981975+0000","last_peered":"2023-11-30T23:28:39.981975+0000","last_clean":"2023-11-30T23:28:39.981975+0000","last_became_active":"2023-11-30T23:12:47.514822+0000","last_became_peered":"2023-11-30T23:12:47.514822+0000","last_unstale":"2023-11-30T23:28:39.981975+0000","last_undegraded":"2023-11-30T23:28:39.981975+0000","last_fullsized":"2023-11-30T23:28:39.981975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3570","last_scrub_stamp":"2023-11-30T23:28:39.981954+0000","last_deep_scrub":"49'3570","last_deep_scrub_stamp":"2023-11-30T23:28:39.981954+0000","last_clean_scrub_stamp":"2023-11-30T23:28:39.981954+0000","objects_scrubbed":3,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:29:45.209014+0000","scrub_duration":0.040667921000000003,"objects_trimmed":0,"snaptrim_duration":0.0076646960000000004,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"49'4620","reported_seq":4681,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:55.010759+0000","last_change":"2023-11-30T23:27:55.010759+0000","last_active":"2023-11-30T23:27:55.010759+0000","last_peered":"2023-11-30T23:27:55.010759+0000","last_clean":"2023-11-30T23:27:55.010759+0000","last_became_active":"2023-11-30T23:12:47.128682+0000","last_became_peered":"2023-11-30T23:12:47.128682+0000","last_unstale":"2023-11-30T23:27:55.010759+0000","last_undegraded":"2023-11-30T23:27:55.010759+0000","last_fullsized":"2023-11-30T23:27:55.010759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4620","last_scrub_stamp":"2023-11-30T23:27:55.010606+0000","last_deep_scrub":"49'4620","last_deep_scrub_stamp":"2023-11-30T23:27:55.010606+0000","last_clean_scrub_stamp":"2023-11-30T23:27:55.010606+0000","objects_scrubbed":25,"log_size":4620,"log_dups_size":0,"ondisk_log_size":4620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:18:38.031596+0000","scrub_duration":0.1011722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583127,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":4657,"num_write_kb":26783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":151374,"num_omap_keys":301,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"49'3663","reported_seq":2983,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:34.285910+0000","last_change":"2023-11-30T23:28:34.286039+0000","last_active":"2023-11-30T23:28:34.285910+0000","last_peered":"2023-11-30T23:28:34.285910+0000","last_clean":"2023-11-30T23:28:34.285910+0000","last_became_active":"2023-11-30T23:12:47.516317+0000","last_became_peered":"2023-11-30T23:12:47.516317+0000","last_unstale":"2023-11-30T23:28:34.285910+0000","last_undegraded":"2023-11-30T23:28:34.285910+0000","last_fullsized":"2023-11-30T23:28:34.285910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3663","last_scrub_stamp":"2023-11-30T23:28:34.285885+0000","last_deep_scrub":"49'3663","last_deep_scrub_stamp":"2023-11-30T23:28:34.285885+0000","last_clean_scrub_stamp":"2023-11-30T23:28:34.285885+0000","objects_scrubbed":4,"log_size":3663,"log_dups_size":0,"ondisk_log_size":3663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:47:53.515865+0000","scrub_duration":0.042263451,"objects_trimmed":0,"snaptrim_duration":0.018738761999999999,"stat_sum":{"num_bytes":16384,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1262,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"49'4380","reported_seq":4439,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:58.157082+0000","last_change":"2023-11-30T23:27:58.157082+0000","last_active":"2023-11-30T23:27:58.157082+0000","last_peered":"2023-11-30T23:27:58.157082+0000","last_clean":"2023-11-30T23:27:58.157082+0000","last_became_active":"2023-11-30T23:12:47.140400+0000","last_became_peered":"2023-11-30T23:12:47.140400+0000","last_unstale":"2023-11-30T23:27:58.157082+0000","last_undegraded":"2023-11-30T23:27:58.157082+0000","last_fullsized":"2023-11-30T23:27:58.157082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4380","last_scrub_stamp":"2023-11-30T23:27:58.156885+0000","last_deep_scrub":"49'4380","last_deep_scrub_stamp":"2023-11-30T23:27:58.156885+0000","last_clean_scrub_stamp":"2023-11-30T23:27:58.156885+0000","objects_scrubbed":18,"log_size":4380,"log_dups_size":0,"ondisk_log_size":4380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:18:41.177875+0000","scrub_duration":0.083489562000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4418,"num_write_kb":27644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73070,"num_omap_keys":145,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"48'3509","reported_seq":2948,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:25.016598+0000","last_change":"2023-11-30T23:28:25.016598+0000","last_active":"2023-11-30T23:28:25.016598+0000","last_peered":"2023-11-30T23:28:25.016598+0000","last_clean":"2023-11-30T23:28:25.016598+0000","last_became_active":"2023-11-30T23:12:47.521481+0000","last_became_peered":"2023-11-30T23:12:47.521481+0000","last_unstale":"2023-11-30T23:28:25.016598+0000","last_undegraded":"2023-11-30T23:28:25.016598+0000","last_fullsized":"2023-11-30T23:28:25.016598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3509","last_scrub_stamp":"2023-11-30T23:28:25.016466+0000","last_deep_scrub":"48'3509","last_deep_scrub_stamp":"2023-11-30T23:28:25.016466+0000","last_clean_scrub_stamp":"2023-11-30T23:28:25.016466+0000","objects_scrubbed":0,"log_size":3509,"log_dups_size":0,"ondisk_log_size":3509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:06:29.157670+0000","scrub_duration":0.035706193999999997,"objects_trimmed":0,"snaptrim_duration":0.010302225,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1071,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"49'119","reported_seq":215,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:58.842999+0000","last_change":"2023-11-30T23:27:58.842999+0000","last_active":"2023-11-30T23:27:58.842999+0000","last_peered":"2023-11-30T23:27:58.842999+0000","last_clean":"2023-11-30T23:27:58.842999+0000","last_became_active":"2023-11-30T23:12:36.556455+0000","last_became_peered":"2023-11-30T23:12:36.556455+0000","last_unstale":"2023-11-30T23:27:58.842999+0000","last_undegraded":"2023-11-30T23:27:58.842999+0000","last_fullsized":"2023-11-30T23:27:58.842999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'119","last_scrub_stamp":"2023-11-30T23:27:58.842660+0000","last_deep_scrub":"49'119","last_deep_scrub_stamp":"2023-11-30T23:27:58.842660+0000","last_clean_scrub_stamp":"2023-11-30T23:27:58.842660+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:48:55.539093+0000","scrub_duration":0.013295479000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"49'958","reported_seq":1019,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:10.270416+0000","last_change":"2023-11-30T23:28:10.270633+0000","last_active":"2023-11-30T23:28:10.270416+0000","last_peered":"2023-11-30T23:28:10.270416+0000","last_clean":"2023-11-30T23:28:10.270416+0000","last_became_active":"2023-11-30T23:12:47.132365+0000","last_became_peered":"2023-11-30T23:12:47.132365+0000","last_unstale":"2023-11-30T23:28:10.270416+0000","last_undegraded":"2023-11-30T23:28:10.270416+0000","last_fullsized":"2023-11-30T23:28:10.270416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'958","last_scrub_stamp":"2023-11-30T23:28:10.270374+0000","last_deep_scrub":"49'958","last_deep_scrub_stamp":"2023-11-30T23:28:10.270374+0000","last_clean_scrub_stamp":"2023-11-30T23:28:10.270374+0000","objects_scrubbed":25,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:25:05.357492+0000","scrub_duration":0.063963533000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":1011,"num_write_kb":13216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":151874,"num_omap_keys":302,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"48'3463","reported_seq":2912,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:13.730886+0000","last_change":"2023-11-30T23:28:13.731013+0000","last_active":"2023-11-30T23:28:13.730886+0000","last_peered":"2023-11-30T23:28:13.730886+0000","last_clean":"2023-11-30T23:28:13.730886+0000","last_became_active":"2023-11-30T23:12:47.508677+0000","last_became_peered":"2023-11-30T23:12:47.508677+0000","last_unstale":"2023-11-30T23:28:13.730886+0000","last_undegraded":"2023-11-30T23:28:13.730886+0000","last_fullsized":"2023-11-30T23:28:13.730886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3463","last_scrub_stamp":"2023-11-30T23:28:13.730861+0000","last_deep_scrub":"48'3463","last_deep_scrub_stamp":"2023-11-30T23:28:13.730861+0000","last_clean_scrub_stamp":"2023-11-30T23:28:13.730861+0000","objects_scrubbed":0,"log_size":3463,"log_dups_size":0,"ondisk_log_size":3463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:56:29.613252+0000","scrub_duration":0.032192482000000001,"objects_trimmed":0,"snaptrim_duration":0.029660272000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1097,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"49'3532","reported_seq":3591,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:03.939565+0000","last_change":"2023-11-30T23:28:03.939708+0000","last_active":"2023-11-30T23:28:03.939565+0000","last_peered":"2023-11-30T23:28:03.939565+0000","last_clean":"2023-11-30T23:28:03.939565+0000","last_became_active":"2023-11-30T23:12:47.148547+0000","last_became_peered":"2023-11-30T23:12:47.148547+0000","last_unstale":"2023-11-30T23:28:03.939565+0000","last_undegraded":"2023-11-30T23:28:03.939565+0000","last_fullsized":"2023-11-30T23:28:03.939565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3532","last_scrub_stamp":"2023-11-30T23:28:03.939542+0000","last_deep_scrub":"49'3532","last_deep_scrub_stamp":"2023-11-30T23:28:03.939542+0000","last_clean_scrub_stamp":"2023-11-30T23:28:03.939542+0000","objects_scrubbed":20,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:18:39.587422+0000","scrub_duration":0.077305334000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":3602,"num_write_kb":26128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":119298,"num_omap_keys":237,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"49'3483","reported_seq":2890,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:30.458853+0000","last_change":"2023-11-30T23:28:30.459027+0000","last_active":"2023-11-30T23:28:30.458853+0000","last_peered":"2023-11-30T23:28:30.458853+0000","last_clean":"2023-11-30T23:28:30.458853+0000","last_became_active":"2023-11-30T23:12:47.515553+0000","last_became_peered":"2023-11-30T23:12:47.515553+0000","last_unstale":"2023-11-30T23:28:30.458853+0000","last_undegraded":"2023-11-30T23:28:30.458853+0000","last_fullsized":"2023-11-30T23:28:30.458853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3483","last_scrub_stamp":"2023-11-30T23:28:30.458824+0000","last_deep_scrub":"49'3483","last_deep_scrub_stamp":"2023-11-30T23:28:30.458824+0000","last_clean_scrub_stamp":"2023-11-30T23:28:30.458824+0000","objects_scrubbed":2,"log_size":3483,"log_dups_size":0,"ondisk_log_size":3483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:40:09.250799+0000","scrub_duration":0.045330653999999998,"objects_trimmed":0,"snaptrim_duration":0.021186228000000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1162,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"49'2714","reported_seq":3288,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:52.126094+0000","last_change":"2023-11-30T23:27:52.126287+0000","last_active":"2023-11-30T23:27:52.126094+0000","last_peered":"2023-11-30T23:27:52.126094+0000","last_clean":"2023-11-30T23:27:52.126094+0000","last_became_active":"2023-11-30T23:12:47.135746+0000","last_became_peered":"2023-11-30T23:12:47.135746+0000","last_unstale":"2023-11-30T23:27:52.126094+0000","last_undegraded":"2023-11-30T23:27:52.126094+0000","last_fullsized":"2023-11-30T23:27:52.126094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'2714","last_scrub_stamp":"2023-11-30T23:27:52.126064+0000","last_deep_scrub":"49'2714","last_deep_scrub_stamp":"2023-11-30T23:27:52.126064+0000","last_clean_scrub_stamp":"2023-11-30T23:27:52.126064+0000","objects_scrubbed":20,"log_size":2714,"log_dups_size":0,"ondisk_log_size":2714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:01:47.118270+0000","scrub_duration":0.050486340999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3169767,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":530,"num_read_kb":3420,"num_write":2759,"num_write_kb":16501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":122836,"num_omap_keys":244,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'3597","reported_seq":2980,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:13.025304+0000","last_change":"2023-11-30T23:28:13.025304+0000","last_active":"2023-11-30T23:28:13.025304+0000","last_peered":"2023-11-30T23:28:13.025304+0000","last_clean":"2023-11-30T23:28:13.025304+0000","last_became_active":"2023-11-30T23:12:47.510024+0000","last_became_peered":"2023-11-30T23:12:47.510024+0000","last_unstale":"2023-11-30T23:28:13.025304+0000","last_undegraded":"2023-11-30T23:28:13.025304+0000","last_fullsized":"2023-11-30T23:28:13.025304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3597","last_scrub_stamp":"2023-11-30T23:28:13.025101+0000","last_deep_scrub":"49'3597","last_deep_scrub_stamp":"2023-11-30T23:28:13.025101+0000","last_clean_scrub_stamp":"2023-11-30T23:28:13.025101+0000","objects_scrubbed":4,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:25:08.112218+0000","scrub_duration":0.042807316999999998,"objects_trimmed":0,"snaptrim_duration":0.045211289000000002,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"49'4604","reported_seq":4663,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:08.371552+0000","last_change":"2023-11-30T23:28:08.371721+0000","last_active":"2023-11-30T23:28:08.371552+0000","last_peered":"2023-11-30T23:28:08.371552+0000","last_clean":"2023-11-30T23:28:08.371552+0000","last_became_active":"2023-11-30T23:12:47.141115+0000","last_became_peered":"2023-11-30T23:12:47.141115+0000","last_unstale":"2023-11-30T23:28:08.371552+0000","last_undegraded":"2023-11-30T23:28:08.371552+0000","last_fullsized":"2023-11-30T23:28:08.371552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4604","last_scrub_stamp":"2023-11-30T23:28:08.371526+0000","last_deep_scrub":"49'4604","last_deep_scrub_stamp":"2023-11-30T23:28:08.371526+0000","last_clean_scrub_stamp":"2023-11-30T23:28:08.371526+0000","objects_scrubbed":22,"log_size":4604,"log_dups_size":0,"ondisk_log_size":4604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:56:24.253918+0000","scrub_duration":0.097972583000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":4625,"num_write_kb":30671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":111760,"num_omap_keys":222,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"48'3767","reported_seq":3109,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:55.873932+0000","last_change":"2023-11-30T23:27:55.874045+0000","last_active":"2023-11-30T23:27:55.873932+0000","last_peered":"2023-11-30T23:27:55.873932+0000","last_clean":"2023-11-30T23:27:55.873932+0000","last_became_active":"2023-11-30T23:12:47.514572+0000","last_became_peered":"2023-11-30T23:12:47.514572+0000","last_unstale":"2023-11-30T23:27:55.873932+0000","last_undegraded":"2023-11-30T23:27:55.873932+0000","last_fullsized":"2023-11-30T23:27:55.873932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3767","last_scrub_stamp":"2023-11-30T23:27:55.873914+0000","last_deep_scrub":"48'3767","last_deep_scrub_stamp":"2023-11-30T23:27:55.873914+0000","last_clean_scrub_stamp":"2023-11-30T23:27:55.873914+0000","objects_scrubbed":0,"log_size":3767,"log_dups_size":0,"ondisk_log_size":3767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:01:50.866119+0000","scrub_duration":0.037263154,"objects_trimmed":0,"snaptrim_duration":0.010674993000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"49'168","reported_seq":227,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:02.037975+0000","last_change":"2023-11-30T23:28:02.038132+0000","last_active":"2023-11-30T23:28:02.037975+0000","last_peered":"2023-11-30T23:28:02.037975+0000","last_clean":"2023-11-30T23:28:02.037975+0000","last_became_active":"2023-11-30T23:12:47.141411+0000","last_became_peered":"2023-11-30T23:12:47.141411+0000","last_unstale":"2023-11-30T23:28:02.037975+0000","last_undegraded":"2023-11-30T23:28:02.037975+0000","last_fullsized":"2023-11-30T23:28:02.037975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'168","last_scrub_stamp":"2023-11-30T23:28:02.037952+0000","last_deep_scrub":"49'168","last_deep_scrub_stamp":"2023-11-30T23:28:02.037952+0000","last_clean_scrub_stamp":"2023-11-30T23:28:02.037952+0000","objects_scrubbed":15,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:48:58.734385+0000","scrub_duration":0.042734723000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":238,"num_write_kb":8770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":93108,"num_omap_keys":185,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"49'3576","reported_seq":2944,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:21.148689+0000","last_change":"2023-11-30T23:28:21.148848+0000","last_active":"2023-11-30T23:28:21.148689+0000","last_peered":"2023-11-30T23:28:21.148689+0000","last_clean":"2023-11-30T23:28:21.148689+0000","last_became_active":"2023-11-30T23:13:30.305367+0000","last_became_peered":"2023-11-30T23:13:30.305367+0000","last_unstale":"2023-11-30T23:28:21.148689+0000","last_undegraded":"2023-11-30T23:28:21.148689+0000","last_fullsized":"2023-11-30T23:28:21.148689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3576","last_scrub_stamp":"2023-11-30T23:28:21.148659+0000","last_deep_scrub":"49'3576","last_deep_scrub_stamp":"2023-11-30T23:28:21.148659+0000","last_clean_scrub_stamp":"2023-11-30T23:28:21.148659+0000","objects_scrubbed":1,"log_size":3576,"log_dups_size":0,"ondisk_log_size":3576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:39:59.940634+0000","scrub_duration":0.039025882999999997,"objects_trimmed":0,"snaptrim_duration":0.017828157000000001,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"49'2067","reported_seq":2126,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:07.980476+0000","last_change":"2023-11-30T23:28:07.980660+0000","last_active":"2023-11-30T23:28:07.980476+0000","last_peered":"2023-11-30T23:28:07.980476+0000","last_clean":"2023-11-30T23:28:07.980476+0000","last_became_active":"2023-11-30T23:12:47.143061+0000","last_became_peered":"2023-11-30T23:12:47.143061+0000","last_unstale":"2023-11-30T23:28:07.980476+0000","last_undegraded":"2023-11-30T23:28:07.980476+0000","last_fullsized":"2023-11-30T23:28:07.980476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'2067","last_scrub_stamp":"2023-11-30T23:28:07.980446+0000","last_deep_scrub":"49'2067","last_deep_scrub_stamp":"2023-11-30T23:28:07.980446+0000","last_clean_scrub_stamp":"2023-11-30T23:28:07.980446+0000","objects_scrubbed":11,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:56:23.862838+0000","scrub_duration":0.039739874000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":2145,"num_write_kb":21845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":71684,"num_omap_keys":142,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"49'3506","reported_seq":2909,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:21.902506+0000","last_change":"2023-11-30T23:28:21.902615+0000","last_active":"2023-11-30T23:28:21.902506+0000","last_peered":"2023-11-30T23:28:21.902506+0000","last_clean":"2023-11-30T23:28:21.902506+0000","last_became_active":"2023-11-30T23:12:47.501516+0000","last_became_peered":"2023-11-30T23:12:47.501516+0000","last_unstale":"2023-11-30T23:28:21.902506+0000","last_undegraded":"2023-11-30T23:28:21.902506+0000","last_fullsized":"2023-11-30T23:28:21.902506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3506","last_scrub_stamp":"2023-11-30T23:28:21.902485+0000","last_deep_scrub":"49'3506","last_deep_scrub_stamp":"2023-11-30T23:28:21.902485+0000","last_clean_scrub_stamp":"2023-11-30T23:28:21.902485+0000","objects_scrubbed":1,"log_size":3506,"log_dups_size":0,"ondisk_log_size":3506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:17:08.416798+0000","scrub_duration":0.039385293000000002,"objects_trimmed":0,"snaptrim_duration":0.040930987000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"49'2130","reported_seq":2189,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:59.120106+0000","last_change":"2023-11-30T23:27:59.120106+0000","last_active":"2023-11-30T23:27:59.120106+0000","last_peered":"2023-11-30T23:27:59.120106+0000","last_clean":"2023-11-30T23:27:59.120106+0000","last_became_active":"2023-11-30T23:12:47.134776+0000","last_became_peered":"2023-11-30T23:12:47.134776+0000","last_unstale":"2023-11-30T23:27:59.120106+0000","last_undegraded":"2023-11-30T23:27:59.120106+0000","last_fullsized":"2023-11-30T23:27:59.120106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'2130","last_scrub_stamp":"2023-11-30T23:27:59.119884+0000","last_deep_scrub":"49'2130","last_deep_scrub_stamp":"2023-11-30T23:27:59.119884+0000","last_clean_scrub_stamp":"2023-11-30T23:27:59.119884+0000","objects_scrubbed":23,"log_size":2130,"log_dups_size":0,"ondisk_log_size":2130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:04.605281+0000","scrub_duration":0.153358732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":2452,"num_write_kb":16294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":130911,"num_omap_keys":260,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"49'3246","reported_seq":2673,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:04.785742+0000","last_change":"2023-11-30T23:28:04.785911+0000","last_active":"2023-11-30T23:28:04.785742+0000","last_peered":"2023-11-30T23:28:04.785742+0000","last_clean":"2023-11-30T23:28:04.785742+0000","last_became_active":"2023-11-30T23:12:47.498631+0000","last_became_peered":"2023-11-30T23:12:47.498631+0000","last_unstale":"2023-11-30T23:28:04.785742+0000","last_undegraded":"2023-11-30T23:28:04.785742+0000","last_fullsized":"2023-11-30T23:28:04.785742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3246","last_scrub_stamp":"2023-11-30T23:28:04.785710+0000","last_deep_scrub":"49'3246","last_deep_scrub_stamp":"2023-11-30T23:28:04.785710+0000","last_clean_scrub_stamp":"2023-11-30T23:28:04.785710+0000","objects_scrubbed":1,"log_size":3246,"log_dups_size":0,"ondisk_log_size":3246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:49:01.482143+0000","scrub_duration":0.043044225999999998,"objects_trimmed":0,"snaptrim_duration":0.033287613000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1095,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"49'1702","reported_seq":1761,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:51.521544+0000","last_change":"2023-11-30T23:27:51.521544+0000","last_active":"2023-11-30T23:27:51.521544+0000","last_peered":"2023-11-30T23:27:51.521544+0000","last_clean":"2023-11-30T23:27:51.521544+0000","last_became_active":"2023-11-30T23:12:47.137406+0000","last_became_peered":"2023-11-30T23:12:47.137406+0000","last_unstale":"2023-11-30T23:27:51.521544+0000","last_undegraded":"2023-11-30T23:27:51.521544+0000","last_fullsized":"2023-11-30T23:27:51.521544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1702","last_scrub_stamp":"2023-11-30T23:27:51.521408+0000","last_deep_scrub":"49'1702","last_deep_scrub_stamp":"2023-11-30T23:27:51.521408+0000","last_clean_scrub_stamp":"2023-11-30T23:27:51.521408+0000","objects_scrubbed":16,"log_size":1702,"log_dups_size":0,"ondisk_log_size":1702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:10:16.544929+0000","scrub_duration":0.038042897999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":1761,"num_write_kb":9276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":90070,"num_omap_keys":179,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"49'3475","reported_seq":2893,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:13.682702+0000","last_change":"2023-11-30T23:28:13.682858+0000","last_active":"2023-11-30T23:28:13.682702+0000","last_peered":"2023-11-30T23:28:13.682702+0000","last_clean":"2023-11-30T23:28:13.682702+0000","last_became_active":"2023-11-30T23:12:47.506447+0000","last_became_peered":"2023-11-30T23:12:47.506447+0000","last_unstale":"2023-11-30T23:28:13.682702+0000","last_undegraded":"2023-11-30T23:28:13.682702+0000","last_fullsized":"2023-11-30T23:28:13.682702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3475","last_scrub_stamp":"2023-11-30T23:28:13.682682+0000","last_deep_scrub":"49'3475","last_deep_scrub_stamp":"2023-11-30T23:28:13.682682+0000","last_clean_scrub_stamp":"2023-11-30T23:28:13.682682+0000","objects_scrubbed":3,"log_size":3475,"log_dups_size":0,"ondisk_log_size":3475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:55:26.571747+0000","scrub_duration":0.041430724000000002,"objects_trimmed":0,"snaptrim_duration":0.037907362999999999,"stat_sum":{"num_bytes":4105,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1170,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"49'1570","reported_seq":1629,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:09.959737+0000","last_change":"2023-11-30T23:28:09.959883+0000","last_active":"2023-11-30T23:28:09.959737+0000","last_peered":"2023-11-30T23:28:09.959737+0000","last_clean":"2023-11-30T23:28:09.959737+0000","last_became_active":"2023-11-30T23:12:47.142135+0000","last_became_peered":"2023-11-30T23:12:47.142135+0000","last_unstale":"2023-11-30T23:28:09.959737+0000","last_undegraded":"2023-11-30T23:28:09.959737+0000","last_fullsized":"2023-11-30T23:28:09.959737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1570","last_scrub_stamp":"2023-11-30T23:28:09.959713+0000","last_deep_scrub":"49'1570","last_deep_scrub_stamp":"2023-11-30T23:28:09.959713+0000","last_clean_scrub_stamp":"2023-11-30T23:28:09.959713+0000","objects_scrubbed":22,"log_size":1570,"log_dups_size":0,"ondisk_log_size":1570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:25:05.046830+0000","scrub_duration":0.056782458000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":1654,"num_write_kb":9390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158140,"num_omap_keys":314,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"49'3432","reported_seq":2823,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:01.796529+0000","last_change":"2023-11-30T23:28:01.796633+0000","last_active":"2023-11-30T23:28:01.796529+0000","last_peered":"2023-11-30T23:28:01.796529+0000","last_clean":"2023-11-30T23:28:01.796529+0000","last_became_active":"2023-11-30T23:12:47.513966+0000","last_became_peered":"2023-11-30T23:12:47.513966+0000","last_unstale":"2023-11-30T23:28:01.796529+0000","last_undegraded":"2023-11-30T23:28:01.796529+0000","last_fullsized":"2023-11-30T23:28:01.796529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3432","last_scrub_stamp":"2023-11-30T23:28:01.796504+0000","last_deep_scrub":"49'3432","last_deep_scrub_stamp":"2023-11-30T23:28:01.796504+0000","last_clean_scrub_stamp":"2023-11-30T23:28:01.796504+0000","objects_scrubbed":1,"log_size":3432,"log_dups_size":0,"ondisk_log_size":3432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:18:44.817494+0000","scrub_duration":0.040597133000000001,"objects_trimmed":0,"snaptrim_duration":0.003646318,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"49'2309","reported_seq":2368,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:49.983621+0000","last_change":"2023-11-30T23:27:49.983621+0000","last_active":"2023-11-30T23:27:49.983621+0000","last_peered":"2023-11-30T23:27:49.983621+0000","last_clean":"2023-11-30T23:27:49.983621+0000","last_became_active":"2023-11-30T23:12:47.140565+0000","last_became_peered":"2023-11-30T23:12:47.140565+0000","last_unstale":"2023-11-30T23:27:49.983621+0000","last_undegraded":"2023-11-30T23:27:49.983621+0000","last_fullsized":"2023-11-30T23:27:49.983621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'2309","last_scrub_stamp":"2023-11-30T23:27:49.983450+0000","last_deep_scrub":"49'2309","last_deep_scrub_stamp":"2023-11-30T23:27:49.983450+0000","last_clean_scrub_stamp":"2023-11-30T23:27:49.983450+0000","objects_scrubbed":14,"log_size":2309,"log_dups_size":0,"ondisk_log_size":2309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:03:38.592123+0000","scrub_duration":0.051593888999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":2336,"num_write_kb":17365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":84032,"num_omap_keys":167,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"49'3598","reported_seq":2959,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:09.673859+0000","last_change":"2023-11-30T23:28:09.674062+0000","last_active":"2023-11-30T23:28:09.673859+0000","last_peered":"2023-11-30T23:28:09.673859+0000","last_clean":"2023-11-30T23:28:09.673859+0000","last_became_active":"2023-11-30T23:12:47.501315+0000","last_became_peered":"2023-11-30T23:12:47.501315+0000","last_unstale":"2023-11-30T23:28:09.673859+0000","last_undegraded":"2023-11-30T23:28:09.673859+0000","last_fullsized":"2023-11-30T23:28:09.673859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3598","last_scrub_stamp":"2023-11-30T23:28:09.673787+0000","last_deep_scrub":"49'3598","last_deep_scrub_stamp":"2023-11-30T23:28:09.673787+0000","last_clean_scrub_stamp":"2023-11-30T23:28:09.673787+0000","objects_scrubbed":3,"log_size":3598,"log_dups_size":0,"ondisk_log_size":3598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:18:45.321668+0000","scrub_duration":0.039006821999999997,"objects_trimmed":0,"snaptrim_duration":0.026736012999999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"49'2886","reported_seq":2945,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:07.112372+0000","last_change":"2023-11-30T23:28:07.112567+0000","last_active":"2023-11-30T23:28:07.112372+0000","last_peered":"2023-11-30T23:28:07.112372+0000","last_clean":"2023-11-30T23:28:07.112372+0000","last_became_active":"2023-11-30T23:12:47.140037+0000","last_became_peered":"2023-11-30T23:12:47.140037+0000","last_unstale":"2023-11-30T23:28:07.112372+0000","last_undegraded":"2023-11-30T23:28:07.112372+0000","last_fullsized":"2023-11-30T23:28:07.112372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'2886","last_scrub_stamp":"2023-11-30T23:28:07.112328+0000","last_deep_scrub":"49'2886","last_deep_scrub_stamp":"2023-11-30T23:28:07.112328+0000","last_clean_scrub_stamp":"2023-11-30T23:28:07.112328+0000","objects_scrubbed":15,"log_size":2886,"log_dups_size":0,"ondisk_log_size":2886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:18:42.760209+0000","scrub_duration":0.079742007000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":2935,"num_write_kb":26081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":70994,"num_omap_keys":141,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"49'3362","reported_seq":2789,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:15.685357+0000","last_change":"2023-11-30T23:28:15.685357+0000","last_active":"2023-11-30T23:28:15.685357+0000","last_peered":"2023-11-30T23:28:15.685357+0000","last_clean":"2023-11-30T23:28:15.685357+0000","last_became_active":"2023-11-30T23:12:47.507181+0000","last_became_peered":"2023-11-30T23:12:47.507181+0000","last_unstale":"2023-11-30T23:28:15.685357+0000","last_undegraded":"2023-11-30T23:28:15.685357+0000","last_fullsized":"2023-11-30T23:28:15.685357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3362","last_scrub_stamp":"2023-11-30T23:28:15.685181+0000","last_deep_scrub":"49'3362","last_deep_scrub_stamp":"2023-11-30T23:28:15.685181+0000","last_clean_scrub_stamp":"2023-11-30T23:28:15.685181+0000","objects_scrubbed":3,"log_size":3362,"log_dups_size":0,"ondisk_log_size":3362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:25:10.772298+0000","scrub_duration":0.040165856999999999,"objects_trimmed":0,"snaptrim_duration":0.030024714000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"49'4607","reported_seq":4666,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:15.063379+0000","last_change":"2023-11-30T23:28:15.063379+0000","last_active":"2023-11-30T23:28:15.063379+0000","last_peered":"2023-11-30T23:28:15.063379+0000","last_clean":"2023-11-30T23:28:15.063379+0000","last_became_active":"2023-11-30T23:12:47.141664+0000","last_became_peered":"2023-11-30T23:12:47.141664+0000","last_unstale":"2023-11-30T23:28:15.063379+0000","last_undegraded":"2023-11-30T23:28:15.063379+0000","last_fullsized":"2023-11-30T23:28:15.063379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4607","last_scrub_stamp":"2023-11-30T23:28:15.063200+0000","last_deep_scrub":"49'4607","last_deep_scrub_stamp":"2023-11-30T23:28:15.063200+0000","last_clean_scrub_stamp":"2023-11-30T23:28:15.063200+0000","objects_scrubbed":23,"log_size":4607,"log_dups_size":0,"ondisk_log_size":4607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:41:16.465072+0000","scrub_duration":0.083387379999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4647,"num_write_kb":30581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":137087,"num_omap_keys":273,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"49'3590","reported_seq":2945,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:10.571189+0000","last_change":"2023-11-30T23:28:10.571476+0000","last_active":"2023-11-30T23:28:10.571189+0000","last_peered":"2023-11-30T23:28:10.571189+0000","last_clean":"2023-11-30T23:28:10.571189+0000","last_became_active":"2023-11-30T23:12:47.516939+0000","last_became_peered":"2023-11-30T23:12:47.516939+0000","last_unstale":"2023-11-30T23:28:10.571189+0000","last_undegraded":"2023-11-30T23:28:10.571189+0000","last_fullsized":"2023-11-30T23:28:10.571189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3590","last_scrub_stamp":"2023-11-30T23:28:10.571134+0000","last_deep_scrub":"49'3590","last_deep_scrub_stamp":"2023-11-30T23:28:10.571134+0000","last_clean_scrub_stamp":"2023-11-30T23:28:10.571134+0000","objects_scrubbed":1,"log_size":3590,"log_dups_size":0,"ondisk_log_size":3590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:56:26.453525+0000","scrub_duration":0.037709890000000003,"objects_trimmed":0,"snaptrim_duration":0.014334588000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"49'3873","reported_seq":3236,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:38.254467+0000","last_change":"2023-11-30T23:28:38.254652+0000","last_active":"2023-11-30T23:28:38.254467+0000","last_peered":"2023-11-30T23:28:38.254467+0000","last_clean":"2023-11-30T23:28:38.254467+0000","last_became_active":"2023-11-30T23:12:47.521310+0000","last_became_peered":"2023-11-30T23:12:47.521310+0000","last_unstale":"2023-11-30T23:28:38.254467+0000","last_undegraded":"2023-11-30T23:28:38.254467+0000","last_fullsized":"2023-11-30T23:28:38.254467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3873","last_scrub_stamp":"2023-11-30T23:28:38.254436+0000","last_deep_scrub":"49'3873","last_deep_scrub_stamp":"2023-11-30T23:28:38.254436+0000","last_clean_scrub_stamp":"2023-11-30T23:28:38.254436+0000","objects_scrubbed":1,"log_size":3873,"log_dups_size":0,"ondisk_log_size":3873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:29:43.481496+0000","scrub_duration":0.039992368,"objects_trimmed":0,"snaptrim_duration":0.015666933000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"49'637","reported_seq":695,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:18.002990+0000","last_change":"2023-11-30T23:28:18.003211+0000","last_active":"2023-11-30T23:28:18.002990+0000","last_peered":"2023-11-30T23:28:18.002990+0000","last_clean":"2023-11-30T23:28:18.002990+0000","last_became_active":"2023-11-30T23:12:47.143512+0000","last_became_peered":"2023-11-30T23:12:47.143512+0000","last_unstale":"2023-11-30T23:28:18.002990+0000","last_undegraded":"2023-11-30T23:28:18.002990+0000","last_fullsized":"2023-11-30T23:28:18.002990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'637","last_scrub_stamp":"2023-11-30T23:28:18.002965+0000","last_deep_scrub":"49'637","last_deep_scrub_stamp":"2023-11-30T23:28:18.002965+0000","last_clean_scrub_stamp":"2023-11-30T23:28:18.002965+0000","objects_scrubbed":15,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:26:28.869417+0000","scrub_duration":0.025368044999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":689,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":85608,"num_omap_keys":170,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"49'3823","reported_seq":3144,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:39.293810+0000","last_change":"2023-11-30T23:28:39.294016+0000","last_active":"2023-11-30T23:28:39.293810+0000","last_peered":"2023-11-30T23:28:39.293810+0000","last_clean":"2023-11-30T23:28:39.293810+0000","last_became_active":"2023-11-30T23:12:47.520322+0000","last_became_peered":"2023-11-30T23:12:47.520322+0000","last_unstale":"2023-11-30T23:28:39.293810+0000","last_undegraded":"2023-11-30T23:28:39.293810+0000","last_fullsized":"2023-11-30T23:28:39.293810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3823","last_scrub_stamp":"2023-11-30T23:28:39.293779+0000","last_deep_scrub":"49'3823","last_deep_scrub_stamp":"2023-11-30T23:28:39.293779+0000","last_clean_scrub_stamp":"2023-11-30T23:28:39.293779+0000","objects_scrubbed":3,"log_size":3823,"log_dups_size":0,"ondisk_log_size":3823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:52:00.549067+0000","scrub_duration":0.039171866,"objects_trimmed":0,"snaptrim_duration":0.018218595000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"49'4596","reported_seq":4656,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:16.094875+0000","last_change":"2023-11-30T23:28:16.095089+0000","last_active":"2023-11-30T23:28:16.094875+0000","last_peered":"2023-11-30T23:28:16.094875+0000","last_clean":"2023-11-30T23:28:16.094875+0000","last_became_active":"2023-11-30T23:12:47.141965+0000","last_became_peered":"2023-11-30T23:12:47.141965+0000","last_unstale":"2023-11-30T23:28:16.094875+0000","last_undegraded":"2023-11-30T23:28:16.094875+0000","last_fullsized":"2023-11-30T23:28:16.094875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4596","last_scrub_stamp":"2023-11-30T23:28:16.094835+0000","last_deep_scrub":"49'4596","last_deep_scrub_stamp":"2023-11-30T23:28:16.094835+0000","last_clean_scrub_stamp":"2023-11-30T23:28:16.094835+0000","objects_scrubbed":26,"log_size":4596,"log_dups_size":0,"ondisk_log_size":4596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:02:45.261146+0000","scrub_duration":0.11253972399999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":4627,"num_write_kb":34948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":138836,"num_omap_keys":276,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"49'3354","reported_seq":2807,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:26.490808+0000","last_change":"2023-11-30T23:28:26.491044+0000","last_active":"2023-11-30T23:28:26.490808+0000","last_peered":"2023-11-30T23:28:26.490808+0000","last_clean":"2023-11-30T23:28:26.490808+0000","last_became_active":"2023-11-30T23:12:47.522002+0000","last_became_peered":"2023-11-30T23:12:47.522002+0000","last_unstale":"2023-11-30T23:28:26.490808+0000","last_undegraded":"2023-11-30T23:28:26.490808+0000","last_fullsized":"2023-11-30T23:28:26.490808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3354","last_scrub_stamp":"2023-11-30T23:28:26.490741+0000","last_deep_scrub":"49'3354","last_deep_scrub_stamp":"2023-11-30T23:28:26.490741+0000","last_clean_scrub_stamp":"2023-11-30T23:28:26.490741+0000","objects_scrubbed":2,"log_size":3354,"log_dups_size":0,"ondisk_log_size":3354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:49:51.622648+0000","scrub_duration":0.025897142000000001,"objects_trimmed":0,"snaptrim_duration":0.025109995999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1079,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"49'4091","reported_seq":4150,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:51.788815+0000","last_change":"2023-11-30T23:27:51.789032+0000","last_active":"2023-11-30T23:27:51.788815+0000","last_peered":"2023-11-30T23:27:51.788815+0000","last_clean":"2023-11-30T23:27:51.788815+0000","last_became_active":"2023-11-30T23:12:47.138275+0000","last_became_peered":"2023-11-30T23:12:47.138275+0000","last_unstale":"2023-11-30T23:27:51.788815+0000","last_undegraded":"2023-11-30T23:27:51.788815+0000","last_fullsized":"2023-11-30T23:27:51.788815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'4091","last_scrub_stamp":"2023-11-30T23:27:51.788769+0000","last_deep_scrub":"49'4091","last_deep_scrub_stamp":"2023-11-30T23:27:51.788769+0000","last_clean_scrub_stamp":"2023-11-30T23:27:51.788769+0000","objects_scrubbed":23,"log_size":4091,"log_dups_size":0,"ondisk_log_size":4091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:01:46.780974+0000","scrub_duration":0.097030336999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":4121,"num_write_kb":30658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":137716,"num_omap_keys":273,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"49'3347","reported_seq":2761,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:28:01.772486+0000","last_change":"2023-11-30T23:28:01.772617+0000","last_active":"2023-11-30T23:28:01.772486+0000","last_peered":"2023-11-30T23:28:01.772486+0000","last_clean":"2023-11-30T23:28:01.772486+0000","last_became_active":"2023-11-30T23:12:47.508718+0000","last_became_peered":"2023-11-30T23:12:47.508718+0000","last_unstale":"2023-11-30T23:28:01.772486+0000","last_undegraded":"2023-11-30T23:28:01.772486+0000","last_fullsized":"2023-11-30T23:28:01.772486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'3347","last_scrub_stamp":"2023-11-30T23:28:01.772467+0000","last_deep_scrub":"49'3347","last_deep_scrub_stamp":"2023-11-30T23:28:01.772467+0000","last_clean_scrub_stamp":"2023-11-30T23:28:01.772467+0000","objects_scrubbed":1,"log_size":3347,"log_dups_size":0,"ondisk_log_size":3347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:57:07.257864+0000","scrub_duration":0.049927862000000003,"objects_trimmed":0,"snaptrim_duration":0.037282159000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"49'807","reported_seq":866,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-30T23:27:54.540611+0000","last_change":"2023-11-30T23:27:54.540737+0000","last_active":"2023-11-30T23:27:54.540611+0000","last_peered":"2023-11-30T23:27:54.540611+0000","last_clean":"2023-11-30T23:27:54.540611+0000","last_became_active":"2023-11-30T23:12:47.140891+0000","last_became_peered":"2023-11-30T23:12:47.140891+0000","last_unstale":"2023-11-30T23:27:54.540611+0000","last_undegraded":"2023-11-30T23:27:54.540611+0000","last_fullsized":"2023-11-30T23:27:54.540611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'807","last_scrub_stamp":"2023-11-30T23:27:54.540586+0000","last_deep_scrub":"49'807","last_deep_scrub_stamp":"2023-11-30T23:27:54.540586+0000","last_clean_scrub_stamp":"2023-11-30T23:27:54.540586+0000","objects_scrubbed":17,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:52:55.092935+0000","scrub_duration":0.051767756999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":847,"num_write_kb":12818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":125846,"num_omap_keys":246,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":74679,"num_write_kb":40592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228982,"ondisk_log_size":228982,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":275279537,"num_objects":614,"num_object_clones":0,"num_object_copies":1228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":614,"num_whiteouts":0,"num_read":1037,"num_read_kb":3420,"num_write":81074,"num_write_kb":625818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":540,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3578267,"num_omap_keys":7100,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":550617088,"data_stored":550559074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79243,"ondisk_log_size":79243,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575046,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":422580,"kb_used_data":70828,"kb_used_omap":0,"kb_used_meta":351744,"kb_avail":93949260,"statfs":{"total":96636764160,"available":96204042240,"internally_reserved":0,"allocated":72527872,"data_stored":72184368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":360185856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.34100000000000003,"5min":0.247,"15min":0.247},"max":{"1min":0.88300000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.85099999999999998,"15min":0.78500000000000003},"min":{"1min":0.29299999999999998,"5min":0.28499999999999998,"15min":0.25600000000000001},"max":{"1min":1.171,"5min":6.9429999999999996,"15min":6.9429999999999996},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.82199999999999995,"5min":7.0540000000000003,"15min":7.0540000000000003},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.749},"min":{"1min":0.54200000000000004,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.89700000000000002,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.82899999999999996,"15min":0.82699999999999996},"min":{"1min":0.373,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.0369999999999999,"5min":5.54,"15min":5.54},"last":1.028},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.84299999999999997,"15min":0.83999999999999997},"min":{"1min":0.437,"5min":0.312,"15min":0.312},"max":{"1min":0.95499999999999996,"5min":5.5880000000000001,"15min":5.5880000000000001},"last":0.84399999999999997}]},{"osd":3,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.91800000000000004,"15min":0.89900000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1379999999999999,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.94399999999999995,"15min":0.95499999999999996},"min":{"1min":0.54000000000000004,"5min":0.42399999999999999,"15min":0.39400000000000002},"max":{"1min":1.093,"5min":4.6589999999999998,"15min":4.6589999999999998},"last":0.92700000000000005}]},{"osd":4,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68700000000000006,"15min":0.76300000000000001},"min":{"1min":0.41699999999999998,"5min":0.316,"15min":0.314},"max":{"1min":1.069,"5min":1.3029999999999999,"15min":1.3759999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.78800000000000003,"15min":0.872},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.244,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.97599999999999998}]},{"osd":5,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77900000000000003,"15min":0.86299999999999999},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.097,"5min":1.7110000000000001,"15min":1.7210000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.81799999999999995,"15min":0.879},"min":{"1min":0.49299999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2330000000000001,"5min":1.796,"15min":1.796},"last":1.052}]},{"osd":6,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.873,"15min":0.93899999999999995},"min":{"1min":0.69499999999999995,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3620000000000001,"5min":1.694,"15min":2.9670000000000001},"last":0.879},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90200000000000002,"15min":0.97499999999999998},"min":{"1min":0.46700000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.226,"5min":2.23,"15min":2.23},"last":1.2909999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575046,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":346012,"kb_used_data":90196,"kb_used_omap":0,"kb_used_meta":255808,"kb_avail":94025828,"statfs":{"total":96636764160,"available":96282447872,"internally_reserved":0,"allocated":92360704,"data_stored":92035739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":261947392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.73999999999999999,"15min":0.73799999999999999},"min":{"1min":0.28899999999999998,"5min":0.23999999999999999,"15min":0.221},"max":{"1min":1.722,"5min":2.1640000000000001,"15min":2.5640000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78000000000000003,"15min":0.77900000000000003},"min":{"1min":0.29899999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.389,"5min":3.4670000000000001,"15min":3.4670000000000001},"last":1.0129999999999999}]},{"osd":1,"last update":"Thu Nov 30 23:28:15 2023","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":0.99299999999999999,"15min":0.91700000000000004},"min":{"1min":0.32100000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":10.983000000000001,"5min":10.983000000000001,"15min":12.172000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.052,"5min":0.89200000000000002,"15min":0.85799999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":5.6980000000000004},"last":0.92900000000000005}]},{"osd":2,"last update":"Thu Nov 30 23:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78600000000000003,"15min":0.78200000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.948,"5min":2.327,"15min":2.327},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.85399999999999998,"15min":0.872},"min":{"1min":0.41999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.7430000000000001,"5min":2.1240000000000001,"15min":2.774},"last":1.046}]},{"osd":3,"last update":"Thu Nov 30 23:28:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":0.96299999999999997,"15min":0.90500000000000003},"min":{"1min":0.58099999999999996,"5min":0.434,"15min":0.38900000000000001},"max":{"1min":5.3339999999999996,"5min":5.3339999999999996,"15min":5.3339999999999996},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.363,"5min":0.96599999999999997,"15min":0.89700000000000002},"min":{"1min":0.36399999999999999,"5min":0.318,"15min":0.318},"max":{"1min":9.3249999999999993,"5min":9.3249999999999993,"15min":9.3249999999999993},"last":0.876}]},{"osd":4,"last update":"Thu Nov 30 23:28:15 2023","interfaces":[{"interface":"back","average":{"1min":1.641,"5min":0.90600000000000003,"15min":0.88500000000000001},"min":{"1min":0.43099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":15.194000000000001,"5min":15.194000000000001,"15min":15.194000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":2.0630000000000002,"5min":1.101,"15min":0.96399999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":21.247,"5min":21.247,"15min":21.247},"last":0.84199999999999997}]},{"osd":5,"last update":"Thu Nov 30 23:28:15 2023","interfaces":[{"interface":"back","average":{"1min":2.133,"5min":1.0800000000000001,"15min":0.93300000000000005},"min":{"1min":0.435,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":23.149000000000001,"5min":23.149000000000001,"15min":23.149000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":1,"5min":0.90400000000000003,"15min":0.97299999999999998},"min":{"1min":0.32200000000000001,"5min":0.314,"15min":0.314},"max":{"1min":2.0259999999999998,"5min":2.2400000000000002,"15min":2.7040000000000002},"last":0.97599999999999998}]},{"osd":7,"last update":"Thu Nov 30 23:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.0720000000000001,"15min":1.0409999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.274,"5min":11.220000000000001,"15min":11.220000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.103,"15min":1.139},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.893,"5min":12.874000000000001,"15min":30.405999999999999},"last":0.95599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575046,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":384304,"kb_used_data":86632,"kb_used_omap":0,"kb_used_meta":297664,"kb_avail":93987536,"statfs":{"total":96636764160,"available":96243236864,"internally_reserved":0,"allocated":88711168,"data_stored":88370710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304807936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":2.4260000000000002,"5min":0.98999999999999999,"15min":0.81599999999999995},"min":{"1min":0.55800000000000005,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":28.123000000000001,"5min":28.123000000000001,"15min":28.123000000000001},"last":1.091},{"interface":"front","average":{"1min":2.2080000000000002,"5min":1.0309999999999999,"15min":0.84299999999999997},"min":{"1min":0.56699999999999995,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":24.707000000000001,"5min":24.707000000000001,"15min":24.707000000000001},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":2.1230000000000002,"5min":1.0449999999999999,"15min":0.90300000000000002},"min":{"1min":0.47499999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":22.565999999999999,"5min":22.565999999999999,"15min":22.565999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":2.1560000000000001,"5min":1.0449999999999999,"15min":0.94399999999999995},"min":{"1min":0.68899999999999995,"5min":0.313,"15min":0.313},"max":{"1min":22.395,"5min":22.395,"15min":22.395},"last":0.78500000000000003}]},{"osd":2,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":2.7519999999999998,"5min":1.1419999999999999,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.311,"15min":0.26700000000000002},"max":{"1min":33.149000000000001,"5min":33.149000000000001,"15min":33.149000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":2.101,"5min":1.036,"15min":0.91600000000000004},"min":{"1min":0.61099999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":22.699000000000002,"5min":22.699000000000002,"15min":22.699000000000002},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":2.1360000000000001,"5min":1.081,"15min":0.93300000000000005},"min":{"1min":0.629,"5min":0.314,"15min":0.314},"max":{"1min":22.943000000000001,"5min":22.943000000000001,"15min":22.943000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":2.4500000000000002,"5min":1.1419999999999999,"15min":1.0109999999999999},"min":{"1min":0.59399999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":27.643999999999998,"5min":27.643999999999998,"15min":27.643999999999998},"last":1.167}]},{"osd":4,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.70099999999999996,"15min":0.80100000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.335,"5min":1.456,"15min":1.4930000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81899999999999995,"15min":0.85499999999999998},"min":{"1min":0.44600000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.3029999999999999,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.002}]},{"osd":6,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":0.88700000000000001,"15min":0.90400000000000003},"min":{"1min":0.622,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":5.3719999999999999,"5min":5.3719999999999999,"15min":5.3719999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.996,"5min":0.86399999999999999,"15min":0.93200000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.9370000000000001,"5min":3.073,"15min":3.073},"last":1.1399999999999999}]},{"osd":7,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.89100000000000001,"15min":0.94199999999999995},"min":{"1min":0.41999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.4970000000000001,"5min":2.895,"15min":2.895},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.282,"5min":0.97499999999999998,"15min":0.995},"min":{"1min":0.52600000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":5.4139999999999997,"5min":5.4139999999999997,"15min":5.4139999999999997},"last":1.2370000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575045,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":349356,"kb_used_data":65636,"kb_used_omap":0,"kb_used_meta":283712,"kb_avail":94022484,"statfs":{"total":96636764160,"available":96279023616,"internally_reserved":0,"allocated":67211264,"data_stored":66877715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":290521088},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:28:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.83899999999999997,"15min":0.749},"min":{"1min":0.39500000000000002,"5min":0.245,"15min":0.245},"max":{"1min":1.2589999999999999,"5min":12.91,"15min":12.91},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.86199999999999999,"15min":0.77800000000000002},"min":{"1min":0.48099999999999998,"5min":0.253,"15min":0.253},"max":{"1min":1.1639999999999999,"5min":12.962,"15min":12.962},"last":0.94499999999999995}]},{"osd":1,"last update":"Thu Nov 30 23:28:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.76600000000000001,"15min":0.77900000000000003},"min":{"1min":0.45300000000000001,"5min":0.32600000000000001,"15min":0.25600000000000001},"max":{"1min":1.236,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.879,"5min":0.82899999999999996,"15min":0.78500000000000003},"min":{"1min":0.57999999999999996,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1080000000000001,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":1.111}]},{"osd":2,"last update":"Thu Nov 30 23:28:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84999999999999998,"15min":0.81000000000000005},"min":{"1min":0.51800000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.27,"5min":9.0229999999999997,"15min":9.0229999999999997},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.91900000000000004,"15min":0.89900000000000002},"min":{"1min":0.56100000000000005,"5min":0.376,"15min":0.33600000000000002},"max":{"1min":1.2250000000000001,"5min":8.9990000000000006,"15min":8.9990000000000006},"last":1.161}]},{"osd":3,"last update":"Thu Nov 30 23:28:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.87,"15min":0.84899999999999998},"min":{"1min":0.63300000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1379999999999999,"5min":5.0209999999999999,"15min":5.0209999999999999},"last":1.218},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.80600000000000005,"15min":0.82499999999999996},"min":{"1min":0.57199999999999995,"5min":0.311,"15min":0.311},"max":{"1min":1.1020000000000001,"5min":2.9489999999999998,"15min":2.9489999999999998},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Nov 30 23:28:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":1.5649999999999999,"15min":1.073},"min":{"1min":0.434,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0249999999999999,"5min":81.837000000000003,"15min":81.837000000000003},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.7030000000000001,"15min":1.1759999999999999},"min":{"1min":0.71599999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.222,"5min":81.751999999999995,"15min":81.751999999999995},"last":0.98599999999999999}]},{"osd":6,"last update":"Thu Nov 30 23:28:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.573,"15min":1.093},"min":{"1min":0.46300000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.204,"5min":79.655000000000001,"15min":79.655000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.673,"15min":1.202},"min":{"1min":0.60699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.339,"5min":80.540000000000006,"15min":80.540000000000006},"last":1.077}]},{"osd":7,"last update":"Thu Nov 30 23:28:13 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.7210000000000001,"15min":1.206},"min":{"1min":0.49299999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.29,"5min":80.486000000000004,"15min":80.486000000000004},"last":0.879},{"interface":"front","average":{"1min":1.03,"5min":1.724,"15min":1.2},"min":{"1min":0.53900000000000003,"5min":0.373,"15min":0.373},"max":{"1min":1.343,"5min":81.875,"15min":81.875},"last":1.038}]}]},{"osd":3,"up_from":13,"seq":55834575046,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375028,"kb_used_data":61036,"kb_used_omap":0,"kb_used_meta":313984,"kb_avail":93996812,"statfs":{"total":96636764160,"available":96252735488,"internally_reserved":0,"allocated":62500864,"data_stored":62176772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321519616},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.41999999999999998,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.05,"5min":1.2130000000000001,"15min":2.6589999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.34100000000000003,"5min":0.24299999999999999,"15min":0.23999999999999999},"max":{"1min":1.018,"5min":2.1850000000000001,"15min":2.4750000000000001},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.29499999999999998,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.86799999999999999,"5min":1.125,"15min":1.6319999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.749,"15min":0.77600000000000002},"min":{"1min":0.40100000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0620000000000001,"5min":1.256,"15min":4.8150000000000004},"last":0.82199999999999995}]},{"osd":2,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.77000000000000002},"min":{"1min":0.42699999999999999,"5min":0.35599999999999998,"15min":0.28000000000000003},"max":{"1min":0.96699999999999997,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.127},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82999999999999996,"15min":0.84999999999999998},"min":{"1min":0.55700000000000005,"5min":0.252,"15min":0.252},"max":{"1min":1.048,"5min":1.3580000000000001,"15min":4.8719999999999999},"last":0.96399999999999997}]},{"osd":4,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.89800000000000002,"15min":0.89600000000000002},"min":{"1min":0.66200000000000003,"5min":0.34100000000000003,"15min":0.31},"max":{"1min":1.6970000000000001,"5min":1.8919999999999999,"15min":2.536},"last":1.369},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95799999999999996,"15min":0.95599999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.378},"max":{"1min":1.3,"5min":4.6820000000000004,"15min":4.6820000000000004},"last":1.2070000000000001}]},{"osd":5,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0629999999999999,"15min":1.0209999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.42099999999999999},"max":{"1min":1.3440000000000001,"5min":8.8010000000000002,"15min":8.8010000000000002},"last":1.3340000000000001},{"interface":"front","average":{"1min":0.999,"5min":0.98699999999999999,"15min":1.04},"min":{"1min":0.47799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.2410000000000001,"5min":1.8500000000000001,"15min":4.9909999999999997},"last":1.1799999999999999}]},{"osd":6,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0389999999999999,"15min":1.02},"min":{"1min":0.60499999999999998,"5min":0.52100000000000002,"15min":0.378},"max":{"1min":1.284,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.0069999999999999,"15min":1.0649999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.45500000000000002},"max":{"1min":1.3380000000000001,"5min":1.4410000000000001,"15min":4.4379999999999997},"last":1.395}]},{"osd":7,"last update":"Thu Nov 30 23:28:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0349999999999999,"15min":1.087},"min":{"1min":0.625,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.381,"5min":1.4910000000000001,"15min":5.0369999999999999},"last":1.095},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.052,"15min":1.069},"min":{"1min":0.65300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.355,"5min":2.214,"15min":2.5609999999999999},"last":1.54}]}]},{"osd":2,"up_from":13,"seq":55834575047,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224108,"kb_used_data":40548,"kb_used_omap":0,"kb_used_meta":183552,"kb_avail":94147732,"statfs":{"total":96636764160,"available":96407277568,"internally_reserved":0,"allocated":41521152,"data_stored":41200500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":187957248},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.432,"5min":0.216,"15min":0.216},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.41699999999999998,"5min":0.222,"15min":0.17999999999999999},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.77400000000000002}]},{"osd":1,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":0.97999999999999998,"15min":0.80300000000000005},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":18.102,"5min":18.102,"15min":18.102},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.749,"15min":0.77400000000000002},"min":{"1min":0.32200000000000001,"5min":0.27500000000000002,"15min":0.224},"max":{"1min":1.899,"5min":1.899,"15min":11.457000000000001},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":2.198,"5min":1.087,"15min":0.83699999999999997},"min":{"1min":0.35799999999999998,"5min":0.224,"15min":0.224},"max":{"1min":29.039000000000001,"5min":29.039000000000001,"15min":29.039000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.876,"15min":0.85799999999999998},"min":{"1min":0.54400000000000004,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":1.1519999999999999}]},{"osd":4,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.85799999999999998,"15min":0.88300000000000001},"min":{"1min":0.44,"5min":0.30599999999999999,"15min":0.28299999999999997},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.97199999999999998},{"interface":"front","average":{"1min":1,"5min":0.89500000000000002,"15min":0.879},"min":{"1min":0.59399999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.7160000000000002,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":1.0940000000000001}]},{"osd":5,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.997,"15min":1.0009999999999999},"min":{"1min":0.60899999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.829,"5min":2.323,"15min":2.323},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.401,"5min":1.073,"15min":1.024},"min":{"1min":0.47699999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":9.6150000000000002,"5min":9.6150000000000002,"15min":9.6150000000000002},"last":1.002}]},{"osd":6,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.02,"15min":0.97599999999999998},"min":{"1min":0.45700000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":3.7549999999999999,"5min":4.9420000000000002,"15min":4.9420000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.7270000000000001,"5min":1.1879999999999999,"15min":1.1080000000000001},"min":{"1min":0.65700000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":13.433,"5min":13.433,"15min":13.433},"last":1.2450000000000001}]},{"osd":7,"last update":"Thu Nov 30 23:28:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.0649999999999999,"15min":1.0669999999999999},"min":{"1min":0.623,"5min":0.376,"15min":0.376},"max":{"1min":3.9399999999999999,"5min":3.9399999999999999,"15min":3.9399999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.115,"5min":1.1020000000000001,"15min":1.054},"min":{"1min":0.58399999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.782,"5min":3.782,"15min":3.782},"last":1.276}]}]},{"osd":1,"up_from":13,"seq":55834575047,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396572,"kb_used_data":86612,"kb_used_omap":0,"kb_used_meta":309952,"kb_avail":93975268,"statfs":{"total":96636764160,"available":96230674432,"internally_reserved":0,"allocated":88690688,"data_stored":88358599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":317390848},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63600000000000001,"15min":0.60299999999999998},"min":{"1min":0.28499999999999998,"5min":0.24299999999999999,"15min":0.183},"max":{"1min":0.99399999999999999,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.67900000000000005,"15min":0.66500000000000004},"min":{"1min":0.28000000000000003,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.627}]},{"osd":2,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.175,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.745,"15min":0.72599999999999998},"min":{"1min":0.316,"5min":0.26000000000000001,"15min":0.20699999999999999},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.93600000000000005}]},{"osd":3,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77400000000000002,"15min":0.79400000000000004},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.222,"5min":1.222,"15min":1.431},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.76800000000000002,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.137,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.86899999999999999,"15min":0.877},"min":{"1min":0.58099999999999996,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.538,"5min":3.476,"15min":3.476},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.85899999999999999,"15min":0.879},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.6919999999999999},"last":0.752}]},{"osd":5,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83399999999999996,"15min":0.84299999999999997},"min":{"1min":0.38800000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.2809999999999999,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.161,"5min":1.0129999999999999,"15min":0.995},"min":{"1min":0.53400000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.91700000000000004,"15min":0.92500000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.351,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.016,"15min":1.018},"min":{"1min":0.68300000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.496,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":1.0669999999999999}]},{"osd":7,"last update":"Thu Nov 30 23:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.98499999999999999,"15min":0.999},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":1.4019999999999999,"5min":2.7549999999999999,"15min":2.7549999999999999},"last":1.008},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.98799999999999999,"15min":0.997},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.5980000000000001,"5min":3.2280000000000002,"15min":3.2280000000000002},"last":1.03}]}]},{"osd":0,"up_from":13,"seq":55834575046,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243824,"kb_used_data":42152,"kb_used_omap":0,"kb_used_meta":201664,"kb_avail":94128016,"statfs":{"total":96636764160,"available":96387088384,"internally_reserved":0,"allocated":43163648,"data_stored":42816095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":206503936},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63800000000000001,"15min":0.61499999999999999},"min":{"1min":0.32500000000000001,"5min":0.26800000000000002,"15min":0.20999999999999999},"max":{"1min":1.048,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.67700000000000005,"15min":0.66600000000000004},"min":{"1min":0.36499999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.486,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.94799999999999995}]},{"osd":2,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":1.798,"5min":0.94899999999999995,"15min":0.81599999999999995},"min":{"1min":0.38400000000000001,"5min":0.311,"15min":0.23699999999999999},"max":{"1min":16.774999999999999,"5min":16.774999999999999,"15min":16.774999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.798,"5min":0.97399999999999998,"15min":0.84099999999999997},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":16.652999999999999,"5min":16.652999999999999,"15min":16.652999999999999},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69899999999999995,"15min":0.71599999999999997},"min":{"1min":0.378,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.85599999999999998,"5min":1.387,"15min":4.3170000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85099999999999998,"15min":0.83199999999999996},"min":{"1min":0.439,"5min":0.254,"15min":0.254},"max":{"1min":1.036,"5min":1.925,"15min":2.395},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90500000000000003,"15min":0.88500000000000001},"min":{"1min":0.36899999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.3180000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":0.92600000000000005,"15min":0.90600000000000003},"min":{"1min":0.40699999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":5.5720000000000001,"5min":5.5720000000000001,"15min":5.5720000000000001},"last":1.0649999999999999}]},{"osd":5,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":2.1190000000000002,"5min":1.131,"15min":0.98799999999999999},"min":{"1min":0.59899999999999998,"5min":0.315,"15min":0.315},"max":{"1min":19.577999999999999,"5min":19.577999999999999,"15min":19.577999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":4.3890000000000002,"5min":1.724,"15min":1.2869999999999999},"min":{"1min":0.54500000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":52.176000000000002,"5min":52.176000000000002,"15min":52.176000000000002},"last":0.98799999999999999}]},{"osd":6,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.0720000000000001,"15min":1.0649999999999999},"min":{"1min":0.68300000000000005,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.341,"5min":2.0840000000000001,"15min":2.5209999999999999},"last":1.121},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.026,"15min":1.018},"min":{"1min":0.45700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.2529999999999999,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.03}]},{"osd":7,"last update":"Thu Nov 30 23:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.0720000000000001,"15min":1.083},"min":{"1min":0.49399999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.395,"5min":2.254,"15min":8.3490000000000002},"last":1.141},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0049999999999999,"15min":1.0309999999999999},"min":{"1min":0.57999999999999996,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2170000000000001,"5min":1.9059999999999999,"15min":6.1529999999999996},"last":1.222}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41955328,"data_stored":41943678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":88088576,"data_stored":88080689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40919040,"data_stored":40918503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61898752,"data_stored":61890695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":66600960,"data_stored":66587530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":88084480,"data_stored":88080474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":91762688,"data_stored":91753755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":28760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":24621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":28708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":32788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":36947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":28695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":36961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-30T23:28:53.256 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-30T23:28:53.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.372+0000 7f047da98700 1 Processor -- start 2023-11-30T23:28:53.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.372+0000 7f047da98700 1 -- start start 2023-11-30T23:28:53.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.372+0000 7f047da98700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f04780b3010 0x7f0478142d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:53.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.372+0000 7f047da98700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f04780b4170 0x7f0478140410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:53.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.372+0000 7f047da98700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047806e7b0 con 0x7f04781432a0 2023-11-30T23:28:53.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.372+0000 7f047da98700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047806e380 con 0x7f04780b4170 2023-11-30T23:28:53.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.372+0000 7f047da98700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04780ae850 con 0x7f04780b3010 2023-11-30T23:28:53.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f047d297700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f04780b4170 0x7f0478140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:53.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f0477fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f04781432a0 0x7f047813fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34274/0 (socket says 172.21.15.73:34274) 2023-11-30T23:28:53.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f0477fff700 1 -- 172.21.15.73:0/3923514015 learned_addr learned my addr 172.21.15.73:0/3923514015 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:28:53.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f047ca96700 1 --2- 172.21.15.73:0/3923514015 >> v2:172.21.15.156:3300/0 conn(0x7f04780b3010 0x7f0478142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:53.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f047d297700 1 -- 172.21.15.73:0/3923514015 >> v2:172.21.15.156:3300/0 conn(0x7f04780b3010 msgr2=0x7f0478142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:28:53.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f047d297700 1 --2- 172.21.15.73:0/3923514015 >> v2:172.21.15.156:3300/0 conn(0x7f04780b3010 0x7f0478142d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f047d297700 1 -- 172.21.15.73:0/3923514015 >> v1:172.21.15.73:6789/0 conn(0x7f04781432a0 legacy=0x7f047813fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:53.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f04777fe700 1 -- 172.21.15.73:0/3923514015 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623941411 0 0) 0x7f047806e7b0 con 0x7f04781432a0 2023-11-30T23:28:53.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f047d297700 1 -- 172.21.15.73:0/3923514015 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047806e540 con 0x7f04780b4170 2023-11-30T23:28:53.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f047d297700 1 --2- 172.21.15.73:0/3923514015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04780b4170 0x7f0478140410 secure :-1 s=READY pgs=4268 cs=0 l=1 rev1=1 crypto rx=0x7f04780b8bf0 tx=0x7f047000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733294c2aec04621 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:53.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f04777fe700 1 -- 172.21.15.73:0/3923514015 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047000e070 con 0x7f04780b4170 2023-11-30T23:28:53.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f04777fe700 1 -- 172.21.15.73:0/3923514015 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047000bbd0 con 0x7f04780b4170 2023-11-30T23:28:53.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f04777fe700 1 -- 172.21.15.73:0/3923514015 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0470012430 con 0x7f04780b4170 2023-11-30T23:28:53.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f047da98700 1 -- 172.21.15.73:0/3923514015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04780b4170 msgr2=0x7f0478140410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:53.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f047da98700 1 --2- 172.21.15.73:0/3923514015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04780b4170 0x7f0478140410 secure :-1 s=READY pgs=4268 cs=0 l=1 rev1=1 crypto rx=0x7f04780b8bf0 tx=0x7f047000b330 comp rx=0 tx=0).stop 2023-11-30T23:28:53.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f047da98700 1 -- 172.21.15.73:0/3923514015 shutdown_connections 2023-11-30T23:28:53.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f047da98700 1 --2- 172.21.15.73:0/3923514015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04780b4170 0x7f0478140410 unknown :-1 s=CLOSED pgs=4268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f047da98700 1 --2- 172.21.15.73:0/3923514015 >> v2:172.21.15.156:3300/0 conn(0x7f04780b3010 0x7f0478142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f047da98700 1 -- 172.21.15.73:0/3923514015 >> 172.21.15.73:0/3923514015 conn(0x7f04780b7b70 msgr2=0x7f04780b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:53.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f047da98700 1 -- 172.21.15.73:0/3923514015 shutdown_connections 2023-11-30T23:28:53.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.376+0000 7f047da98700 1 -- 172.21.15.73:0/3923514015 wait complete. 2023-11-30T23:28:53.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f047da98700 1 Processor -- start 2023-11-30T23:28:53.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f047da98700 1 -- start start 2023-11-30T23:28:53.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f047da98700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04780b3010 0x7f047813dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:53.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f047da98700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04780b4170 0x7f04781460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:53.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f047da98700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04781432a0 0x7f04781d9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:53.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f047da98700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047813c2d0 con 0x7f04780b3010 2023-11-30T23:28:53.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f047da98700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047813f7b0 con 0x7f04780b4170 2023-11-30T23:28:53.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f047da98700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047813c590 con 0x7f04781432a0 2023-11-30T23:28:53.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f047ca96700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04780b3010 0x7f047813dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:53.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f047ca96700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04780b3010 0x7f047813dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39268/0 (socket says 172.21.15.73:39268) 2023-11-30T23:28:53.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f047ca96700 1 -- 172.21.15.73:0/898468817 learned_addr learned my addr 172.21.15.73:0/898468817 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:28:53.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f0477fff700 1 --2- 172.21.15.73:0/898468817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04780b4170 0x7f04781460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:53.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f047d297700 1 --2- 172.21.15.73:0/898468817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04781432a0 0x7f04781d9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:53.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f047ca96700 1 -- 172.21.15.73:0/898468817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04781432a0 msgr2=0x7f04781d9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:53.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f047ca96700 1 --2- 172.21.15.73:0/898468817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04781432a0 0x7f04781d9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f047ca96700 1 -- 172.21.15.73:0/898468817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04780b4170 msgr2=0x7f04781460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:53.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f047ca96700 1 --2- 172.21.15.73:0/898468817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04780b4170 0x7f04781460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f047ca96700 1 -- 172.21.15.73:0/898468817 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0470009a70 con 0x7f04780b3010 2023-11-30T23:28:53.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f047ca96700 1 --2- 172.21.15.73:0/898468817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04780b3010 0x7f047813dc50 secure :-1 s=READY pgs=4269 cs=0 l=1 rev1=1 crypto rx=0x7f046c00e810 tx=0x7f046c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:53.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.380+0000 7f04757fa700 1 -- 172.21.15.73:0/898468817 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c00c070 con 0x7f04780b3010 2023-11-30T23:28:53.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.384+0000 7f04757fa700 1 -- 172.21.15.73:0/898468817 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c005a40 con 0x7f04780b3010 2023-11-30T23:28:53.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.384+0000 7f04757fa700 1 -- 172.21.15.73:0/898468817 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c005df0 con 0x7f04780b3010 2023-11-30T23:28:53.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.384+0000 7f047da98700 1 -- 172.21.15.73:0/898468817 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0478140a50 con 0x7f04780b3010 2023-11-30T23:28:53.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.384+0000 7f047da98700 1 -- 172.21.15.73:0/898468817 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f047813d800 con 0x7f04780b3010 2023-11-30T23:28:53.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.384+0000 7f047da98700 1 -- 172.21.15.73:0/898468817 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047813c750 con 0x7f04780b3010 2023-11-30T23:28:53.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.384+0000 7f04757fa700 1 -- 172.21.15.73:0/898468817 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f046c006020 con 0x7f04780b3010 2023-11-30T23:28:53.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.384+0000 7f04757fa700 1 --2- 172.21.15.73:0/898468817 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0464065ad0 0x7f0464067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:53.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.384+0000 7f04757fa700 1 -- 172.21.15.73:0/898468817 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f046c082c10 con 0x7f04780b3010 2023-11-30T23:28:53.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.384+0000 7f0477fff700 1 --2- 172.21.15.73:0/898468817 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0464065ad0 0x7f0464067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:53.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.388+0000 7f0477fff700 1 --2- 172.21.15.73:0/898468817 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0464065ad0 0x7f0464067f90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0478147340 tx=0x7f0468009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:53.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.392+0000 7f04757fa700 1 -- 172.21.15.73:0/898468817 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f046c0504a0 con 0x7f04780b3010 2023-11-30T23:28:53.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.560+0000 7f047da98700 1 -- 172.21.15.73:0/898468817 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f047813f5f0 con 0x7f04780b3010 2023-11-30T23:28:53.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.572+0000 7f04757fa700 1 -- 172.21.15.73:0/898468817 <== mon.0 v2:172.21.15.73:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f046c0504a0 con 0x7f04780b3010 2023-11-30T23:28:53.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.572+0000 7f04757fa700 1 -- 172.21.15.73:0/898468817 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f046c053ac0 con 0x7f04780b3010 2023-11-30T23:28:53.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.572+0000 7f047da98700 1 -- 172.21.15.73:0/898468817 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0464065ad0 msgr2=0x7f0464067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:53.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.572+0000 7f047da98700 1 --2- 172.21.15.73:0/898468817 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0464065ad0 0x7f0464067f90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0478147340 tx=0x7f0468009040 comp rx=0 tx=0).stop 2023-11-30T23:28:53.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.572+0000 7f047da98700 1 -- 172.21.15.73:0/898468817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04780b3010 msgr2=0x7f047813dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.572+0000 7f047da98700 1 --2- 172.21.15.73:0/898468817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04780b3010 0x7f047813dc50 secure :-1 s=READY pgs=4269 cs=0 l=1 rev1=1 crypto rx=0x7f046c00e810 tx=0x7f046c00eb20 comp rx=0 tx=0).stop 2023-11-30T23:28:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.572+0000 7f047da98700 1 -- 172.21.15.73:0/898468817 shutdown_connections 2023-11-30T23:28:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.572+0000 7f047da98700 1 --2- 172.21.15.73:0/898468817 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f04781432a0 0x7f04781d9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.572+0000 7f047da98700 1 --2- 172.21.15.73:0/898468817 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f0464065ad0 0x7f0464067f90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.572+0000 7f047da98700 1 --2- 172.21.15.73:0/898468817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04780b4170 0x7f04781460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.572+0000 7f047da98700 1 --2- 172.21.15.73:0/898468817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04780b3010 0x7f047813dc50 unknown :-1 s=CLOSED pgs=4269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.572+0000 7f047da98700 1 -- 172.21.15.73:0/898468817 >> 172.21.15.73:0/898468817 conn(0x7f04780b7b70 msgr2=0x7f04780b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.572+0000 7f047da98700 1 -- 172.21.15.73:0/898468817 shutdown_connections 2023-11-30T23:28:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.572+0000 7f047da98700 1 -- 172.21.15.73:0/898468817 wait complete. 2023-11-30T23:28:53.591 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-30T23:28:53.591 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T23:28:53.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d973e700 1 Processor -- start 2023-11-30T23:28:53.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d973e700 1 -- start start 2023-11-30T23:28:53.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d973e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6d40afcc0 0x7fe6d4144e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:53.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d973e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe6d40b24a0 0x7fe6d414e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:53.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d973e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d40b0fb0 con 0x7fe6d414e1f0 2023-11-30T23:28:53.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d973e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d40af5e0 con 0x7fe6d40b24a0 2023-11-30T23:28:53.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d973e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d414ee90 con 0x7fe6d40afcc0 2023-11-30T23:28:53.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d8f3d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe6d40b24a0 0x7fe6d414e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:53.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d3fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe6d414e1f0 0x7fe6d4144700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34288/0 (socket says 172.21.15.73:34288) 2023-11-30T23:28:53.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d3fff700 1 -- 172.21.15.73:0/2610048290 learned_addr learned my addr 172.21.15.73:0/2610048290 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:28:53.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d37fe700 1 --2- 172.21.15.73:0/2610048290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6d40afcc0 0x7fe6d4144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:53.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d2ffd700 1 -- 172.21.15.73:0/2610048290 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098076837 0 0) 0x7fe6d40b0fb0 con 0x7fe6d414e1f0 2023-11-30T23:28:53.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d2ffd700 1 -- 172.21.15.73:0/2610048290 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6b40035d0 con 0x7fe6d414e1f0 2023-11-30T23:28:53.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d8f3d700 1 -- 172.21.15.73:0/2610048290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6d40afcc0 msgr2=0x7fe6d4144e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:28:53.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d8f3d700 1 --2- 172.21.15.73:0/2610048290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6d40afcc0 0x7fe6d4144e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d2ffd700 1 -- 172.21.15.73:0/2610048290 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1803031066 0 0) 0x7fe6b40035d0 con 0x7fe6d414e1f0 2023-11-30T23:28:53.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d8f3d700 1 -- 172.21.15.73:0/2610048290 >> v1:172.21.15.73:6789/0 conn(0x7fe6d414e1f0 legacy=0x7fe6d4144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d8f3d700 1 -- 172.21.15.73:0/2610048290 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d40b1c80 con 0x7fe6d40b24a0 2023-11-30T23:28:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d8f3d700 1 --2- 172.21.15.73:0/2610048290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6d40b24a0 0x7fe6d414e950 secure :-1 s=READY pgs=4271 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009850 tx=0x7fe6bc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f93643f0ce9e816 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d2ffd700 1 -- 172.21.15.73:0/2610048290 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc0019f0 con 0x7fe6d40b24a0 2023-11-30T23:28:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d2ffd700 1 -- 172.21.15.73:0/2610048290 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe6bc004030 con 0x7fe6d40b24a0 2023-11-30T23:28:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d2ffd700 1 -- 172.21.15.73:0/2610048290 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc004400 con 0x7fe6d40b24a0 2023-11-30T23:28:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d973e700 1 -- 172.21.15.73:0/2610048290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6d40b24a0 msgr2=0x7fe6d414e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d973e700 1 --2- 172.21.15.73:0/2610048290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6d40b24a0 0x7fe6d414e950 secure :-1 s=READY pgs=4271 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009850 tx=0x7fe6bc009b60 comp rx=0 tx=0).stop 2023-11-30T23:28:53.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d973e700 1 -- 172.21.15.73:0/2610048290 shutdown_connections 2023-11-30T23:28:53.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d973e700 1 --2- 172.21.15.73:0/2610048290 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6d40afcc0 0x7fe6d4144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d973e700 1 --2- 172.21.15.73:0/2610048290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6d40b24a0 0x7fe6d414e950 unknown :-1 s=CLOSED pgs=4271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d973e700 1 -- 172.21.15.73:0/2610048290 >> 172.21.15.73:0/2610048290 conn(0x7fe6d40b45a0 msgr2=0x7fe6d40b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:53.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d973e700 1 -- 172.21.15.73:0/2610048290 shutdown_connections 2023-11-30T23:28:53.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.700+0000 7fe6d973e700 1 -- 172.21.15.73:0/2610048290 wait complete. 2023-11-30T23:28:53.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d973e700 1 Processor -- start 2023-11-30T23:28:53.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d973e700 1 -- start start 2023-11-30T23:28:53.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d973e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6d40afcc0 0x7fe6d414d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:53.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d973e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6d40b24a0 0x7fe6d40b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:53.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d973e700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6d414e1f0 0x7fe6d40b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:53.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d973e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d41df870 con 0x7fe6d40afcc0 2023-11-30T23:28:53.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d973e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d40b65b0 con 0x7fe6d40b24a0 2023-11-30T23:28:53.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d973e700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d4072490 con 0x7fe6d414e1f0 2023-11-30T23:28:53.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6d40afcc0 0x7fe6d414d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:53.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6d40afcc0 0x7fe6d414d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39276/0 (socket says 172.21.15.73:39276) 2023-11-30T23:28:53.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d3fff700 1 -- 172.21.15.73:0/3813857281 learned_addr learned my addr 172.21.15.73:0/3813857281 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:28:53.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d8f3d700 1 --2- 172.21.15.73:0/3813857281 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6d414e1f0 0x7fe6d40b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:53.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d37fe700 1 --2- 172.21.15.73:0/3813857281 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6d40b24a0 0x7fe6d40b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:53.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d3fff700 1 -- 172.21.15.73:0/3813857281 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6d414e1f0 msgr2=0x7fe6d40b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:53.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d3fff700 1 --2- 172.21.15.73:0/3813857281 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6d414e1f0 0x7fe6d40b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d3fff700 1 -- 172.21.15.73:0/3813857281 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6d40b24a0 msgr2=0x7fe6d40b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:53.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d3fff700 1 --2- 172.21.15.73:0/3813857281 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6d40b24a0 0x7fe6d40b6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d3fff700 1 -- 172.21.15.73:0/3813857281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6bc0094b0 con 0x7fe6d40afcc0 2023-11-30T23:28:53.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d3fff700 1 --2- 172.21.15.73:0/3813857281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6d40afcc0 0x7fe6d414d420 secure :-1 s=READY pgs=4272 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0018e0 tx=0x7fe6cc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:53.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d0ff9700 1 -- 172.21.15.73:0/3813857281 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc00ada0 con 0x7fe6d40afcc0 2023-11-30T23:28:53.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d0ff9700 1 -- 172.21.15.73:0/3813857281 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe6cc0070d0 con 0x7fe6d40afcc0 2023-11-30T23:28:53.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d0ff9700 1 -- 172.21.15.73:0/3813857281 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc007480 con 0x7fe6d40afcc0 2023-11-30T23:28:53.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d973e700 1 -- 172.21.15.73:0/3813857281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d40b5a60 con 0x7fe6d40afcc0 2023-11-30T23:28:53.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d973e700 1 -- 172.21.15.73:0/3813857281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d414ab70 con 0x7fe6d40afcc0 2023-11-30T23:28:53.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.704+0000 7fe6d973e700 1 -- 172.21.15.73:0/3813857281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d4145d20 con 0x7fe6d40afcc0 2023-11-30T23:28:53.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.708+0000 7fe6d0ff9700 1 -- 172.21.15.73:0/3813857281 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe6cc0075e0 con 0x7fe6d40afcc0 2023-11-30T23:28:53.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.708+0000 7fe6d0ff9700 1 --2- 172.21.15.73:0/3813857281 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fe6b8065ad0 0x7fe6b8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:53.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.708+0000 7fe6d37fe700 1 --2- 172.21.15.73:0/3813857281 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fe6b8065ad0 0x7fe6b8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:53.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.708+0000 7fe6d0ff9700 1 -- 172.21.15.73:0/3813857281 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fe6cc082ec0 con 0x7fe6d40afcc0 2023-11-30T23:28:53.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.708+0000 7fe6d37fe700 1 --2- 172.21.15.73:0/3813857281 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fe6b8065ad0 0x7fe6b8067f90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4142d60 tx=0x7fe6c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:53.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.712+0000 7fe6d0ff9700 1 -- 172.21.15.73:0/3813857281 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fe6cc050750 con 0x7fe6d40afcc0 2023-11-30T23:28:53.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.912+0000 7fe6d973e700 1 -- 172.21.15.73:0/3813857281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6d40b58c0 con 0x7fe6d40afcc0 2023-11-30T23:28:53.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.916+0000 7fe6d0ff9700 1 -- 172.21.15.73:0/3813857281 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3133 (secure 0 0 0) 0x7fe6d40b58c0 con 0x7fe6d40afcc0 2023-11-30T23:28:53.919 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:28:53.919 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3213239947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3213239947},{"type":"v1","addr":"172.21.15.73:6835","nonce":3213239947}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T23:12:47.481180+0000","modified":"2023-11-30T23:12:50.126014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6833/1140380051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":1140380051},{"type":"v1","addr":"172.21.15.156:6833","nonce":1140380051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-30T23:28:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.916+0000 7fe6d973e700 1 -- 172.21.15.73:0/3813857281 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fe6b8065ad0 msgr2=0x7fe6b8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.916+0000 7fe6d973e700 1 --2- 172.21.15.73:0/3813857281 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fe6b8065ad0 0x7fe6b8067f90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4142d60 tx=0x7fe6c4008040 comp rx=0 tx=0).stop 2023-11-30T23:28:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.916+0000 7fe6d973e700 1 -- 172.21.15.73:0/3813857281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6d40afcc0 msgr2=0x7fe6d414d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:53.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.916+0000 7fe6d973e700 1 --2- 172.21.15.73:0/3813857281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6d40afcc0 0x7fe6d414d420 secure :-1 s=READY pgs=4272 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0018e0 tx=0x7fe6cc00a340 comp rx=0 tx=0).stop 2023-11-30T23:28:53.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.916+0000 7fe6d973e700 1 -- 172.21.15.73:0/3813857281 shutdown_connections 2023-11-30T23:28:53.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.916+0000 7fe6d973e700 1 --2- 172.21.15.73:0/3813857281 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7fe6d414e1f0 0x7fe6d40b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.916+0000 7fe6d973e700 1 --2- 172.21.15.73:0/3813857281 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7fe6b8065ad0 0x7fe6b8067f90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.916+0000 7fe6d973e700 1 --2- 172.21.15.73:0/3813857281 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6d40b24a0 0x7fe6d40b6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.916+0000 7fe6d973e700 1 --2- 172.21.15.73:0/3813857281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6d40afcc0 0x7fe6d414d420 unknown :-1 s=CLOSED pgs=4272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.916+0000 7fe6d973e700 1 -- 172.21.15.73:0/3813857281 >> 172.21.15.73:0/3813857281 conn(0x7fe6d40b45a0 msgr2=0x7fe6d4145380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.916+0000 7fe6d973e700 1 -- 172.21.15.73:0/3813857281 shutdown_connections 2023-11-30T23:28:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:53.916+0000 7fe6d973e700 1 -- 172.21.15.73:0/3813857281 wait complete. 2023-11-30T23:28:53.927 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 7 2023-11-30T23:28:53.934 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-30T23:28:54.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.040+0000 7febc2c38700 1 Processor -- start 2023-11-30T23:28:54.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.040+0000 7febc2c38700 1 -- start start 2023-11-30T23:28:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc2c38700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7febbc1440d0 0x7febbc070220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc2c38700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7febbc070760 0x7febbc13d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc2c38700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febbc06f800 con 0x7febbc06f420 2023-11-30T23:28:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc2c38700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febbc1435f0 con 0x7febbc1440d0 2023-11-30T23:28:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc2c38700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febbc1438d0 con 0x7febbc070760 2023-11-30T23:28:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc1435700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7febbc1440d0 0x7febbc070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc1c36700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7febbc06f420 0x7febbc0b35d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34298/0 (socket says 172.21.15.73:34298) 2023-11-30T23:28:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc1c36700 1 -- 172.21.15.73:0/3003593438 learned_addr learned my addr 172.21.15.73:0/3003593438 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:28:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc1435700 1 -- 172.21.15.73:0/3003593438 >> v2:172.21.15.156:3300/0 conn(0x7febbc070760 msgr2=0x7febbc13d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:28:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc1435700 1 --2- 172.21.15.73:0/3003593438 >> v2:172.21.15.156:3300/0 conn(0x7febbc070760 0x7febbc13d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc1435700 1 -- 172.21.15.73:0/3003593438 >> v1:172.21.15.73:6789/0 conn(0x7febbc06f420 legacy=0x7febbc0b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc1435700 1 -- 172.21.15.73:0/3003593438 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc143bb0 con 0x7febbc1440d0 2023-11-30T23:28:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc1435700 1 --2- 172.21.15.73:0/3003593438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc1440d0 0x7febbc070220 secure :-1 s=READY pgs=4274 cs=0 l=1 rev1=1 crypto rx=0x7febbc073d70 tx=0x7febb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107bc2f6988ad150 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc0c34700 1 -- 172.21.15.73:0/3003593438 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb800e070 con 0x7febbc1440d0 2023-11-30T23:28:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc0c34700 1 -- 172.21.15.73:0/3003593438 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7febb800bbd0 con 0x7febbc1440d0 2023-11-30T23:28:54.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc0c34700 1 -- 172.21.15.73:0/3003593438 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb8012430 con 0x7febbc1440d0 2023-11-30T23:28:54.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc2c38700 1 -- 172.21.15.73:0/3003593438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc1440d0 msgr2=0x7febbc070220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:54.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc2c38700 1 --2- 172.21.15.73:0/3003593438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc1440d0 0x7febbc070220 secure :-1 s=READY pgs=4274 cs=0 l=1 rev1=1 crypto rx=0x7febbc073d70 tx=0x7febb800b330 comp rx=0 tx=0).stop 2023-11-30T23:28:54.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc2c38700 1 -- 172.21.15.73:0/3003593438 shutdown_connections 2023-11-30T23:28:54.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc2c38700 1 --2- 172.21.15.73:0/3003593438 >> v2:172.21.15.156:3300/0 conn(0x7febbc070760 0x7febbc13d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc2c38700 1 --2- 172.21.15.73:0/3003593438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc1440d0 0x7febbc070220 unknown :-1 s=CLOSED pgs=4274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc2c38700 1 -- 172.21.15.73:0/3003593438 >> 172.21.15.73:0/3003593438 conn(0x7febbc06b290 msgr2=0x7febbc06b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:54.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc2c38700 1 -- 172.21.15.73:0/3003593438 shutdown_connections 2023-11-30T23:28:54.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.044+0000 7febc2c38700 1 -- 172.21.15.73:0/3003593438 wait complete. 2023-11-30T23:28:54.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.048+0000 7febc2c38700 1 Processor -- start 2023-11-30T23:28:54.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.048+0000 7febc2c38700 1 -- start start 2023-11-30T23:28:54.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.048+0000 7febc2c38700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febbc06f420 0x7febbc0b7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:54.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.048+0000 7febc2c38700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febbc070760 0x7febbc13dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:54.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.048+0000 7febc2c38700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc1440d0 0x7febbc137c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:54.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.048+0000 7febc2c38700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc13f410 con 0x7febbc1440d0 2023-11-30T23:28:54.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.048+0000 7febc2c38700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc140340 con 0x7febbc070760 2023-11-30T23:28:54.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.048+0000 7febc2c38700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febbc13e9f0 con 0x7febbc06f420 2023-11-30T23:28:54.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.048+0000 7febc2437700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc1440d0 0x7febbc137c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:54.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.048+0000 7febc2437700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc1440d0 0x7febbc137c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39296/0 (socket says 172.21.15.73:39296) 2023-11-30T23:28:54.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.048+0000 7febc2437700 1 -- 172.21.15.73:0/2472224016 learned_addr learned my addr 172.21.15.73:0/2472224016 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:28:54.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.048+0000 7febc1c36700 1 --2- 172.21.15.73:0/2472224016 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febbc06f420 0x7febbc0b7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:54.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.048+0000 7febc1435700 1 --2- 172.21.15.73:0/2472224016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febbc070760 0x7febbc13dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:54.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.048+0000 7febc2437700 1 -- 172.21.15.73:0/2472224016 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febbc06f420 msgr2=0x7febbc0b7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:54.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.048+0000 7febc2437700 1 --2- 172.21.15.73:0/2472224016 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febbc06f420 0x7febbc0b7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.048+0000 7febc2437700 1 -- 172.21.15.73:0/2472224016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febbc070760 msgr2=0x7febbc13dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:54.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.048+0000 7febc2437700 1 --2- 172.21.15.73:0/2472224016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febbc070760 0x7febbc13dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.048+0000 7febc2437700 1 -- 172.21.15.73:0/2472224016 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb8009a70 con 0x7febbc1440d0 2023-11-30T23:28:54.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.052+0000 7febc2437700 1 --2- 172.21.15.73:0/2472224016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc1440d0 0x7febbc137c10 secure :-1 s=READY pgs=4275 cs=0 l=1 rev1=1 crypto rx=0x7febb400b450 tx=0x7febb400b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:54.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.052+0000 7febb27fc700 1 -- 172.21.15.73:0/2472224016 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb4011830 con 0x7febbc1440d0 2023-11-30T23:28:54.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.052+0000 7febb27fc700 1 -- 172.21.15.73:0/2472224016 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7febb4011990 con 0x7febbc1440d0 2023-11-30T23:28:54.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.052+0000 7febb27fc700 1 -- 172.21.15.73:0/2472224016 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb4011d60 con 0x7febbc1440d0 2023-11-30T23:28:54.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.052+0000 7febc2c38700 1 -- 172.21.15.73:0/2472224016 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febbc13ecd0 con 0x7febbc1440d0 2023-11-30T23:28:54.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.052+0000 7febc2c38700 1 -- 172.21.15.73:0/2472224016 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febbc13be40 con 0x7febbc1440d0 2023-11-30T23:28:54.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.052+0000 7febc2c38700 1 -- 172.21.15.73:0/2472224016 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febbc06ce30 con 0x7febbc1440d0 2023-11-30T23:28:54.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.052+0000 7febb27fc700 1 -- 172.21.15.73:0/2472224016 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7febb401a400 con 0x7febbc1440d0 2023-11-30T23:28:54.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.052+0000 7febb27fc700 1 --2- 172.21.15.73:0/2472224016 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7feba0065ad0 0x7feba0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:54.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.052+0000 7febb27fc700 1 -- 172.21.15.73:0/2472224016 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7febb4083200 con 0x7febbc1440d0 2023-11-30T23:28:54.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.052+0000 7febc1c36700 1 --2- 172.21.15.73:0/2472224016 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7feba0065ad0 0x7feba0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:54.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.056+0000 7febc1c36700 1 --2- 172.21.15.73:0/2472224016 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7feba0065ad0 0x7feba0067f90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7febac000f60 tx=0x7febac007f30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:54.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.060+0000 7febb27fc700 1 -- 172.21.15.73:0/2472224016 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7febb4050a10 con 0x7febbc1440d0 2023-11-30T23:28:54.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.268+0000 7febc2c38700 1 -- 172.21.15.73:0/2472224016 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febbc13f550 con 0x7febbc1440d0 2023-11-30T23:28:54.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.268+0000 7febb27fc700 1 -- 172.21.15.73:0/2472224016 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3133 (secure 0 0 0) 0x7febb4015c50 con 0x7febbc1440d0 2023-11-30T23:28:54.273 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:28:54.273 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3213239947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3213239947},{"type":"v1","addr":"172.21.15.73:6835","nonce":3213239947}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-30T23:12:47.481180+0000","modified":"2023-11-30T23:12:50.126014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6833/1140380051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":1140380051},{"type":"v1","addr":"172.21.15.156:6833","nonce":1140380051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-30T23:28:54.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.272+0000 7febc2c38700 1 -- 172.21.15.73:0/2472224016 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7feba0065ad0 msgr2=0x7feba0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:54.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.272+0000 7febc2c38700 1 --2- 172.21.15.73:0/2472224016 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7feba0065ad0 0x7feba0067f90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7febac000f60 tx=0x7febac007f30 comp rx=0 tx=0).stop 2023-11-30T23:28:54.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.272+0000 7febc2c38700 1 -- 172.21.15.73:0/2472224016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc1440d0 msgr2=0x7febbc137c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:54.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.272+0000 7febc2c38700 1 --2- 172.21.15.73:0/2472224016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc1440d0 0x7febbc137c10 secure :-1 s=READY pgs=4275 cs=0 l=1 rev1=1 crypto rx=0x7febb400b450 tx=0x7febb400b760 comp rx=0 tx=0).stop 2023-11-30T23:28:54.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.272+0000 7febc2c38700 1 -- 172.21.15.73:0/2472224016 shutdown_connections 2023-11-30T23:28:54.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.272+0000 7febc2c38700 1 --2- 172.21.15.73:0/2472224016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febbc1440d0 0x7febbc137c10 unknown :-1 s=CLOSED pgs=4275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.272+0000 7febc2c38700 1 --2- 172.21.15.73:0/2472224016 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7feba0065ad0 0x7feba0067f90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.272+0000 7febc2c38700 1 --2- 172.21.15.73:0/2472224016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febbc070760 0x7febbc13dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.272+0000 7febc2c38700 1 --2- 172.21.15.73:0/2472224016 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7febbc06f420 0x7febbc0b7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.272+0000 7febc2c38700 1 -- 172.21.15.73:0/2472224016 >> 172.21.15.73:0/2472224016 conn(0x7febbc06b290 msgr2=0x7febbc0b3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:54.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.272+0000 7febc2c38700 1 -- 172.21.15.73:0/2472224016 shutdown_connections 2023-11-30T23:28:54.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.272+0000 7febc2c38700 1 -- 172.21.15.73:0/2472224016 wait complete. 2023-11-30T23:28:54.280 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 7 2023-11-30T23:28:54.293 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-30T23:28:54.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f753a04d700 1 Processor -- start 2023-11-30T23:28:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f753a04d700 1 -- start start 2023-11-30T23:28:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f753a04d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f75340b3840 0x7f75340b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f753a04d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75341444d0 0x7f7534144920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f753a04d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7534071460 con 0x7f753413e270 2023-11-30T23:28:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f753a04d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75340b0d90 con 0x7f75340b3840 2023-11-30T23:28:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f753a04d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75340b3c20 con 0x7f75341444d0 2023-11-30T23:28:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f753904b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f75340b3840 0x7f75340b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f753884a700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f753413e270 0x7f753413e6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34304/0 (socket says 172.21.15.73:34304) 2023-11-30T23:28:54.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f753884a700 1 -- 172.21.15.73:0/4179118765 learned_addr learned my addr 172.21.15.73:0/4179118765 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:28:54.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f753984c700 1 --2- 172.21.15.73:0/4179118765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75341444d0 0x7f7534144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:54.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f753904b700 1 -- 172.21.15.73:0/4179118765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75341444d0 msgr2=0x7f7534144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:28:54.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f753904b700 1 --2- 172.21.15.73:0/4179118765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75341444d0 0x7f7534144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f753904b700 1 -- 172.21.15.73:0/4179118765 >> v1:172.21.15.73:6789/0 conn(0x7f753413e270 legacy=0x7f753413e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:54.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f753904b700 1 -- 172.21.15.73:0/4179118765 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753406d030 con 0x7f75340b3840 2023-11-30T23:28:54.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f753984c700 1 --2- 172.21.15.73:0/4179118765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75341444d0 0x7f7534144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:28:54.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f753904b700 1 --2- 172.21.15.73:0/4179118765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75340b3840 0x7f75340b4e10 secure :-1 s=READY pgs=4277 cs=0 l=1 rev1=1 crypto rx=0x7f7530009850 tx=0x7f7530009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69c419c9ec0c4d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:54.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f7527fff700 1 -- 172.21.15.73:0/4179118765 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530011830 con 0x7f75340b3840 2023-11-30T23:28:54.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f7527fff700 1 -- 172.21.15.73:0/4179118765 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7530011990 con 0x7f75340b3840 2023-11-30T23:28:54.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.400+0000 7f7527fff700 1 -- 172.21.15.73:0/4179118765 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530011d40 con 0x7f75340b3840 2023-11-30T23:28:54.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753a04d700 1 -- 172.21.15.73:0/4179118765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75340b3840 msgr2=0x7f75340b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:54.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753a04d700 1 --2- 172.21.15.73:0/4179118765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75340b3840 0x7f75340b4e10 secure :-1 s=READY pgs=4277 cs=0 l=1 rev1=1 crypto rx=0x7f7530009850 tx=0x7f7530009b60 comp rx=0 tx=0).stop 2023-11-30T23:28:54.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753a04d700 1 -- 172.21.15.73:0/4179118765 shutdown_connections 2023-11-30T23:28:54.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753a04d700 1 --2- 172.21.15.73:0/4179118765 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75341444d0 0x7f7534144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753a04d700 1 --2- 172.21.15.73:0/4179118765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75340b3840 0x7f75340b4e10 unknown :-1 s=CLOSED pgs=4277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753a04d700 1 -- 172.21.15.73:0/4179118765 >> 172.21.15.73:0/4179118765 conn(0x7f753406b290 msgr2=0x7f753406b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:54.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753a04d700 1 -- 172.21.15.73:0/4179118765 shutdown_connections 2023-11-30T23:28:54.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753a04d700 1 -- 172.21.15.73:0/4179118765 wait complete. 2023-11-30T23:28:54.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753a04d700 1 Processor -- start 2023-11-30T23:28:54.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753a04d700 1 -- start start 2023-11-30T23:28:54.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753a04d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75340b3840 0x7f7534141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:54.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753a04d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f753413e270 0x7f75340af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:54.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753a04d700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75341444d0 0x7f753413fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:54.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753a04d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75341da790 con 0x7f753413e270 2023-11-30T23:28:54.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753a04d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75341d3f30 con 0x7f75340b3840 2023-11-30T23:28:54.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753a04d700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7534141ea0 con 0x7f75341444d0 2023-11-30T23:28:54.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753884a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f753413e270 0x7f75340af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753884a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f753413e270 0x7f75340af240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39310/0 (socket says 172.21.15.73:39310) 2023-11-30T23:28:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753884a700 1 -- 172.21.15.73:0/3698247370 learned_addr learned my addr 172.21.15.73:0/3698247370 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:28:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753904b700 1 --2- 172.21.15.73:0/3698247370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75340b3840 0x7f7534141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753984c700 1 --2- 172.21.15.73:0/3698247370 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75341444d0 0x7f753413fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753884a700 1 -- 172.21.15.73:0/3698247370 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75341444d0 msgr2=0x7f753413fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753884a700 1 --2- 172.21.15.73:0/3698247370 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75341444d0 0x7f753413fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753884a700 1 -- 172.21.15.73:0/3698247370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75340b3840 msgr2=0x7f7534141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753884a700 1 --2- 172.21.15.73:0/3698247370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75340b3840 0x7f7534141170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753884a700 1 -- 172.21.15.73:0/3698247370 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75300094b0 con 0x7f753413e270 2023-11-30T23:28:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.404+0000 7f753984c700 1 --2- 172.21.15.73:0/3698247370 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75341444d0 0x7f753413fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-30T23:28:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.408+0000 7f753884a700 1 --2- 172.21.15.73:0/3698247370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f753413e270 0x7f75340af240 secure :-1 s=READY pgs=4278 cs=0 l=1 rev1=1 crypto rx=0x7f752800cba0 tx=0x7f752800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.408+0000 7f7525ffb700 1 -- 172.21.15.73:0/3698247370 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752800a980 con 0x7f753413e270 2023-11-30T23:28:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.408+0000 7f7525ffb700 1 -- 172.21.15.73:0/3698247370 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f752800aae0 con 0x7f753413e270 2023-11-30T23:28:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.408+0000 7f753a04d700 1 -- 172.21.15.73:0/3698247370 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75341da1d0 con 0x7f753413e270 2023-11-30T23:28:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.408+0000 7f7525ffb700 1 -- 172.21.15.73:0/3698247370 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752800ae70 con 0x7f753413e270 2023-11-30T23:28:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.408+0000 7f753a04d700 1 -- 172.21.15.73:0/3698247370 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7534140980 con 0x7f753413e270 2023-11-30T23:28:54.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.408+0000 7f753a04d700 1 -- 172.21.15.73:0/3698247370 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753404ed80 con 0x7f753413e270 2023-11-30T23:28:54.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.408+0000 7f7525ffb700 1 -- 172.21.15.73:0/3698247370 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f752801b3b0 con 0x7f753413e270 2023-11-30T23:28:54.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.408+0000 7f7525ffb700 1 --2- 172.21.15.73:0/3698247370 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7518065ad0 0x7f7518067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:54.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.412+0000 7f7525ffb700 1 -- 172.21.15.73:0/3698247370 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f7528082c60 con 0x7f753413e270 2023-11-30T23:28:54.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.412+0000 7f753904b700 1 --2- 172.21.15.73:0/3698247370 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7518065ad0 0x7f7518067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:54.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.412+0000 7f753904b700 1 --2- 172.21.15.73:0/3698247370 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7518065ad0 0x7f7518067f90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7530000c00 tx=0x7f7530008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:54.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.416+0000 7f7525ffb700 1 -- 172.21.15.73:0/3698247370 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f7528050590 con 0x7f753413e270 2023-11-30T23:28:54.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.576+0000 7f753a04d700 1 -- 172.21.15.73:0/3698247370 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f753413a910 con 0x7f753413e270 2023-11-30T23:28:54.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.580+0000 7f7525ffb700 1 -- 172.21.15.73:0/3698247370 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16353 (secure 0 0 0) 0x7f7528053bb0 con 0x7f753413e270 2023-11-30T23:28:54.582 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-11-30T23:28:54.582 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":49,"fsid":"a677cb6a-4a54-4567-a30d-f0fa4bc22b17","created":"2023-11-30T23:12:23.260968+0000","modified":"2023-11-30T23:27:48.394742+0000","last_up_change":"2023-11-30T23:12:33.649318+0000","last_in_change":"2023-11-30T23:12:25.326689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-30T23:12:34.413317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-30T23:12:45.403156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-30T23:12:46.475384+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":65,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbf1c93f-0775-4780-8524-cf25792d9aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36686},{"type":"v1","addr":"172.21.15.73:6817","nonce":36686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36686},{"type":"v1","addr":"172.21.15.73:6819","nonce":36686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36686},{"type":"v1","addr":"172.21.15.73:6823","nonce":36686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36686},{"type":"v1","addr":"172.21.15.73:6821","nonce":36686}]},"public_addr":"172.21.15.73:6817/36686","cluster_addr":"172.21.15.73:6819/36686","heartbeat_back_addr":"172.21.15.73:6823/36686","heartbeat_front_addr":"172.21.15.73:6821/36686","state":["exists","up"]},{"osd":1,"uuid":"9d9dd122-9a42-4588-a0d2-50d13b13eba8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36687},{"type":"v1","addr":"172.21.15.73:6809","nonce":36687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":36687},{"type":"v1","addr":"172.21.15.73:6811","nonce":36687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36687},{"type":"v1","addr":"172.21.15.73:6815","nonce":36687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36687},{"type":"v1","addr":"172.21.15.73:6813","nonce":36687}]},"public_addr":"172.21.15.73:6809/36687","cluster_addr":"172.21.15.73:6811/36687","heartbeat_back_addr":"172.21.15.73:6815/36687","heartbeat_front_addr":"172.21.15.73:6813/36687","state":["exists","up"]},{"osd":2,"uuid":"68ff4f1e-ec45-42e0-bb83-fe03598e4940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36688},{"type":"v1","addr":"172.21.15.73:6825","nonce":36688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36688},{"type":"v1","addr":"172.21.15.73:6827","nonce":36688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36688},{"type":"v1","addr":"172.21.15.73:6831","nonce":36688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36688},{"type":"v1","addr":"172.21.15.73:6829","nonce":36688}]},"public_addr":"172.21.15.73:6825/36688","cluster_addr":"172.21.15.73:6827/36688","heartbeat_back_addr":"172.21.15.73:6831/36688","heartbeat_front_addr":"172.21.15.73:6829/36688","state":["exists","up"]},{"osd":3,"uuid":"e4b08c98-6a4d-4ec8-a245-59a35f70a16f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36685},{"type":"v1","addr":"172.21.15.73:6801","nonce":36685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36685},{"type":"v1","addr":"172.21.15.73:6803","nonce":36685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":36685},{"type":"v1","addr":"172.21.15.73:6807","nonce":36685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36685},{"type":"v1","addr":"172.21.15.73:6805","nonce":36685}]},"public_addr":"172.21.15.73:6801/36685","cluster_addr":"172.21.15.73:6803/36685","heartbeat_back_addr":"172.21.15.73:6807/36685","heartbeat_front_addr":"172.21.15.73:6805/36685","state":["exists","up"]},{"osd":4,"uuid":"d0922b0e-5170-474d-b270-ddb5adc858cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":36908},{"type":"v1","addr":"172.21.15.156:6801","nonce":36908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":36908},{"type":"v1","addr":"172.21.15.156:6803","nonce":36908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":36908},{"type":"v1","addr":"172.21.15.156:6807","nonce":36908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":36908},{"type":"v1","addr":"172.21.15.156:6805","nonce":36908}]},"public_addr":"172.21.15.156:6801/36908","cluster_addr":"172.21.15.156:6803/36908","heartbeat_back_addr":"172.21.15.156:6807/36908","heartbeat_front_addr":"172.21.15.156:6805/36908","state":["exists","up"]},{"osd":5,"uuid":"f2791a77-db25-479c-95d5-ea7f77458685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":36909},{"type":"v1","addr":"172.21.15.156:6809","nonce":36909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":36909},{"type":"v1","addr":"172.21.15.156:6811","nonce":36909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":36909},{"type":"v1","addr":"172.21.15.156:6815","nonce":36909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":36909},{"type":"v1","addr":"172.21.15.156:6813","nonce":36909}]},"public_addr":"172.21.15.156:6809/36909","cluster_addr":"172.21.15.156:6811/36909","heartbeat_back_addr":"172.21.15.156:6815/36909","heartbeat_front_addr":"172.21.15.156:6813/36909","state":["exists","up"]},{"osd":6,"uuid":"f86c2fe9-ec8b-406e-af26-5dc65c926382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":36910},{"type":"v1","addr":"172.21.15.156:6817","nonce":36910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":36910},{"type":"v1","addr":"172.21.15.156:6819","nonce":36910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":36910},{"type":"v1","addr":"172.21.15.156:6823","nonce":36910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":36910},{"type":"v1","addr":"172.21.15.156:6821","nonce":36910}]},"public_addr":"172.21.15.156:6817/36910","cluster_addr":"172.21.15.156:6819/36910","heartbeat_back_addr":"172.21.15.156:6823/36910","heartbeat_front_addr":"172.21.15.156:6821/36910","state":["exists","up"]},{"osd":7,"uuid":"56ac6c08-7b40-4a4f-9a5a-7140ac27cbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":36911},{"type":"v1","addr":"172.21.15.156:6825","nonce":36911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":36911},{"type":"v1","addr":"172.21.15.156:6827","nonce":36911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":36911},{"type":"v1","addr":"172.21.15.156:6831","nonce":36911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":36911},{"type":"v1","addr":"172.21.15.156:6829","nonce":36911}]},"public_addr":"172.21.15.156:6825/36911","cluster_addr":"172.21.15.156:6827/36911","heartbeat_back_addr":"172.21.15.156:6831/36911","heartbeat_front_addr":"172.21.15.156:6829/36911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.597534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.505493+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.811871+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.586741+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.366817+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.101605+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.627496+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-30T23:12:30.829046+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":60,"length":6}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-30T23:28:54.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.580+0000 7f753a04d700 1 -- 172.21.15.73:0/3698247370 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7518065ad0 msgr2=0x7f7518067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:54.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.580+0000 7f753a04d700 1 --2- 172.21.15.73:0/3698247370 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7518065ad0 0x7f7518067f90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7530000c00 tx=0x7f7530008030 comp rx=0 tx=0).stop 2023-11-30T23:28:54.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.580+0000 7f753a04d700 1 -- 172.21.15.73:0/3698247370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f753413e270 msgr2=0x7f75340af240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:54.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.580+0000 7f753a04d700 1 --2- 172.21.15.73:0/3698247370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f753413e270 0x7f75340af240 secure :-1 s=READY pgs=4278 cs=0 l=1 rev1=1 crypto rx=0x7f752800cba0 tx=0x7f752800cc80 comp rx=0 tx=0).stop 2023-11-30T23:28:54.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.580+0000 7f753a04d700 1 -- 172.21.15.73:0/3698247370 shutdown_connections 2023-11-30T23:28:54.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.580+0000 7f753a04d700 1 --2- 172.21.15.73:0/3698247370 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f75341444d0 0x7f753413fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.580+0000 7f753a04d700 1 --2- 172.21.15.73:0/3698247370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f753413e270 0x7f75340af240 unknown :-1 s=CLOSED pgs=4278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.580+0000 7f753a04d700 1 --2- 172.21.15.73:0/3698247370 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f7518065ad0 0x7f7518067f90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.580+0000 7f753a04d700 1 --2- 172.21.15.73:0/3698247370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75340b3840 0x7f7534141170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.580+0000 7f753a04d700 1 -- 172.21.15.73:0/3698247370 >> 172.21.15.73:0/3698247370 conn(0x7f753406b290 msgr2=0x7f753406b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:54.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.580+0000 7f753a04d700 1 -- 172.21.15.73:0/3698247370 shutdown_connections 2023-11-30T23:28:54.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.580+0000 7f753a04d700 1 -- 172.21.15.73:0/3698247370 wait complete. 2023-11-30T23:28:54.597 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-30T23:28:54.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.704+0000 7f8857fff700 1 Processor -- start 2023-11-30T23:28:54.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.704+0000 7f8857fff700 1 -- start start 2023-11-30T23:28:54.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8857fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f88580b1420 0x7f8858147970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:54.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8857fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f885813e920 0x7f885814eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:54.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8857fff700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885806ee70 con 0x7f8858147eb0 2023-11-30T23:28:54.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8857fff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88580b40c0 con 0x7f88580b1420 2023-11-30T23:28:54.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8857fff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8858070050 con 0x7f885813e920 2023-11-30T23:28:54.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8856ffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f88580b1420 0x7f8858147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:54.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8856ffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f88580b1420 0x7f8858147970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39314/0 (socket says 172.21.15.73:39314) 2023-11-30T23:28:54.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8856ffd700 1 -- 172.21.15.73:0/1156232563 learned_addr learned my addr 172.21.15.73:0/1156232563 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:28:54.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f88577fe700 1 --2- 172.21.15.73:0/1156232563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f885813e920 0x7f885814eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:54.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8856ffd700 1 -- 172.21.15.73:0/1156232563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f885813e920 msgr2=0x7f885814eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:28:54.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8856ffd700 1 --2- 172.21.15.73:0/1156232563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f885813e920 0x7f885814eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8856ffd700 1 -- 172.21.15.73:0/1156232563 >> v1:172.21.15.156:6789/0 conn(0x7f8858147eb0 legacy=0x7f885813e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:54.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8856ffd700 1 -- 172.21.15.73:0/1156232563 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885806f300 con 0x7f88580b1420 2023-11-30T23:28:54.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8856ffd700 1 --2- 172.21.15.73:0/1156232563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88580b1420 0x7f8858147970 secure :-1 s=READY pgs=4279 cs=0 l=1 rev1=1 crypto rx=0x7f884c009910 tx=0x7f884c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c481f6c94ee3b2c server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:54.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8855ffb700 1 -- 172.21.15.73:0/1156232563 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c011830 con 0x7f88580b1420 2023-11-30T23:28:54.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8855ffb700 1 -- 172.21.15.73:0/1156232563 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f884c011990 con 0x7f88580b1420 2023-11-30T23:28:54.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8855ffb700 1 -- 172.21.15.73:0/1156232563 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c011d60 con 0x7f88580b1420 2023-11-30T23:28:54.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8857fff700 1 -- 172.21.15.73:0/1156232563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88580b1420 msgr2=0x7f8858147970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:54.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8857fff700 1 --2- 172.21.15.73:0/1156232563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88580b1420 0x7f8858147970 secure :-1 s=READY pgs=4279 cs=0 l=1 rev1=1 crypto rx=0x7f884c009910 tx=0x7f884c009c20 comp rx=0 tx=0).stop 2023-11-30T23:28:54.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8857fff700 1 -- 172.21.15.73:0/1156232563 shutdown_connections 2023-11-30T23:28:54.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8857fff700 1 --2- 172.21.15.73:0/1156232563 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f885813e920 0x7f885814eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8857fff700 1 --2- 172.21.15.73:0/1156232563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88580b1420 0x7f8858147970 unknown :-1 s=CLOSED pgs=4279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.708+0000 7f8857fff700 1 -- 172.21.15.73:0/1156232563 >> 172.21.15.73:0/1156232563 conn(0x7f88580b45a0 msgr2=0x7f88580b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:54.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.712+0000 7f8857fff700 1 -- 172.21.15.73:0/1156232563 shutdown_connections 2023-11-30T23:28:54.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.712+0000 7f8857fff700 1 -- 172.21.15.73:0/1156232563 wait complete. 2023-11-30T23:28:54.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.712+0000 7f8857fff700 1 Processor -- start 2023-11-30T23:28:54.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.712+0000 7f8857fff700 1 -- start start 2023-11-30T23:28:54.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.712+0000 7f8857fff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88580b1420 0x7f88580b6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:54.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.712+0000 7f8857fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f885813e920 0x7f88580b8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:54.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.712+0000 7f8857fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8858147eb0 0x7f88581d9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:54.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.712+0000 7f8857fff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88580b8950 con 0x7f8858147eb0 2023-11-30T23:28:54.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.712+0000 7f8857fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88581d9e70 con 0x7f885813e920 2023-11-30T23:28:54.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.712+0000 7f8857fff700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88580b7a30 con 0x7f88580b1420 2023-11-30T23:28:54.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.712+0000 7f88577fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8858147eb0 0x7f88581d9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:54.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.712+0000 7f88577fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8858147eb0 0x7f88581d9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39322/0 (socket says 172.21.15.73:39322) 2023-11-30T23:28:54.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.712+0000 7f88577fe700 1 -- 172.21.15.73:0/1641476632 learned_addr learned my addr 172.21.15.73:0/1641476632 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:28:54.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.712+0000 7f8856ffd700 1 --2- 172.21.15.73:0/1641476632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88580b1420 0x7f88580b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:54.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.712+0000 7f88567fc700 1 --2- 172.21.15.73:0/1641476632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f885813e920 0x7f88580b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:54.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.716+0000 7f88577fe700 1 -- 172.21.15.73:0/1641476632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88580b1420 msgr2=0x7f88580b6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:54.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.716+0000 7f88577fe700 1 --2- 172.21.15.73:0/1641476632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88580b1420 0x7f88580b6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.716+0000 7f88577fe700 1 -- 172.21.15.73:0/1641476632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f885813e920 msgr2=0x7f88580b8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:54.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.716+0000 7f88577fe700 1 --2- 172.21.15.73:0/1641476632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f885813e920 0x7f88580b8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.716+0000 7f88577fe700 1 -- 172.21.15.73:0/1641476632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c009570 con 0x7f8858147eb0 2023-11-30T23:28:54.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.716+0000 7f88567fc700 1 --2- 172.21.15.73:0/1641476632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f885813e920 0x7f88580b8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:28:54.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.716+0000 7f88577fe700 1 --2- 172.21.15.73:0/1641476632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8858147eb0 0x7f88581d9930 secure :-1 s=READY pgs=4280 cs=0 l=1 rev1=1 crypto rx=0x7f8850009dd0 tx=0x7f885000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:54.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.716+0000 7f883f7fe700 1 -- 172.21.15.73:0/1641476632 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850009c40 con 0x7f8858147eb0 2023-11-30T23:28:54.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.716+0000 7f883f7fe700 1 -- 172.21.15.73:0/1641476632 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f885000f040 con 0x7f8858147eb0 2023-11-30T23:28:54.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.716+0000 7f8857fff700 1 -- 172.21.15.73:0/1641476632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8858143d60 con 0x7f8858147eb0 2023-11-30T23:28:54.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.716+0000 7f883f7fe700 1 -- 172.21.15.73:0/1641476632 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850014480 con 0x7f8858147eb0 2023-11-30T23:28:54.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.716+0000 7f8857fff700 1 -- 172.21.15.73:0/1641476632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88580b58c0 con 0x7f8858147eb0 2023-11-30T23:28:54.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.716+0000 7f8857fff700 1 -- 172.21.15.73:0/1641476632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885806f580 con 0x7f8858147eb0 2023-11-30T23:28:54.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.716+0000 7f883f7fe700 1 -- 172.21.15.73:0/1641476632 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f88500145e0 con 0x7f8858147eb0 2023-11-30T23:28:54.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.716+0000 7f883f7fe700 1 --2- 172.21.15.73:0/1641476632 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8844065ad0 0x7f8844067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:54.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.716+0000 7f8856ffd700 1 --2- 172.21.15.73:0/1641476632 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8844065ad0 0x7f8844067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:54.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.716+0000 7f883f7fe700 1 -- 172.21.15.73:0/1641476632 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8850083a20 con 0x7f8858147eb0 2023-11-30T23:28:54.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.720+0000 7f8856ffd700 1 --2- 172.21.15.73:0/1641476632 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8844065ad0 0x7f8844067f90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f884c000c00 tx=0x7f884c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:54.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.728+0000 7f883f7fe700 1 -- 172.21.15.73:0/1641476632 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f8850051360 con 0x7f8858147eb0 2023-11-30T23:28:54.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.928+0000 7f8857fff700 1 -- 172.21.15.73:0/1641476632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f88580b6590 con 0x7f8858147eb0 2023-11-30T23:28:54.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.948+0000 7f883f7fe700 1 -- 172.21.15.73:0/1641476632 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f88580b6590 con 0x7f8858147eb0 2023-11-30T23:28:54.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.952+0000 7f8857fff700 1 -- 172.21.15.73:0/1641476632 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8844065ad0 msgr2=0x7f8844067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:54.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.952+0000 7f8857fff700 1 --2- 172.21.15.73:0/1641476632 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8844065ad0 0x7f8844067f90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f884c000c00 tx=0x7f884c008030 comp rx=0 tx=0).stop 2023-11-30T23:28:54.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.952+0000 7f8857fff700 1 -- 172.21.15.73:0/1641476632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8858147eb0 msgr2=0x7f88581d9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:54.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.952+0000 7f8857fff700 1 --2- 172.21.15.73:0/1641476632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8858147eb0 0x7f88581d9930 secure :-1 s=READY pgs=4280 cs=0 l=1 rev1=1 crypto rx=0x7f8850009dd0 tx=0x7f885000c3a0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.952+0000 7f8857fff700 1 -- 172.21.15.73:0/1641476632 shutdown_connections 2023-11-30T23:28:54.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.952+0000 7f8857fff700 1 --2- 172.21.15.73:0/1641476632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8858147eb0 0x7f88581d9930 unknown :-1 s=CLOSED pgs=4280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.952+0000 7f8857fff700 1 --2- 172.21.15.73:0/1641476632 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f8844065ad0 0x7f8844067f90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.952+0000 7f8857fff700 1 --2- 172.21.15.73:0/1641476632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f885813e920 0x7f88580b8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.952+0000 7f8857fff700 1 --2- 172.21.15.73:0/1641476632 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f88580b1420 0x7f88580b6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:54.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.952+0000 7f8857fff700 1 -- 172.21.15.73:0/1641476632 >> 172.21.15.73:0/1641476632 conn(0x7f88580b45a0 msgr2=0x7f88580b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:54.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.952+0000 7f8857fff700 1 -- 172.21.15.73:0/1641476632 shutdown_connections 2023-11-30T23:28:54.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:54.952+0000 7f8857fff700 1 -- 172.21.15.73:0/1641476632 wait complete. 2023-11-30T23:28:54.959 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-30T23:28:54.968 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-30T23:28:55.007 INFO:tasks.ceph.mds.b.smithi156.stdout:starting mds.b at 2023-11-30T23:28:55.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.080+0000 7f6ef4e29700 1 Processor -- start 2023-11-30T23:28:55.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6ef4e29700 1 -- start start 2023-11-30T23:28:55.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6ef4e29700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6ef0140a50 0x7f6ef0149d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:55.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6ef4e29700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ef014a2c0 0x7f6ef0150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:55.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6ef4e29700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef00b4e70 con 0x7f6ef00bc8b0 2023-11-30T23:28:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6ef4e29700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef00b5da0 con 0x7f6ef0140a50 2023-11-30T23:28:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6ef4e29700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef014a730 con 0x7f6ef014a2c0 2023-11-30T23:28:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6eeffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ef014a2c0 0x7f6ef0150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6eeeffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6ef0140a50 0x7f6ef0149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6eef7fe700 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6ef00bc8b0 0x7f6ef0140340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.73:46986/0 (socket says 172.21.15.73:46986) 2023-11-30T23:28:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6eeffff700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ef014a2c0 0x7f6ef0150ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3301/0 says I am v2:172.21.15.73:49578/0 (socket says 172.21.15.73:49578) 2023-11-30T23:28:55.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6eeeffd700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6ef0140a50 0x7f6ef0149d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.73:38056/0 (socket says 172.21.15.73:38056) 2023-11-30T23:28:55.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6eef7fe700 1 -- 172.21.15.73:0/535402038 learned_addr learned my addr 172.21.15.73:0/535402038 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:28:55.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6eeffff700 1 -- 172.21.15.73:0/535402038 >> v2:172.21.15.156:3300/0 conn(0x7f6ef0140a50 msgr2=0x7f6ef0149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:28:55.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6eeffff700 1 --2- 172.21.15.73:0/535402038 >> v2:172.21.15.156:3300/0 conn(0x7f6ef0140a50 0x7f6ef0149d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:55.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6eeffff700 1 -- 172.21.15.73:0/535402038 >> v1:172.21.15.156:6789/0 conn(0x7f6ef00bc8b0 legacy=0x7f6ef0140340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:55.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6eeffff700 1 -- 172.21.15.73:0/535402038 --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef00bcc90 con 0x7f6ef014a2c0 2023-11-30T23:28:55.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6eeffff700 1 --2- 172.21.15.73:0/535402038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ef014a2c0 0x7f6ef0150ed0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009d90 tx=0x7f6ee800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44c780ac7884c483 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:55.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6eee7fc700 1 -- 172.21.15.73:0/535402038 <== mon.2 v2:172.21.15.156:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee800e070 con 0x7f6ef014a2c0 2023-11-30T23:28:55.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6eee7fc700 1 -- 172.21.15.73:0/535402038 <== mon.2 v2:172.21.15.156:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6ee800bb20 con 0x7f6ef014a2c0 2023-11-30T23:28:55.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6eee7fc700 1 -- 172.21.15.73:0/535402038 <== mon.2 v2:172.21.15.156:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8012430 con 0x7f6ef014a2c0 2023-11-30T23:28:55.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6ef4e29700 1 -- 172.21.15.73:0/535402038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ef014a2c0 msgr2=0x7f6ef0150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:55.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.084+0000 7f6ef4e29700 1 --2- 172.21.15.73:0/535402038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ef014a2c0 0x7f6ef0150ed0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009d90 tx=0x7f6ee800b330 comp rx=0 tx=0).stop 2023-11-30T23:28:55.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6ef4e29700 1 -- 172.21.15.73:0/535402038 shutdown_connections 2023-11-30T23:28:55.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6ef4e29700 1 --2- 172.21.15.73:0/535402038 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ef014a2c0 0x7f6ef0150ed0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:55.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6ef4e29700 1 --2- 172.21.15.73:0/535402038 >> v2:172.21.15.156:3300/0 conn(0x7f6ef0140a50 0x7f6ef0149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:55.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6ef4e29700 1 -- 172.21.15.73:0/535402038 >> 172.21.15.73:0/535402038 conn(0x7f6ef0071ee0 msgr2=0x7f6ef00bbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:55.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6ef4e29700 1 -- 172.21.15.73:0/535402038 shutdown_connections 2023-11-30T23:28:55.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6ef4e29700 1 -- 172.21.15.73:0/535402038 wait complete. 2023-11-30T23:28:55.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6ef4e29700 1 Processor -- start 2023-11-30T23:28:55.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6ef4e29700 1 -- start start 2023-11-30T23:28:55.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6ef4e29700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ef00bc8b0 0x7f6ef013cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:55.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6ef4e29700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ef014a2c0 0x7f6ef01d1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:55.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6ef4e29700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ef01dbda0 0x7f6ef01dc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:55.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6ef4e29700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef013d120 con 0x7f6ef01dbda0 2023-11-30T23:28:55.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6ef4e29700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef01d17a0 con 0x7f6ef00bc8b0 2023-11-30T23:28:55.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6ef4e29700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef0136dc0 con 0x7f6ef014a2c0 2023-11-30T23:28:55.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6eeffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ef01dbda0 0x7f6ef01dc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:55.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6eeffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ef01dbda0 0x7f6ef01dc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39330/0 (socket says 172.21.15.73:39330) 2023-11-30T23:28:55.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6eeffff700 1 -- 172.21.15.73:0/1345225689 learned_addr learned my addr 172.21.15.73:0/1345225689 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:28:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6eef7fe700 1 --2- 172.21.15.73:0/1345225689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ef00bc8b0 0x7f6ef013cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6eeeffd700 1 --2- 172.21.15.73:0/1345225689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ef014a2c0 0x7f6ef01d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6eeffff700 1 -- 172.21.15.73:0/1345225689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ef014a2c0 msgr2=0x7f6ef01d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6eeffff700 1 --2- 172.21.15.73:0/1345225689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ef014a2c0 0x7f6ef01d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:55.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6eeffff700 1 -- 172.21.15.73:0/1345225689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ef00bc8b0 msgr2=0x7f6ef013cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:55.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6eeffff700 1 --2- 172.21.15.73:0/1345225689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ef00bc8b0 0x7f6ef013cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:55.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6eeffff700 1 -- 172.21.15.73:0/1345225689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee8009a70 con 0x7f6ef01dbda0 2023-11-30T23:28:55.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.088+0000 7f6eef7fe700 1 --2- 172.21.15.73:0/1345225689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ef00bc8b0 0x7f6ef013cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-30T23:28:55.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.092+0000 7f6eeffff700 1 --2- 172.21.15.73:0/1345225689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ef01dbda0 0x7f6ef01dc250 secure :-1 s=READY pgs=4282 cs=0 l=1 rev1=1 crypto rx=0x7f6ef014a870 tx=0x7f6ee8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:55.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.092+0000 7f6ed7fff700 1 -- 172.21.15.73:0/1345225689 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8012430 con 0x7f6ef01dbda0 2023-11-30T23:28:55.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.092+0000 7f6ed7fff700 1 -- 172.21.15.73:0/1345225689 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6ee8020070 con 0x7f6ef01dbda0 2023-11-30T23:28:55.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.092+0000 7f6ed7fff700 1 -- 172.21.15.73:0/1345225689 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80042a0 con 0x7f6ef01dbda0 2023-11-30T23:28:55.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.092+0000 7f6ef4e29700 1 -- 172.21.15.73:0/1345225689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef01dc790 con 0x7f6ef01dbda0 2023-11-30T23:28:55.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.092+0000 7f6ef4e29700 1 -- 172.21.15.73:0/1345225689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef01cf680 con 0x7f6ef01dbda0 2023-11-30T23:28:55.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.092+0000 7f6ef4e29700 1 -- 172.21.15.73:0/1345225689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef0136f00 con 0x7f6ef01dbda0 2023-11-30T23:28:55.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.092+0000 7f6ed7fff700 1 -- 172.21.15.73:0/1345225689 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6ee8004400 con 0x7f6ef01dbda0 2023-11-30T23:28:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.096+0000 7f6ed7fff700 1 --2- 172.21.15.73:0/1345225689 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6edc065ad0 0x7f6edc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.096+0000 7f6ed7fff700 1 -- 172.21.15.73:0/1345225689 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f6ee8022070 con 0x7f6ef01dbda0 2023-11-30T23:28:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.096+0000 7f6eef7fe700 1 --2- 172.21.15.73:0/1345225689 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6edc065ad0 0x7f6edc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.096+0000 7f6eef7fe700 1 --2- 172.21.15.73:0/1345225689 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6edc065ad0 0x7f6edc067f90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4000f60 tx=0x7f6ee4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:55.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.104+0000 7f6ed7fff700 1 -- 172.21.15.73:0/1345225689 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f6ee8089070 con 0x7f6ef01dbda0 2023-11-30T23:28:55.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.300+0000 7f6ef4e29700 1 -- 172.21.15.73:0/1345225689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6ef00681c0 con 0x7f6ef01dbda0 2023-11-30T23:28:55.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.956+0000 7f6ed7fff700 1 -- 172.21.15.73:0/1345225689 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6ee8052850 con 0x7f6ef01dbda0 2023-11-30T23:28:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.960+0000 7f6ef4e29700 1 -- 172.21.15.73:0/1345225689 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6edc065ad0 msgr2=0x7f6edc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.960+0000 7f6ef4e29700 1 --2- 172.21.15.73:0/1345225689 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6edc065ad0 0x7f6edc067f90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4000f60 tx=0x7f6ee4009040 comp rx=0 tx=0).stop 2023-11-30T23:28:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.960+0000 7f6ef4e29700 1 -- 172.21.15.73:0/1345225689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ef01dbda0 msgr2=0x7f6ef01dc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.960+0000 7f6ef4e29700 1 --2- 172.21.15.73:0/1345225689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ef01dbda0 0x7f6ef01dc250 secure :-1 s=READY pgs=4282 cs=0 l=1 rev1=1 crypto rx=0x7f6ef014a870 tx=0x7f6ee8004af0 comp rx=0 tx=0).stop 2023-11-30T23:28:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.960+0000 7f6ef4e29700 1 -- 172.21.15.73:0/1345225689 shutdown_connections 2023-11-30T23:28:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.960+0000 7f6ef4e29700 1 --2- 172.21.15.73:0/1345225689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ef01dbda0 0x7f6ef01dc250 unknown :-1 s=CLOSED pgs=4282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.960+0000 7f6ef4e29700 1 --2- 172.21.15.73:0/1345225689 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f6ef014a2c0 0x7f6ef01d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.960+0000 7f6ef4e29700 1 --2- 172.21.15.73:0/1345225689 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f6edc065ad0 0x7f6edc067f90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.960+0000 7f6ef4e29700 1 --2- 172.21.15.73:0/1345225689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ef00bc8b0 0x7f6ef013cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.960+0000 7f6ef4e29700 1 -- 172.21.15.73:0/1345225689 >> 172.21.15.73:0/1345225689 conn(0x7f6ef0071ee0 msgr2=0x7f6ef00b8860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.960+0000 7f6ef4e29700 1 -- 172.21.15.73:0/1345225689 shutdown_connections 2023-11-30T23:28:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:55.960+0000 7f6ef4e29700 1 -- 172.21.15.73:0/1345225689 wait complete. 2023-11-30T23:28:55.981 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-30T23:28:56.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.104+0000 7f3e2ab71700 1 Processor -- start 2023-11-30T23:28:56.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.104+0000 7f3e2ab71700 1 -- start start 2023-11-30T23:28:56.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e2ab71700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3e2413d9a0 0x7f3e240b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:56.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e2ab71700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e240ae7d0 con 0x7f3e24143480 2023-11-30T23:28:56.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e2ab71700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e240b2b60 con 0x7f3e240b2780 2023-11-30T23:28:56.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e2ab71700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e2406e900 con 0x7f3e2413d9a0 2023-11-30T23:28:56.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e2936e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3e2413d9a0 0x7f3e240b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:56.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e2a370700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3e24143480 0x7f3e240b0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34312/0 (socket says 172.21.15.73:34312) 2023-11-30T23:28:56.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e2a370700 1 -- 172.21.15.73:0/3275749309 learned_addr learned my addr 172.21.15.73:0/3275749309 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-11-30T23:28:56.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e2936e700 1 -- 172.21.15.73:0/3275749309 >> v1:172.21.15.156:6789/0 conn(0x7f3e240b2780 legacy=0x7f3e2413d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:56.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e2936e700 1 -- 172.21.15.73:0/3275749309 >> v1:172.21.15.73:6789/0 conn(0x7f3e24143480 legacy=0x7f3e240b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:56.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e2936e700 1 -- 172.21.15.73:0/3275749309 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e240aea70 con 0x7f3e2413d9a0 2023-11-30T23:28:56.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e2936e700 1 --2- 172.21.15.73:0/3275749309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e2413d9a0 0x7f3e240b0a20 secure :-1 s=READY pgs=4284 cs=0 l=1 rev1=1 crypto rx=0x7f3e18009850 tx=0x7f3e18009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf06776426fa13c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:56.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e28b6d700 1 -- 172.21.15.73:0/3275749309 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e18011830 con 0x7f3e2413d9a0 2023-11-30T23:28:56.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e28b6d700 1 -- 172.21.15.73:0/3275749309 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3e18011990 con 0x7f3e2413d9a0 2023-11-30T23:28:56.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e28b6d700 1 -- 172.21.15.73:0/3275749309 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e18011d40 con 0x7f3e2413d9a0 2023-11-30T23:28:56.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e2ab71700 1 -- 172.21.15.73:0/3275749309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e2413d9a0 msgr2=0x7f3e240b0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:56.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e2ab71700 1 --2- 172.21.15.73:0/3275749309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e2413d9a0 0x7f3e240b0a20 secure :-1 s=READY pgs=4284 cs=0 l=1 rev1=1 crypto rx=0x7f3e18009850 tx=0x7f3e18009b60 comp rx=0 tx=0).stop 2023-11-30T23:28:56.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e2ab71700 1 -- 172.21.15.73:0/3275749309 shutdown_connections 2023-11-30T23:28:56.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e2ab71700 1 --2- 172.21.15.73:0/3275749309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e2413d9a0 0x7f3e240b0a20 unknown :-1 s=CLOSED pgs=4284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:56.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e2ab71700 1 -- 172.21.15.73:0/3275749309 >> 172.21.15.73:0/3275749309 conn(0x7f3e240b7b70 msgr2=0x7f3e240b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:56.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e2ab71700 1 -- 172.21.15.73:0/3275749309 shutdown_connections 2023-11-30T23:28:56.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.108+0000 7f3e2ab71700 1 -- 172.21.15.73:0/3275749309 wait complete. 2023-11-30T23:28:56.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2ab71700 1 Processor -- start 2023-11-30T23:28:56.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2ab71700 1 -- start start 2023-11-30T23:28:56.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2ab71700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e240b2780 0x7f3e24137420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:56.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2ab71700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e2413d9a0 0x7f3e2413bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:56.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2ab71700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e24143480 0x7f3e2412ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:56.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2ab71700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2413b8c0 con 0x7f3e2413d9a0 2023-11-30T23:28:56.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2ab71700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240ad6c0 con 0x7f3e240b2780 2023-11-30T23:28:56.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2ab71700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240ae080 con 0x7f3e24143480 2023-11-30T23:28:56.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2936e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e2413d9a0 0x7f3e2413bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:56.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2936e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e2413d9a0 0x7f3e2413bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39340/0 (socket says 172.21.15.73:39340) 2023-11-30T23:28:56.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2936e700 1 -- 172.21.15.73:0/26327896 learned_addr learned my addr 172.21.15.73:0/26327896 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:28:56.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e29b6f700 1 --2- 172.21.15.73:0/26327896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e240b2780 0x7f3e24137420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:56.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2a370700 1 --2- 172.21.15.73:0/26327896 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e24143480 0x7f3e2412ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:56.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2936e700 1 -- 172.21.15.73:0/26327896 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e24143480 msgr2=0x7f3e2412ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:56.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2936e700 1 --2- 172.21.15.73:0/26327896 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e24143480 0x7f3e2412ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:56.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2936e700 1 -- 172.21.15.73:0/26327896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e240b2780 msgr2=0x7f3e24137420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:56.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2936e700 1 --2- 172.21.15.73:0/26327896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e240b2780 0x7f3e24137420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2936e700 1 -- 172.21.15.73:0/26327896 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e180094b0 con 0x7f3e2413d9a0 2023-11-30T23:28:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2936e700 1 --2- 172.21.15.73:0/26327896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e2413d9a0 0x7f3e2413bf30 secure :-1 s=READY pgs=4285 cs=0 l=1 rev1=1 crypto rx=0x7f3e18013000 tx=0x7f3e18004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e167fc700 1 -- 172.21.15.73:0/26327896 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e180036c0 con 0x7f3e2413d9a0 2023-11-30T23:28:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e167fc700 1 -- 172.21.15.73:0/26327896 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3e18003840 con 0x7f3e2413d9a0 2023-11-30T23:28:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e2ab71700 1 -- 172.21.15.73:0/26327896 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e240ae360 con 0x7f3e2413d9a0 2023-11-30T23:28:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.112+0000 7f3e167fc700 1 -- 172.21.15.73:0/26327896 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e18003c10 con 0x7f3e2413d9a0 2023-11-30T23:28:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.116+0000 7f3e2ab71700 1 -- 172.21.15.73:0/26327896 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e241410e0 con 0x7f3e2413d9a0 2023-11-30T23:28:56.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.116+0000 7f3e2ab71700 1 -- 172.21.15.73:0/26327896 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e240ae4f0 con 0x7f3e2413d9a0 2023-11-30T23:28:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.116+0000 7f3e167fc700 1 -- 172.21.15.73:0/26327896 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3e1801a430 con 0x7f3e2413d9a0 2023-11-30T23:28:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.116+0000 7f3e167fc700 1 --2- 172.21.15.73:0/26327896 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3e08065ad0 0x7f3e08067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.120+0000 7f3e167fc700 1 -- 172.21.15.73:0/26327896 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f3e18021030 con 0x7f3e2413d9a0 2023-11-30T23:28:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.120+0000 7f3e29b6f700 1 --2- 172.21.15.73:0/26327896 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3e08065ad0 0x7f3e08067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:56.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.120+0000 7f3e29b6f700 1 --2- 172.21.15.73:0/26327896 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3e08065ad0 0x7f3e08067f90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e20000fb0 tx=0x7f3e20009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:56.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.124+0000 7f3e167fc700 1 -- 172.21.15.73:0/26327896 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f3e18052250 con 0x7f3e2413d9a0 2023-11-30T23:28:56.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.288+0000 7f3e2ab71700 1 -- 172.21.15.73:0/26327896 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3e2406b530 con 0x7f3e2413d9a0 2023-11-30T23:28:56.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.964+0000 7f3e167fc700 1 -- 172.21.15.73:0/26327896 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3e180150d0 con 0x7f3e2413d9a0 2023-11-30T23:28:56.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.976+0000 7f3e2ab71700 1 -- 172.21.15.73:0/26327896 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3e08065ad0 msgr2=0x7f3e08067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:56.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.976+0000 7f3e2ab71700 1 --2- 172.21.15.73:0/26327896 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3e08065ad0 0x7f3e08067f90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e20000fb0 tx=0x7f3e20009040 comp rx=0 tx=0).stop 2023-11-30T23:28:56.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.976+0000 7f3e2ab71700 1 -- 172.21.15.73:0/26327896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e2413d9a0 msgr2=0x7f3e2413bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:56.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.976+0000 7f3e2ab71700 1 --2- 172.21.15.73:0/26327896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e2413d9a0 0x7f3e2413bf30 secure :-1 s=READY pgs=4285 cs=0 l=1 rev1=1 crypto rx=0x7f3e18013000 tx=0x7f3e18004770 comp rx=0 tx=0).stop 2023-11-30T23:28:56.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.976+0000 7f3e2ab71700 1 -- 172.21.15.73:0/26327896 shutdown_connections 2023-11-30T23:28:56.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.976+0000 7f3e2ab71700 1 --2- 172.21.15.73:0/26327896 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f3e24143480 0x7f3e2412ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:56.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.976+0000 7f3e2ab71700 1 --2- 172.21.15.73:0/26327896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e2413d9a0 0x7f3e2413bf30 unknown :-1 s=CLOSED pgs=4285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:56.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.976+0000 7f3e2ab71700 1 --2- 172.21.15.73:0/26327896 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f3e08065ad0 0x7f3e08067f90 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e20000fb0 tx=0x7f3e20009040 comp rx=0 tx=0).stop 2023-11-30T23:28:56.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.976+0000 7f3e2ab71700 1 --2- 172.21.15.73:0/26327896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e240b2780 0x7f3e24137420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:56.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.976+0000 7f3e2ab71700 1 -- 172.21.15.73:0/26327896 >> 172.21.15.73:0/26327896 conn(0x7f3e240b7b70 msgr2=0x7f3e240b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:56.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.976+0000 7f3e2ab71700 1 -- 172.21.15.73:0/26327896 shutdown_connections 2023-11-30T23:28:56.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:56.976+0000 7f3e2ab71700 1 -- 172.21.15.73:0/26327896 wait complete. 2023-11-30T23:28:56.981 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2023-11-30T23:28:56.998 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-30T23:28:57.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.140+0000 7f456cf26700 1 Processor -- start 2023-11-30T23:28:57.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.140+0000 7f456cf26700 1 -- start start 2023-11-30T23:28:57.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f45680bcb00 0x7f45680b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:57.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4568140550 0x7f45681409a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:57.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45680b4010 con 0x7f456814a150 2023-11-30T23:28:57.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45680b6110 con 0x7f4568140550 2023-11-30T23:28:57.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45680b4820 con 0x7f45680bcb00 2023-11-30T23:28:57.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f4567fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4568140550 0x7f45681409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:57.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f4567fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4568140550 0x7f45681409a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39348/0 (socket says 172.21.15.73:39348) 2023-11-30T23:28:57.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f4567fff700 1 -- 172.21.15.73:0/1913767775 learned_addr learned my addr 172.21.15.73:0/1913767775 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:28:57.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f45677fe700 1 --2- 172.21.15.73:0/1913767775 >> v2:172.21.15.156:3300/0 conn(0x7f45680bcb00 0x7f45680b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:57.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f4567fff700 1 -- 172.21.15.73:0/1913767775 >> v2:172.21.15.156:3300/0 conn(0x7f45680bcb00 msgr2=0x7f45680b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-30T23:28:57.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f4567fff700 1 --2- 172.21.15.73:0/1913767775 >> v2:172.21.15.156:3300/0 conn(0x7f45680bcb00 0x7f45680b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:57.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f4567fff700 1 -- 172.21.15.73:0/1913767775 >> v1:172.21.15.156:6789/0 conn(0x7f456814a150 legacy=0x7f456814a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:57.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f4567fff700 1 -- 172.21.15.73:0/1913767775 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45680bcee0 con 0x7f4568140550 2023-11-30T23:28:57.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f4567fff700 1 --2- 172.21.15.73:0/1913767775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4568140550 0x7f45681409a0 secure :-1 s=READY pgs=4286 cs=0 l=1 rev1=1 crypto rx=0x7f45680bd1d0 tx=0x7f456000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6796443e565d266b server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:57.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f4566ffd700 1 -- 172.21.15.73:0/1913767775 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456000e070 con 0x7f4568140550 2023-11-30T23:28:57.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f4566ffd700 1 -- 172.21.15.73:0/1913767775 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f456000b9c0 con 0x7f4568140550 2023-11-30T23:28:57.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f4566ffd700 1 -- 172.21.15.73:0/1913767775 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456000bd90 con 0x7f4568140550 2023-11-30T23:28:57.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 -- 172.21.15.73:0/1913767775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4568140550 msgr2=0x7f45681409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:57.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 --2- 172.21.15.73:0/1913767775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4568140550 0x7f45681409a0 secure :-1 s=READY pgs=4286 cs=0 l=1 rev1=1 crypto rx=0x7f45680bd1d0 tx=0x7f456000b330 comp rx=0 tx=0).stop 2023-11-30T23:28:57.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 -- 172.21.15.73:0/1913767775 shutdown_connections 2023-11-30T23:28:57.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 --2- 172.21.15.73:0/1913767775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4568140550 0x7f45681409a0 unknown :-1 s=CLOSED pgs=4286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:57.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 --2- 172.21.15.73:0/1913767775 >> v2:172.21.15.156:3300/0 conn(0x7f45680bcb00 0x7f45680b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:57.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 -- 172.21.15.73:0/1913767775 >> 172.21.15.73:0/1913767775 conn(0x7f4568071ff0 msgr2=0x7f45680bc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:57.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 -- 172.21.15.73:0/1913767775 shutdown_connections 2023-11-30T23:28:57.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 -- 172.21.15.73:0/1913767775 wait complete. 2023-11-30T23:28:57.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 Processor -- start 2023-11-30T23:28:57.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 -- start start 2023-11-30T23:28:57.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45680bcb00 0x7f45681df0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:57.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4568140550 0x7f45680b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:57.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 --2- >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456814a150 0x7f45681d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:57.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45681cf7a0 con 0x7f4568140550 2023-11-30T23:28:57.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45680bbb40 con 0x7f45680bcb00 2023-11-30T23:28:57.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.144+0000 7f456cf26700 1 -- --> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45681d06f0 con 0x7f456814a150 2023-11-30T23:28:57.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.148+0000 7f455ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4568140550 0x7f45680b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:57.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.148+0000 7f45677fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45680bcb00 0x7f45681df0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:57.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.148+0000 7f455ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4568140550 0x7f45680b6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39350/0 (socket says 172.21.15.73:39350) 2023-11-30T23:28:57.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.148+0000 7f455ffff700 1 -- 172.21.15.73:0/2031754901 learned_addr learned my addr 172.21.15.73:0/2031754901 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-11-30T23:28:57.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.148+0000 7f4567fff700 1 --2- 172.21.15.73:0/2031754901 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456814a150 0x7f45681d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:57.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.148+0000 7f455ffff700 1 -- 172.21.15.73:0/2031754901 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456814a150 msgr2=0x7f45681d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:57.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.148+0000 7f455ffff700 1 --2- 172.21.15.73:0/2031754901 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456814a150 0x7f45681d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:57.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.148+0000 7f455ffff700 1 -- 172.21.15.73:0/2031754901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45680bcb00 msgr2=0x7f45681df0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.148+0000 7f455ffff700 1 --2- 172.21.15.73:0/2031754901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45680bcb00 0x7f45681df0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.148+0000 7f455ffff700 1 -- 172.21.15.73:0/2031754901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4560009b30 con 0x7f4568140550 2023-11-30T23:28:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.148+0000 7f455ffff700 1 --2- 172.21.15.73:0/2031754901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4568140550 0x7f45680b6bc0 secure :-1 s=READY pgs=4287 cs=0 l=1 rev1=1 crypto rx=0x7f455000c500 tx=0x7f455000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.148+0000 7f4564ff9700 1 -- 172.21.15.73:0/2031754901 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45500052d0 con 0x7f4568140550 2023-11-30T23:28:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.148+0000 7f4564ff9700 1 -- 172.21.15.73:0/2031754901 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4550005430 con 0x7f4568140550 2023-11-30T23:28:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.148+0000 7f456cf26700 1 -- 172.21.15.73:0/2031754901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45681d09d0 con 0x7f4568140550 2023-11-30T23:28:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.148+0000 7f4564ff9700 1 -- 172.21.15.73:0/2031754901 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45500055a0 con 0x7f4568140550 2023-11-30T23:28:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.148+0000 7f456cf26700 1 -- 172.21.15.73:0/2031754901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45680b7610 con 0x7f4568140550 2023-11-30T23:28:57.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.148+0000 7f456cf26700 1 -- 172.21.15.73:0/2031754901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4568067d20 con 0x7f4568140550 2023-11-30T23:28:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.148+0000 7f4564ff9700 1 -- 172.21.15.73:0/2031754901 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4550003900 con 0x7f4568140550 2023-11-30T23:28:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.152+0000 7f4564ff9700 1 --2- 172.21.15.73:0/2031754901 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f4548065ad0 0x7f4548067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-30T23:28:57.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.152+0000 7f45677fe700 1 --2- 172.21.15.73:0/2031754901 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f4548065ad0 0x7f4548067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-30T23:28:57.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.152+0000 7f4564ff9700 1 -- 172.21.15.73:0/2031754901 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f4550082230 con 0x7f4568140550 2023-11-30T23:28:57.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.152+0000 7f45677fe700 1 --2- 172.21.15.73:0/2031754901 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f4548065ad0 0x7f4548067f90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f45680b72c0 tx=0x7f4558008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-30T23:28:57.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.160+0000 7f4564ff9700 1 -- 172.21.15.73:0/2031754901 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f455004fd60 con 0x7f4568140550 2023-11-30T23:28:57.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.388+0000 7f456cf26700 1 -- 172.21.15.73:0/2031754901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f45680bb9a0 con 0x7f4568140550 2023-11-30T23:28:57.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.964+0000 7f4564ff9700 1 -- 172.21.15.73:0/2031754901 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) v1 ==== 169+0+0 (secure 0 0 0) 0x7f45680bb9a0 con 0x7f4568140550 2023-11-30T23:28:57.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.972+0000 7f456cf26700 1 -- 172.21.15.73:0/2031754901 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f4548065ad0 msgr2=0x7f4548067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:57.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.972+0000 7f456cf26700 1 --2- 172.21.15.73:0/2031754901 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f4548065ad0 0x7f4548067f90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f45680b72c0 tx=0x7f4558008040 comp rx=0 tx=0).stop 2023-11-30T23:28:57.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.972+0000 7f456cf26700 1 -- 172.21.15.73:0/2031754901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4568140550 msgr2=0x7f45680b6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-30T23:28:57.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.972+0000 7f456cf26700 1 --2- 172.21.15.73:0/2031754901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4568140550 0x7f45680b6bc0 secure :-1 s=READY pgs=4287 cs=0 l=1 rev1=1 crypto rx=0x7f455000c500 tx=0x7f455000c810 comp rx=0 tx=0).stop 2023-11-30T23:28:57.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.972+0000 7f456cf26700 1 -- 172.21.15.73:0/2031754901 shutdown_connections 2023-11-30T23:28:57.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.972+0000 7f456cf26700 1 --2- 172.21.15.73:0/2031754901 >> [v2:172.21.15.156:3301/0,v1:172.21.15.156:6790/0] conn(0x7f456814a150 0x7f45681d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:57.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.972+0000 7f456cf26700 1 --2- 172.21.15.73:0/2031754901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4568140550 0x7f45680b6bc0 unknown :-1 s=CLOSED pgs=4287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:57.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.972+0000 7f456cf26700 1 --2- 172.21.15.73:0/2031754901 >> [v2:172.21.15.73:6832/36559,v1:172.21.15.73:6833/36559] conn(0x7f4548065ad0 0x7f4548067f90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:57.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.972+0000 7f456cf26700 1 --2- 172.21.15.73:0/2031754901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45680bcb00 0x7f45681df0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-30T23:28:57.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.972+0000 7f456cf26700 1 -- 172.21.15.73:0/2031754901 >> 172.21.15.73:0/2031754901 conn(0x7f4568071ff0 msgr2=0x7f4568146880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-30T23:28:57.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.972+0000 7f456cf26700 1 -- 172.21.15.73:0/2031754901 shutdown_connections 2023-11-30T23:28:57.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-11-30T23:28:57.972+0000 7f456cf26700 1 -- 172.21.15.73:0/2031754901 wait complete. 2023-11-30T23:28:57.977 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2023-11-30T23:28:57.994 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-30T23:28:57.995 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-30T23:28:57.995 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T23:28:58.007 INFO:tasks.ceph.mds.a:Stopped 2023-11-30T23:28:58.007 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-30T23:28:58.007 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T23:28:58.016 INFO:tasks.ceph.mds.b:Stopped 2023-11-30T23:28:58.017 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-30T23:28:58.017 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-30T23:28:58.017 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T23:28:58.118 INFO:tasks.ceph.osd.0:Stopped 2023-11-30T23:28:58.119 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-30T23:28:58.119 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T23:28:58.201 INFO:tasks.ceph.osd.1:Stopped 2023-11-30T23:28:58.202 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-30T23:28:58.202 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T23:28:58.262 INFO:tasks.ceph.osd.2:Stopped 2023-11-30T23:28:58.263 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-30T23:28:58.263 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T23:28:59.292 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:28:59.295 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:29:04.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-30T23:29:04.366 INFO:tasks.ceph.osd.3:Stopped 2023-11-30T23:29:04.369 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-30T23:29:04.370 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T23:29:04.452 INFO:tasks.ceph.osd.4:Stopped 2023-11-30T23:29:04.453 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-30T23:29:04.453 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T23:29:04.546 INFO:tasks.ceph.osd.5:Stopped 2023-11-30T23:29:04.546 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-30T23:29:04.546 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T23:29:04.648 INFO:tasks.ceph.osd.6:Stopped 2023-11-30T23:29:04.648 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-30T23:29:04.648 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T23:29:04.734 INFO:tasks.ceph.osd.7:Stopped 2023-11-30T23:29:04.735 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-30T23:29:04.735 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-30T23:29:04.735 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T23:29:04.767 INFO:tasks.ceph.mgr.y:Stopped 2023-11-30T23:29:04.768 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-30T23:29:04.768 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T23:29:04.800 INFO:tasks.ceph.mgr.x:Stopped 2023-11-30T23:29:04.801 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-30T23:29:04.801 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-30T23:29:04.801 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T23:29:04.826 INFO:tasks.ceph.mon.a:Stopped 2023-11-30T23:29:04.826 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-30T23:29:04.827 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T23:29:04.845 INFO:tasks.ceph.mon.b:Stopped 2023-11-30T23:29:04.845 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-30T23:29:04.845 INFO:teuthology.orchestra.run:waiting for 300 2023-11-30T23:29:04.864 INFO:tasks.ceph.mon.c:Stopped 2023-11-30T23:29:04.864 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-30T23:29:04.865 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-30T23:29:04.889 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi073.front.sepia.ceph.com 2023-11-30T23:29:04.890 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-30T23:29:05.142 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi073.front.sepia.ceph.com 2023-11-30T23:29:05.142 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-30T23:29:05.461 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi073.front.sepia.ceph.com 2023-11-30T23:29:05.462 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-30T23:29:05.712 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi073.front.sepia.ceph.com 2023-11-30T23:29:05.713 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-30T23:29:05.903 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-30T23:29:05.904 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-30T23:29:06.324 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-30T23:29:06.325 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-30T23:29:06.533 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-30T23:29:06.534 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-30T23:29:06.794 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-30T23:29:06.794 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-30T23:29:07.024 INFO:tasks.ceph:Archiving mon data... 2023-11-30T23:29:07.026 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473010/data/mon.a.tgz 2023-11-30T23:29:07.026 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-11-30T23:29:07.034 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.JxpsQnXfLf 2023-11-30T23:29:07.034 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.JxpsQnXfLf 2023-11-30T23:29:07.118 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.JxpsQnXfLf 2023-11-30T23:29:07.141 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.JxpsQnXfLf is 308KB 2023-11-30T23:29:07.207 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.JxpsQnXfLf 2023-11-30T23:29:07.214 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473010/data/mon.b.tgz 2023-11-30T23:29:07.215 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2023-11-30T23:29:07.221 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.lPXU6ePQMf 2023-11-30T23:29:07.222 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.lPXU6ePQMf 2023-11-30T23:29:07.346 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.lPXU6ePQMf 2023-11-30T23:29:07.370 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.lPXU6ePQMf is 314KB 2023-11-30T23:29:07.433 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.lPXU6ePQMf 2023-11-30T23:29:07.441 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473010/data/mon.c.tgz 2023-11-30T23:29:07.441 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2023-11-30T23:29:07.449 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.TTagAlIsPF 2023-11-30T23:29:07.449 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.TTagAlIsPF 2023-11-30T23:29:07.576 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.TTagAlIsPF 2023-11-30T23:29:07.595 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.TTagAlIsPF is 314KB 2023-11-30T23:29:07.657 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.TTagAlIsPF 2023-11-30T23:29:07.664 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-30T23:29:07.664 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-30T23:29:07.666 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-30T23:29:07.681 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-30T23:29:07.681 DEBUG:teuthology.orchestra.run.smithi073:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-30T23:29:07.683 DEBUG:teuthology.orchestra.run.smithi156:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-30T23:29:07.710 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-30T23:29:07.712 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-30T23:29:07.719 INFO:tasks.ceph:Archiving crash dumps... 2023-11-30T23:29:07.721 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473010/remote/smithi073/crash 2023-11-30T23:29:07.722 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-30T23:29:07.774 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473010/remote/smithi156/crash 2023-11-30T23:29:07.775 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-30T23:29:07.793 INFO:tasks.ceph:Shutting down logrotate 2023-11-30T23:29:07.793 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:29:07.795 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-30T23:29:07.840 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-30T23:29:07.856 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-30T23:29:07.870 INFO:tasks.ceph:Compressing logs... 2023-11-30T23:29:07.871 DEBUG:teuthology.orchestra.run.smithi073:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-30T23:29:07.899 DEBUG:teuthology.orchestra.run.smithi156:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-30T23:29:09.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-11-30T23:30:27.829 INFO:tasks.ceph:Archiving logs... 2023-11-30T23:30:27.829 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473010/remote/smithi073/log 2023-11-30T23:30:27.830 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-30T23:30:37.663 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473010/remote/smithi156/log 2023-11-30T23:30:37.664 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-30T23:30:56.706 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-30T23:30:56.716 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-30T23:30:56.716 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-30T23:30:56.719 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-30T23:30:56.806 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-30T23:30:56.815 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-30T23:30:56.816 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-30T23:30:56.818 DEBUG:teuthology.orchestra.run.smithi156:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-30T23:30:56.840 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2023-11-30T23:30:56.841 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2023-11-30T23:30:56.841 INFO:teuthology.orchestra.run.smithi073.stdout:*hv01.front.sepi 44.4.53.2 2 u 28 64 377 0.093 -1.147 0.028 2023-11-30T23:30:56.841 INFO:teuthology.orchestra.run.smithi073.stdout:+hv02.front.sepi 63.231.80.2 3 u 30 64 377 0.078 -0.511 0.046 2023-11-30T23:30:56.841 INFO:teuthology.orchestra.run.smithi073.stdout:+hv03.front.sepi 74.6.168.72 3 u 39 64 377 0.078 0.742 0.055 2023-11-30T23:30:56.841 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 0.000 0.000 2023-11-30T23:30:56.843 INFO:teuthology.orchestra.run.smithi156.stdout: remote refid st t when poll reach delay offset jitter 2023-11-30T23:30:56.843 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================== 2023-11-30T23:30:56.843 INFO:teuthology.orchestra.run.smithi156.stdout:*hv01.front.sepi 44.4.53.2 2 u 41 64 377 0.091 3.325 0.939 2023-11-30T23:30:56.843 INFO:teuthology.orchestra.run.smithi156.stdout:+hv02.front.sepi 63.231.80.2 3 u 40 64 377 0.064 3.220 1.525 2023-11-30T23:30:56.843 INFO:teuthology.orchestra.run.smithi156.stdout:+hv03.front.sepi 74.6.168.72 3 u 45 64 377 0.097 4.826 1.182 2023-11-30T23:30:56.843 INFO:teuthology.orchestra.run.smithi156.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 0.000 0.000 2023-11-30T23:30:56.844 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-30T23:30:56.895 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-30T23:30:56.896 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-30T23:30:56.904 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-30T23:30:56.913 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-30T23:30:56.922 INFO:teuthology.task.internal:Duration was 1754.511271 seconds 2023-11-30T23:30:56.923 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-30T23:30:56.933 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-30T23:30:56.933 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-30T23:30:56.936 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-30T23:30:56.988 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-30T23:30:56.988 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2023-11-30T23:30:56.988 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-30T23:30:57.000 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi156.front.sepia.ceph.com 2023-11-30T23:30:57.001 DEBUG:teuthology.orchestra.run.smithi156:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-30T23:30:57.014 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-30T23:30:57.014 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-30T23:30:57.017 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-30T23:30:57.049 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-30T23:30:57.049 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-30T23:30:57.095 DEBUG:teuthology.orchestra.run.smithi156:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-30T23:30:57.175 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-30T23:30:57.192 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-30T23:30:57.193 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-30T23:30:57.210 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-30T23:30:57.227 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-30T23:30:57.237 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-30T23:30:57.240 DEBUG:teuthology.orchestra.run.smithi156:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-30T23:30:57.252 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2023-11-30T23:30:57.256 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = core 2023-11-30T23:30:57.306 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-30T23:30:57.338 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi073.front.sepia.ceph.com, flagging run as failed 2023-11-30T23:30:57.339 DEBUG:teuthology.orchestra.run.smithi156:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-30T23:30:57.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T23:30:57.354 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-30T23:30:57.366 INFO:teuthology.task.internal:Transferring archived files... 2023-11-30T23:30:57.367 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473010/remote/smithi073 2023-11-30T23:30:57.367 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-30T23:30:57.509 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-11-30T23:30:57.828 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473010/remote/smithi073/coredump/1701386861.84445.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph_test_libcephfs_reclaim', real uid: 1000, effective uid: 1000, real gid: 1267, effective gid: 1267, execfn: '/usr/bin/ceph_test_libcephfs_reclaim', platform: 'x86_64' 2023-11-30T23:30:57.829 INFO:teuthology.task.internal: dump_program: ceph_test_libcephfs_reclaim 2023-11-30T23:30:57.830 DEBUG:teuthology.orchestra.run.smithi073:> which ceph_test_libcephfs_reclaim 2023-11-30T23:30:57.837 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/bin/ceph_test_libcephfs_reclaim 2023-11-30T23:30:57.850 DEBUG:teuthology.orchestra.remote:smithi073:/usr/bin/ceph_test_libcephfs_reclaim is 2MB 2023-11-30T23:30:57.937 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-11-30T23:30:57.944 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.ikmxLr75Qo 2023-11-30T23:30:57.944 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /usr/bin/ceph_test_libcephfs_reclaim /tmp/tmp.ikmxLr75Qo 2023-11-30T23:30:57.965 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.ikmxLr75Qo 2023-11-30T23:30:58.028 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.ikmxLr75Qo is 2MB 2023-11-30T23:30:58.127 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.ikmxLr75Qo 2023-11-30T23:30:58.135 DEBUG:teuthology.misc:Transferring archived files from smithi156:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473010/remote/smithi156 2023-11-30T23:30:58.135 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-30T23:30:58.160 INFO:teuthology.task.internal:Removing archive directory... 2023-11-30T23:30:58.160 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-30T23:30:58.163 DEBUG:teuthology.orchestra.run.smithi156:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-30T23:30:58.207 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-30T23:30:58.221 INFO:teuthology.task.internal:Not uploading archives. 2023-11-30T23:30:58.221 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-30T23:30:58.232 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-30T23:30:58.232 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-30T23:30:58.235 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-30T23:30:58.240 INFO:teuthology.orchestra.run.smithi073.stdout: 924112 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 30 23:30 /home/ubuntu/cephtest 2023-11-30T23:30:58.240 INFO:teuthology.orchestra.run.smithi073.stdout: 1186017 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 30 23:13 /home/ubuntu/cephtest/mnt.0 2023-11-30T23:30:58.241 INFO:teuthology.orchestra.run.smithi073.stdout: 1186018 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 30 23:14 /home/ubuntu/cephtest/mnt.0/client.0 2023-11-30T23:30:58.241 INFO:teuthology.orchestra.run.smithi073.stdout: 1199789 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 30 23:14 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-30T23:30:58.242 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-11-30T23:30:58.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-30T23:30:58.243 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-11-30T23:30:58.252 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-30T23:30:58.265 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-30T23:30:58.276 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi073 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-11-30T23:30:58.276 INFO:teuthology.nuke:Checking targets against current locks 2023-11-30T23:30:58.285 INFO:teuthology.orchestra.run.smithi156.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 30 23:30 /home/ubuntu/cephtest 2023-11-30T23:30:58.320 DEBUG:teuthology.nuke:shortname: smithi073 2023-11-30T23:30:58.320 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-30T23:30:58.350 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473010', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-30 22:51:46.750546', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-30T23:30:58.354 DEBUG:teuthology.nuke:shortname: smithi156 2023-11-30T23:30:58.354 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-30T23:30:58.386 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473010', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-30 22:51:46.749061', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-30T23:30:58.415 INFO:teuthology.orchestra.console.smithi073:Power off 2023-11-30T23:30:58.417 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-30T23:30:58.447 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2023-11-30T23:30:58.447 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T23:30:58.470 INFO:teuthology.orchestra.console.smithi156:Power off 2023-11-30T23:30:58.470 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-30T23:30:58.484 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-11-30T23:30:58.498 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-11-30T23:30:58.499 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T23:30:58.530 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-11-30T23:31:02.485 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T23:31:02.531 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T23:31:02.600 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-11-30T23:31:02.647 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-11-30T23:31:06.602 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T23:31:06.648 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T23:31:06.717 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-11-30T23:31:06.762 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-11-30T23:31:06.818 INFO:teuthology.orchestra.console.smithi073:Power off completed 2023-11-30T23:31:10.765 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T23:31:10.876 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-30T23:31:10.976 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-11-30T23:31:11.082 INFO:teuthology.run:Summary data: description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_20.04} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}} duration: 1754.5112709999084 failure_reason: 'Command failed (workunit test libcephfs/test.sh) on smithi073 with status 139: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a6f82997ac57b70a895455dfed6256360a1e4c32 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=7fcc23c315134363a51929320c92f144 status: fail success: false 2023-11-30T23:31:11.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T23:31:11.177 INFO:teuthology.run:FAIL